Jul 14 22:57:23.953176 ip-10-0-136-11 systemd[1]: Starting Kubernetes Kubelet... Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.393548 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398687 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398703 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398707 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398709 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398712 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398715 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398717 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:57:26.030679 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398720 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:57:25.963304 ip-10-0-136-11 systemd[1]: Started Kubernetes Kubelet. Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398724 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398727 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398729 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398732 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398734 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398737 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398740 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398743 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398746 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398748 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398751 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398754 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398756 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398759 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398762 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398765 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398768 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398770 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:57:26.031778 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398773 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398775 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398779 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398781 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398784 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398787 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398790 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398793 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398795 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398798 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398800 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398803 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398806 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398809 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398811 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398813 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398816 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398837 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398845 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398850 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:57:26.032506 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398853 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398856 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398858 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398861 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398864 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398866 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398869 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398871 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398874 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398877 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398879 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398882 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398884 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398888 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398892 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398895 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398899 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398904 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398909 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:57:26.033120 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398912 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398916 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398918 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398921 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398924 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398927 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398930 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398932 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398935 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398938 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398941 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398943 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398946 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398948 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398952 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398955 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398958 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398961 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398964 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398967 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:57:26.033725 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398970 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398972 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398975 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398977 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398980 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398982 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398985 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398988 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398990 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398993 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398995 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.398998 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399000 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399003 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399714 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399723 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399727 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399729 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399732 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399735 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:57:26.034288 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399738 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399741 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399743 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399746 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399749 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399751 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399755 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399758 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399760 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399763 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399765 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399769 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399771 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399774 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399776 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399779 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399783 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399786 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399789 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:57:26.034928 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399792 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399795 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399798 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399800 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399803 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399806 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399808 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399812 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399814 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399817 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399836 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399839 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399842 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399844 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399847 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399850 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399852 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399862 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399866 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399870 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:57:26.035529 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399873 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399876 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399879 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399883 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399885 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399889 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399892 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399895 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399898 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399901 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399904 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399907 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399910 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399913 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399916 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399918 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399921 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399923 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399926 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399929 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:57:26.036131 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399931 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399934 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399937 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399939 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399942 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399944 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399948 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399950 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399953 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399955 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399958 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399960 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399963 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399966 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399968 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399971 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399974 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399977 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399980 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399983 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:57:26.036733 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399985 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399988 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399990 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399993 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399995 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.399998 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400000 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400002 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400005 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400007 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400010 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400012 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400015 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400017 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400443 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400449 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400453 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400456 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400459 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400462 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:57:26.037347 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400464 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400467 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400470 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400473 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400475 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400478 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400480 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400484 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400488 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400492 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400495 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400498 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400501 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400504 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400506 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400509 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400511 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400514 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400516 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400518 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:57:26.037920 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400521 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400523 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400526 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400528 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400531 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400533 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400539 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400542 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400544 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400547 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400549 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400552 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400554 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400557 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400559 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400562 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400565 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400567 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400570 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400573 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:57:26.038554 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400575 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400578 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400580 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400584 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400587 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400589 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400592 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400595 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400600 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400603 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400605 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400607 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400610 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400613 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400615 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400618 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400620 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400623 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400627 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:57:26.039081 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400630 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400633 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400637 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400639 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400642 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400645 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400648 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400651 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400653 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400656 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400659 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400662 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400664 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400667 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400670 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400673 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400675 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400678 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400680 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400683 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:57:26.040053 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400685 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400688 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400690 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400693 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400696 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400698 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400701 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400703 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400706 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400708 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400711 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400715 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400718 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.400720 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400790 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400799 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400808 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400815 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400836 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400842 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400847 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 22:57:26.040944 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400851 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400855 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400858 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400862 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400865 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400870 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400873 2568 flags.go:64] FLAG: --cgroup-root="" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400876 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400879 2568 flags.go:64] FLAG: --client-ca-file="" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400882 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400885 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400889 2568 flags.go:64] FLAG: --cluster-domain="" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400892 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400895 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400898 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400902 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400906 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400909 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400912 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400915 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400918 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400921 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400925 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400928 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 22:57:26.041834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400931 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400936 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400939 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400942 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400944 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400947 2568 flags.go:64] FLAG: --enable-server="true" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400950 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400956 2568 flags.go:64] FLAG: --event-burst="100" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400959 2568 flags.go:64] FLAG: --event-qps="50" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400962 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400965 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400968 2568 flags.go:64] FLAG: --eviction-hard="" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400972 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400976 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400979 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400982 2568 flags.go:64] FLAG: --eviction-soft="" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400985 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400988 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400991 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400994 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.400997 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401000 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401002 2568 flags.go:64] FLAG: --feature-gates="" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401006 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401009 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 22:57:26.042948 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401012 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401014 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401017 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401020 2568 flags.go:64] FLAG: --help="false" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401023 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401027 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401030 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401033 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401036 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401040 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401042 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401045 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401048 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401050 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401054 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401056 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401059 2568 flags.go:64] FLAG: --kube-reserved="" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401062 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401065 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401068 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401072 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401074 2568 flags.go:64] FLAG: --lock-file="" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401077 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401080 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 22:57:26.044057 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401083 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401088 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401091 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401094 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401097 2568 flags.go:64] FLAG: --logging-format="text" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401100 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401103 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401106 2568 flags.go:64] FLAG: --manifest-url="" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401108 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401113 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401115 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401119 2568 flags.go:64] FLAG: --max-pods="110" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401122 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401127 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401130 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401133 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401136 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401139 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401142 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401149 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401152 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401155 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401158 2568 flags.go:64] FLAG: --pod-cidr="" Jul 14 22:57:26.048214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401161 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401166 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401169 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401172 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401175 2568 flags.go:64] FLAG: --port="10250" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401179 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401182 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f38e21b9ccbd49bc" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401185 2568 flags.go:64] FLAG: --qos-reserved="" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401188 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401191 2568 flags.go:64] FLAG: --register-node="true" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401194 2568 flags.go:64] FLAG: --register-with-taints="" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401198 2568 flags.go:64] FLAG: --registry-burst="10" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401201 2568 flags.go:64] FLAG: --registry-qps="5" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401204 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401206 2568 flags.go:64] FLAG: --reserved-memory="" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401210 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401213 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401216 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401219 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401222 2568 flags.go:64] FLAG: --runonce="false" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401224 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401228 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401230 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401235 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401238 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401241 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 22:57:26.049322 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401243 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401247 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401249 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401253 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401255 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401258 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401261 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401264 2568 flags.go:64] FLAG: --system-cgroups="" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401267 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401272 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401274 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401279 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401284 2568 flags.go:64] FLAG: --tls-min-version="" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401287 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401289 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401292 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401295 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401298 2568 flags.go:64] FLAG: --v="2" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401301 2568 flags.go:64] FLAG: --version="false" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401306 2568 flags.go:64] FLAG: --vmodule="" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401310 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.401314 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401429 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401433 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:57:26.277360 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401436 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401439 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401441 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401444 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401446 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401450 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401453 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401456 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401458 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401461 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401464 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401466 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401469 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401473 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401477 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401480 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401483 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401486 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401489 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:57:26.300718 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401494 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401497 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401501 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401503 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401506 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401510 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401514 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401517 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401519 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401522 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401525 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401528 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401530 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401533 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401535 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401538 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401540 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401543 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401547 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:57:26.301748 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401549 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401552 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401554 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401557 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401559 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401562 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401564 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401567 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401569 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401572 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401575 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401577 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401579 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401583 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401586 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401589 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401591 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401594 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401597 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401599 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:57:26.302328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401601 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401604 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401606 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401610 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401612 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401615 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401617 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401620 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401622 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401625 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401628 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401632 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401634 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401637 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401639 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401642 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401644 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401656 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401658 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401661 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401664 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:57:26.302950 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401666 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401669 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401671 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401674 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401678 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401681 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401683 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401686 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401689 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401691 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401694 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401696 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401699 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401701 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401704 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401707 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401710 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:57:26.303582 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.401712 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.402404 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.409764 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.409785 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.409811 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.409839 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409915 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409922 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409927 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409931 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409936 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409940 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409944 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409948 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409953 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:57:26.304044 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409957 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409961 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409965 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409969 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409973 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409977 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409981 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409985 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409988 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409992 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.409996 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410000 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410003 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410007 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410010 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410014 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410018 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410022 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410026 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410030 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:57:26.304531 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410035 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410039 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410043 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410047 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410051 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410055 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410059 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410062 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410066 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410070 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410073 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410077 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410080 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410084 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410088 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410093 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410099 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410103 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410107 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:57:26.305072 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410112 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410116 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410120 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410123 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410130 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410133 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410137 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410141 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410145 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410149 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410153 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410157 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410161 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410165 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410171 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410176 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410181 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410185 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410189 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:57:26.305639 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410194 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410197 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410201 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410205 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410208 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410212 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410216 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410220 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410223 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410227 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410231 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410236 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410240 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410244 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410248 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410252 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410256 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410262 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410266 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:57:26.306176 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410270 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410276 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410281 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410285 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410289 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410293 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410297 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410301 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410304 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410310 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410314 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410318 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410322 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.410329 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410490 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:57:26.306777 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410497 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410501 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410505 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410510 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410514 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410518 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410523 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410527 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410531 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410536 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410540 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410544 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410548 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410552 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410555 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410559 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410565 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410569 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410572 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410576 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:57:26.307225 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410580 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410584 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410588 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410591 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410595 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410599 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410603 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410607 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410611 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410615 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410618 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410622 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410626 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410630 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410635 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410639 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410643 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410647 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410650 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:57:26.307817 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410654 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410658 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410663 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410667 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410671 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410674 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410678 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410682 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410686 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410691 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410695 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410699 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410703 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410706 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410711 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410714 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410718 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410722 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410725 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410730 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:57:26.308328 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410733 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410737 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410741 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410745 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410751 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410756 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410760 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410764 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410768 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410771 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410775 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410781 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410785 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410790 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410795 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410799 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410803 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410807 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410811 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:57:26.308927 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410814 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410818 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410839 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410843 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410846 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410850 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410855 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410858 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410862 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410866 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410870 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410874 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410878 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410881 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410885 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410889 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410893 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410897 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410901 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:57:26.309467 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:24.410904 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.410911 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.411050 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.413456 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.414990 2568 server.go:1019] "Starting client certificate rotation" Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.415097 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.415130 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.417864 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.419089 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.431949 2568 log.go:25] "Validated CRI v1 runtime API" Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.433945 2568 log.go:25] "Validated CRI v1 image API" Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:24.434696 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 22:57:26.310012 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.937508 2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cc19314e-fa93-493d-856d-0f35a0a155c2:/dev/nvme0n1p4 f2c95e5d-3e5f-4063-9ff9-d2fdfd5ea9e4:/dev/nvme0n1p3] Jul 14 22:57:26.310388 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.937523 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 22:57:26.310501 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.943472 2568 manager.go:216] Machine: {Timestamp:2026-07-14 22:57:25.941989901 +0000 UTC m=+0.374234865 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099889 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2392b0b2a68aced5a2bc20e7e8a2f7 SystemUUID:ec2392b0-b2a6-8ace-d5a2-bc20e7e8a2f7 BootID:2ec7a5c3-4bd8-4734-9e51-95c24ed0abcd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:37:a6:36:1c:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:37:a6:36:1c:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:95:76:79:ad:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 22:57:26.310501 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.943572 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 22:57:26.310501 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.943644 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 22:57:26.310501 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.945685 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 22:57:26.310501 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.945707 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-11.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 22:57:26.310501 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.946629 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 22:57:26.310501 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.946639 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 22:57:26.310501 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.946646 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.947368 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.948624 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.950358 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.952622 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.952734 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.952761 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.952771 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.952781 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.952789 2568 kubelet.go:398] "Adding apiserver pod source" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.952799 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.953136 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.953152 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.955599 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.957639 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.957665 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.957865 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.957878 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.957884 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.957890 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.957898 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.957903 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.958479 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.958485 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.958491 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.958497 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.958505 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.958514 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.959365 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.959372 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:25.960637 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.960660 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-11.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:25.960779 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-11.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.962500 2568 server.go:1268] "Started kubelet" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.962556 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.962566 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.962626 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.965296 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.968289 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 22:57:26.311069 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:25.969578 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.972199 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.972207 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:25.972259 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.972855 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.972864 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.972883 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.972985 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.972995 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.973001 2568 factory.go:55] Registering systemd factory Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.973016 2568 factory.go:223] Registration of the systemd container factory successfully Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.973197 2568 factory.go:153] Registering CRI-O factory Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.973211 2568 factory.go:223] Registration of the crio container factory successfully Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.973275 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.973296 2568 factory.go:103] Registering Raw factory Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.973310 2568 manager.go:1196] Started watching for new ooms in manager Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.973934 2568 manager.go:349] Starting recovery of all containers Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.974710 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-phkhq" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:25.975507 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:25.982350 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-11.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:25.975557 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-11.ec2.internal.18c24a128f143d4e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-11.ec2.internal,UID:ip-10-0-136-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-11.ec2.internal,},FirstTimestamp:2026-07-14 22:57:25.962472782 +0000 UTC m=+0.394717746,LastTimestamp:2026-07-14 22:57:25.962472782 +0000 UTC m=+0.394717746,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-11.ec2.internal,}" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.983112 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-phkhq" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.985442 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.990505 2568 manager.go:354] Recovery completed Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.994590 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.996269 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.996298 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:57:26.312222 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.996312 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:25.998424 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-11.ec2.internal.18c24a129118260d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-11.ec2.internal,UID:ip-10-0-136-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-11.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-11.ec2.internal,},FirstTimestamp:2026-07-14 22:57:25.996283405 +0000 UTC m=+0.428528372,LastTimestamp:2026-07-14 22:57:25.996283405 +0000 UTC m=+0.428528372,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-11.ec2.internal,}" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.998552 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.998562 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.998562 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.998629 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.999236 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.999256 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:25.999264 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.000647 2568 policy_none.go:49] "None policy: Start" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.000659 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.000668 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.002668 2568 policy_none.go:47] "Start" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.052701 2568 manager.go:337] "Starting Device Plugin manager" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.052841 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.052854 2568 server.go:87] "Starting device plugin registration server" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.053055 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.053064 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.053179 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.053268 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.053276 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.053808 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.053854 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.153755 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.154805 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.154833 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.154842 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.154872 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.163165 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.163200 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.163205 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.163225 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.163226 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-11.ec2.internal\": node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.163265 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 22:57:26.542870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.165496 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.191774 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.263803 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-11.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal"] Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.263867 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.264841 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.264865 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.264874 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.267604 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.267705 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.267734 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.268366 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.268366 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.268403 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.268412 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.268387 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.268467 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.270589 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.270615 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.273843 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a51735bdb7a0293d22b75abc2bc9c15-config\") pod \"kube-apiserver-proxy-ip-10-0-136-11.ec2.internal\" (UID: \"0a51735bdb7a0293d22b75abc2bc9c15\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.273865 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8f5ae50e2c9b9caf6ad8967394ab762-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal\" (UID: \"c8f5ae50e2c9b9caf6ad8967394ab762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.273879 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8f5ae50e2c9b9caf6ad8967394ab762-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal\" (UID: \"c8f5ae50e2c9b9caf6ad8967394ab762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.282754 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.282776 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.282785 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.286904 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-11.ec2.internal\" not found" node="ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.291827 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:26.543945 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.293037 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-11.ec2.internal\" not found" node="ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.544668 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.374565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a51735bdb7a0293d22b75abc2bc9c15-config\") pod \"kube-apiserver-proxy-ip-10-0-136-11.ec2.internal\" (UID: \"0a51735bdb7a0293d22b75abc2bc9c15\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.544668 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.374593 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8f5ae50e2c9b9caf6ad8967394ab762-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal\" (UID: \"c8f5ae50e2c9b9caf6ad8967394ab762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.544668 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.374614 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8f5ae50e2c9b9caf6ad8967394ab762-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal\" (UID: \"c8f5ae50e2c9b9caf6ad8967394ab762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.544668 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.374648 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8f5ae50e2c9b9caf6ad8967394ab762-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal\" (UID: \"c8f5ae50e2c9b9caf6ad8967394ab762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.544668 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.374662 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a51735bdb7a0293d22b75abc2bc9c15-config\") pod \"kube-apiserver-proxy-ip-10-0-136-11.ec2.internal\" (UID: \"0a51735bdb7a0293d22b75abc2bc9c15\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.544668 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.374663 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8f5ae50e2c9b9caf6ad8967394ab762-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal\" (UID: \"c8f5ae50e2c9b9caf6ad8967394ab762\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.544668 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.392653 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:26.544668 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.493404 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:26.786820 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.588985 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.786820 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.593466 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:26.786820 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.595602 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" Jul 14 22:57:26.786820 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.693833 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:27.017859 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.794853 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:27.017859 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.877057 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 22:57:27.017859 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.895474 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:27.017859 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.905617 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 22:57:27.017859 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.905738 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 22:57:27.017859 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.905761 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 22:57:27.017859 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.987429 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 22:52:25 +0000 UTC" deadline="2028-03-17 21:54:33.799735764 +0000 UTC" Jul 14 22:57:27.017859 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:26.987453 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14686h57m6.812285463s" Jul 14 22:57:27.017859 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:26.996570 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:27.182072 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:27.097228 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:27.413894 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:27.198067 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:27.413894 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:27.219257 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f5ae50e2c9b9caf6ad8967394ab762.slice/crio-dbbcb3fe3ca5bbebec66ff6f1792a102a16a875119977419b83b8331d8caee00 WatchSource:0}: Error finding container dbbcb3fe3ca5bbebec66ff6f1792a102a16a875119977419b83b8331d8caee00: Status 404 returned error can't find the container with id dbbcb3fe3ca5bbebec66ff6f1792a102a16a875119977419b83b8331d8caee00 Jul 14 22:57:27.413894 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:27.219951 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a51735bdb7a0293d22b75abc2bc9c15.slice/crio-0ad5925fd2327795e3a4f09bee4ac5f461ccb8afbcc65afac8c5c04ec67da149 WatchSource:0}: Error finding container 0ad5925fd2327795e3a4f09bee4ac5f461ccb8afbcc65afac8c5c04ec67da149: Status 404 returned error can't find the container with id 0ad5925fd2327795e3a4f09bee4ac5f461ccb8afbcc65afac8c5c04ec67da149 Jul 14 22:57:27.413894 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.224145 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 22:57:27.413894 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:27.298707 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:27.413894 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:27.399155 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:27.657263 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.452728 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 22:57:27.657263 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:27.499964 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-11.ec2.internal\" not found" Jul 14 22:57:27.657263 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.554037 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 22:57:27.657263 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.572758 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-11.ec2.internal" Jul 14 22:57:27.657263 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.583365 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 22:57:27.657263 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.584614 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" Jul 14 22:57:27.657263 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.596228 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 22:57:27.837125 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.797080 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 22:57:27.955815 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.954764 2568 apiserver.go:52] "Watching apiserver" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.972413 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.972628 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.974486 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-7tk8s","kube-system/konnectivity-agent-7ggdn","kube-system/kube-apiserver-proxy-ip-10-0-136-11.ec2.internal","openshift-image-registry/node-ca-bzgjx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal","openshift-multus/multus-additional-cni-plugins-z4zvr","openshift-ovn-kubernetes/ovnkube-node-vcdms","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc","openshift-cluster-node-tuning-operator/tuned-nwqrk","openshift-dns/node-resolver-7dpvq","openshift-multus/multus-wlhk2","openshift-multus/network-metrics-daemon-p8fj7","openshift-network-diagnostics/network-check-target-q5g45","openshift-network-operator/iptables-alerter-vm2zm"] Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.982680 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.984954 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.985599 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.985661 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.985714 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.985876 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.985943 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.986191 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.986457 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ff7p7\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.987242 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vm2zm" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.989183 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.989426 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.989709 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bzgjx" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.991912 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:27.999639 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.009191 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.009758 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.009758 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.009893 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.009967 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4rffc\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010043 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010124 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010174 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010240 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-clmww\"" Jul 14 22:57:28.040571 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010362 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010504 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jxksr\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010661 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010726 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010663 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010848 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nzpml\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010871 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.010993 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.011109 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.011112 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.011128 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pxzld\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.011277 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.011427 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.013034 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.013986 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.014388 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.014428 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nkgkf" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.014619 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rcjxj\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.015495 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lp8pr\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.015737 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.015749 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.015885 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7dpvq" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.017659 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.017730 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.018018 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.018060 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.018287 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fkjb4\"" Jul 14 22:57:28.042068 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.019997 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:28.043263 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.020057 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:28.043263 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.040821 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nkgkf" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.075129 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.083644 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-cni-bin\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.083680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-cnibin\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.083705 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-daemon-config\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.083727 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-sys\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.083750 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.083773 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75e2573c-b255-4b0f-8879-cc5825e6d7c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.083796 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-slash\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.083817 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-run-netns\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.083839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-run-ovn\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095481 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-log-socket\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095511 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs698\" (UniqueName: \"kubernetes.io/projected/73558940-4ec3-47d2-a883-c0d5d6341f31-kube-api-access-cs698\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095535 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-run-systemd\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.119765 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095556 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d420c798-c1c3-462e-b030-fbabe9480da0-ovnkube-config\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095618 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-run-multus-certs\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095672 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-socket-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095710 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-registration-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-cni-dir\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095762 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-host\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-node-log\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095857 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tls2f\" (UniqueName: \"kubernetes.io/projected/d420c798-c1c3-462e-b030-fbabe9480da0-kube-api-access-tls2f\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095887 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/917de4b2-08fe-4ab6-ba15-69da63fa81cc-dbus\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095911 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-var-lib-cni-multus\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095936 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-sys-fs\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095957 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-os-release\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.095993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-sysctl-conf\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.120679 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096044 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c60e6c84-2ebd-4ca0-bc49-5f1896a5677a-host-slash\") pod \"iptables-alerter-vm2zm\" (UID: \"c60e6c84-2ebd-4ca0-bc49-5f1896a5677a\") " pod="openshift-network-operator/iptables-alerter-vm2zm" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096082 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-device-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096115 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-sysconfig\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096141 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-systemd-units\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096166 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-run-openvswitch\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096189 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c60e6c84-2ebd-4ca0-bc49-5f1896a5677a-iptables-alerter-script\") pod \"iptables-alerter-vm2zm\" (UID: \"c60e6c84-2ebd-4ca0-bc49-5f1896a5677a\") " pod="openshift-network-operator/iptables-alerter-vm2zm" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-system-cni-dir\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096240 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt9sj\" (UniqueName: \"kubernetes.io/projected/fc0ef685-669f-4c4e-a941-a9fd9e20765f-kube-api-access-vt9sj\") pod \"node-resolver-7dpvq\" (UID: \"fc0ef685-669f-4c4e-a941-a9fd9e20765f\") " pod="openshift-dns/node-resolver-7dpvq" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096263 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-var-lib-kubelet\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-hostroot\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096387 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75e2573c-b255-4b0f-8879-cc5825e6d7c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75e2573c-b255-4b0f-8879-cc5825e6d7c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.121908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096447 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-socket-dir-parent\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096516 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d420c798-c1c3-462e-b030-fbabe9480da0-env-overrides\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096538 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7tgl\" (UniqueName: \"kubernetes.io/projected/c60e6c84-2ebd-4ca0-bc49-5f1896a5677a-kube-api-access-k7tgl\") pod \"iptables-alerter-vm2zm\" (UID: \"c60e6c84-2ebd-4ca0-bc49-5f1896a5677a\") " pod="openshift-network-operator/iptables-alerter-vm2zm" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/116ae59c-ca9a-4cb0-ae05-384d0d6ba864-host\") pod \"node-ca-bzgjx\" (UID: \"116ae59c-ca9a-4cb0-ae05-384d0d6ba864\") " pod="openshift-image-registry/node-ca-bzgjx" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096618 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096642 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-cnibin\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d420c798-c1c3-462e-b030-fbabe9480da0-ovnkube-script-lib\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/116ae59c-ca9a-4cb0-ae05-384d0d6ba864-serviceca\") pod \"node-ca-bzgjx\" (UID: \"116ae59c-ca9a-4cb0-ae05-384d0d6ba864\") " pod="openshift-image-registry/node-ca-bzgjx" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096719 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-779dg\" (UniqueName: \"kubernetes.io/projected/116ae59c-ca9a-4cb0-ae05-384d0d6ba864-kube-api-access-779dg\") pod \"node-ca-bzgjx\" (UID: \"116ae59c-ca9a-4cb0-ae05-384d0d6ba864\") " pod="openshift-image-registry/node-ca-bzgjx" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096751 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-kubelet-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096774 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-etc-selinux\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096797 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-os-release\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-etc-openvswitch\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.122743 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096871 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d420c798-c1c3-462e-b030-fbabe9480da0-ovn-node-metrics-cert\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096907 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnwv7\" (UniqueName: \"kubernetes.io/projected/75e2573c-b255-4b0f-8879-cc5825e6d7c6-kube-api-access-pnwv7\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096935 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc0ef685-669f-4c4e-a941-a9fd9e20765f-tmp-dir\") pod \"node-resolver-7dpvq\" (UID: \"fc0ef685-669f-4c4e-a941-a9fd9e20765f\") " pod="openshift-dns/node-resolver-7dpvq" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.096964 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-run-netns\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097004 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-var-lib-cni-bin\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-conf-dir\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097051 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-kubernetes\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097089 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-var-lib-openvswitch\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097113 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64v2k\" (UniqueName: \"kubernetes.io/projected/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-kube-api-access-64v2k\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097134 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-sysctl-d\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097155 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-lib-modules\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42d4c87-751f-4648-8f1a-1ebafc59b993-tmp\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097199 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d50c911c-c8a1-49e8-9636-a62f3a2c9ff1-agent-certs\") pod \"konnectivity-agent-7ggdn\" (UID: \"d50c911c-c8a1-49e8-9636-a62f3a2c9ff1\") " pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097220 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-kubelet\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.125646 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097257 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/917de4b2-08fe-4ab6-ba15-69da63fa81cc-kubelet-config\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097288 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-system-cni-dir\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097311 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-run-k8s-cni-cncf-io\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097349 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-modprobe-d\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-systemd\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-var-lib-kubelet\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-tuned\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc0ef685-669f-4c4e-a941-a9fd9e20765f-hosts-file\") pod \"node-resolver-7dpvq\" (UID: \"fc0ef685-669f-4c4e-a941-a9fd9e20765f\") " pod="openshift-dns/node-resolver-7dpvq" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097476 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-run\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097497 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sct6p\" (UniqueName: \"kubernetes.io/projected/a42d4c87-751f-4648-8f1a-1ebafc59b993-kube-api-access-sct6p\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097527 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6vhk\" (UniqueName: \"kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk\") pod \"network-check-target-q5g45\" (UID: \"236456e0-bf2f-4312-bf4d-97956e97c7ad\") " pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097559 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d50c911c-c8a1-49e8-9636-a62f3a2c9ff1-konnectivity-ca\") pod \"konnectivity-agent-7ggdn\" (UID: \"d50c911c-c8a1-49e8-9636-a62f3a2c9ff1\") " pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097583 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-cni-netd\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfp4j\" (UniqueName: \"kubernetes.io/projected/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-kube-api-access-dfp4j\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.126641 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-cni-binary-copy\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.128747 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.097700 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-etc-kubernetes\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.175074 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-11.ec2.internal" event={"ID":"0a51735bdb7a0293d22b75abc2bc9c15","Type":"ContainerStarted","Data":"0ad5925fd2327795e3a4f09bee4ac5f461ccb8afbcc65afac8c5c04ec67da149"} Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.179911 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" event={"ID":"c8f5ae50e2c9b9caf6ad8967394ab762","Type":"ContainerStarted","Data":"dbbcb3fe3ca5bbebec66ff6f1792a102a16a875119977419b83b8331d8caee00"} Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203592 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-lib-modules\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42d4c87-751f-4648-8f1a-1ebafc59b993-tmp\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203651 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d50c911c-c8a1-49e8-9636-a62f3a2c9ff1-agent-certs\") pod \"konnectivity-agent-7ggdn\" (UID: \"d50c911c-c8a1-49e8-9636-a62f3a2c9ff1\") " pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203673 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-kubelet\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203695 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/917de4b2-08fe-4ab6-ba15-69da63fa81cc-kubelet-config\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203800 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-lib-modules\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203848 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-system-cni-dir\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203875 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-run-k8s-cni-cncf-io\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203895 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-modprobe-d\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203914 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-systemd\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-var-lib-kubelet\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203954 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-tuned\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.223824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc0ef685-669f-4c4e-a941-a9fd9e20765f-hosts-file\") pod \"node-resolver-7dpvq\" (UID: \"fc0ef685-669f-4c4e-a941-a9fd9e20765f\") " pod="openshift-dns/node-resolver-7dpvq" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203975 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/917de4b2-08fe-4ab6-ba15-69da63fa81cc-kubelet-config\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.203991 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-run\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sct6p\" (UniqueName: \"kubernetes.io/projected/a42d4c87-751f-4648-8f1a-1ebafc59b993-kube-api-access-sct6p\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204032 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vhk\" (UniqueName: \"kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk\") pod \"network-check-target-q5g45\" (UID: \"236456e0-bf2f-4312-bf4d-97956e97c7ad\") " pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204033 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204049 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-kubelet\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204054 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d50c911c-c8a1-49e8-9636-a62f3a2c9ff1-konnectivity-ca\") pod \"konnectivity-agent-7ggdn\" (UID: \"d50c911c-c8a1-49e8-9636-a62f3a2c9ff1\") " pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-cni-netd\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204154 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfp4j\" (UniqueName: \"kubernetes.io/projected/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-kube-api-access-dfp4j\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204178 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-cni-binary-copy\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204201 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-etc-kubernetes\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204245 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-cni-bin\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204270 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-cnibin\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204295 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-daemon-config\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.226484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204321 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-sys\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204361 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204387 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75e2573c-b255-4b0f-8879-cc5825e6d7c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204456 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-cni-netd\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204508 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-var-lib-kubelet\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204553 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-etc-kubernetes\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204571 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-run\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204580 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d50c911c-c8a1-49e8-9636-a62f3a2c9ff1-konnectivity-ca\") pod \"konnectivity-agent-7ggdn\" (UID: \"d50c911c-c8a1-49e8-9636-a62f3a2c9ff1\") " pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204642 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-modprobe-d\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204693 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-systemd\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204730 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-run-k8s-cni-cncf-io\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204508 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-system-cni-dir\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204798 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-slash\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204837 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-run-netns\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204877 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-run-ovn\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.227395 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204899 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-log-socket\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204931 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-slash\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204935 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs698\" (UniqueName: \"kubernetes.io/projected/73558940-4ec3-47d2-a883-c0d5d6341f31-kube-api-access-cs698\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204958 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-cni-bin\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204978 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-run-systemd\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205007 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d420c798-c1c3-462e-b030-fbabe9480da0-ovnkube-config\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205036 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-run-multus-certs\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.205043 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205063 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-socket-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205063 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-daemon-config\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205088 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-registration-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.205104 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs podName:73558940-4ec3-47d2-a883-c0d5d6341f31 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:28.705085638 +0000 UTC m=+3.137330590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs") pod "network-metrics-daemon-p8fj7" (UID: "73558940-4ec3-47d2-a883-c0d5d6341f31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205108 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-cnibin\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205123 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-run-netns\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.228671 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.204845 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-cni-binary-copy\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205136 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-registration-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205147 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-cni-dir\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205174 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-host\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205189 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-run-systemd\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205197 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-run-ovn\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205205 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-node-log\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tls2f\" (UniqueName: \"kubernetes.io/projected/d420c798-c1c3-462e-b030-fbabe9480da0-kube-api-access-tls2f\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/917de4b2-08fe-4ab6-ba15-69da63fa81cc-dbus\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205255 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-run-multus-certs\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205279 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc0ef685-669f-4c4e-a941-a9fd9e20765f-hosts-file\") pod \"node-resolver-7dpvq\" (UID: \"fc0ef685-669f-4c4e-a941-a9fd9e20765f\") " pod="openshift-dns/node-resolver-7dpvq" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205289 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-log-socket\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205330 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-node-log\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205423 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/917de4b2-08fe-4ab6-ba15-69da63fa81cc-dbus\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205510 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-cni-dir\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.229537 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205584 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-host\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205619 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-var-lib-cni-multus\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205627 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-socket-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205649 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-sys-fs\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205676 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-os-release\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205680 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-sys\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-sysctl-conf\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205742 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-os-release\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205747 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205752 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75e2573c-b255-4b0f-8879-cc5825e6d7c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205790 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205784 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-var-lib-cni-multus\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c60e6c84-2ebd-4ca0-bc49-5f1896a5677a-host-slash\") pod \"iptables-alerter-vm2zm\" (UID: \"c60e6c84-2ebd-4ca0-bc49-5f1896a5677a\") " pod="openshift-network-operator/iptables-alerter-vm2zm" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205855 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-device-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.230375 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205877 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-sysctl-conf\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205880 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-sysconfig\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205897 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-sys-fs\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205901 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d420c798-c1c3-462e-b030-fbabe9480da0-ovnkube-config\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205910 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-systemd-units\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205920 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-sysconfig\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205938 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-systemd-units\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205857 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c60e6c84-2ebd-4ca0-bc49-5f1896a5677a-host-slash\") pod \"iptables-alerter-vm2zm\" (UID: \"c60e6c84-2ebd-4ca0-bc49-5f1896a5677a\") " pod="openshift-network-operator/iptables-alerter-vm2zm" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205949 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-run-openvswitch\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205982 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c60e6c84-2ebd-4ca0-bc49-5f1896a5677a-iptables-alerter-script\") pod \"iptables-alerter-vm2zm\" (UID: \"c60e6c84-2ebd-4ca0-bc49-5f1896a5677a\") " pod="openshift-network-operator/iptables-alerter-vm2zm" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206078 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-system-cni-dir\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206117 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt9sj\" (UniqueName: \"kubernetes.io/projected/fc0ef685-669f-4c4e-a941-a9fd9e20765f-kube-api-access-vt9sj\") pod \"node-resolver-7dpvq\" (UID: \"fc0ef685-669f-4c4e-a941-a9fd9e20765f\") " pod="openshift-dns/node-resolver-7dpvq" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206159 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-system-cni-dir\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205985 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-run-openvswitch\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.231599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206179 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-var-lib-kubelet\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206214 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-hostroot\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206221 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-var-lib-kubelet\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206250 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206255 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-hostroot\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206274 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75e2573c-b255-4b0f-8879-cc5825e6d7c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75e2573c-b255-4b0f-8879-cc5825e6d7c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206393 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-socket-dir-parent\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206422 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.205946 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-device-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206484 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d420c798-c1c3-462e-b030-fbabe9480da0-env-overrides\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206512 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c60e6c84-2ebd-4ca0-bc49-5f1896a5677a-iptables-alerter-script\") pod \"iptables-alerter-vm2zm\" (UID: \"c60e6c84-2ebd-4ca0-bc49-5f1896a5677a\") " pod="openshift-network-operator/iptables-alerter-vm2zm" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206517 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7tgl\" (UniqueName: \"kubernetes.io/projected/c60e6c84-2ebd-4ca0-bc49-5f1896a5677a-kube-api-access-k7tgl\") pod \"iptables-alerter-vm2zm\" (UID: \"c60e6c84-2ebd-4ca0-bc49-5f1896a5677a\") " pod="openshift-network-operator/iptables-alerter-vm2zm" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206567 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/116ae59c-ca9a-4cb0-ae05-384d0d6ba864-host\") pod \"node-ca-bzgjx\" (UID: \"116ae59c-ca9a-4cb0-ae05-384d0d6ba864\") " pod="openshift-image-registry/node-ca-bzgjx" Jul 14 22:57:28.232425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206593 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206615 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-cnibin\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206638 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d420c798-c1c3-462e-b030-fbabe9480da0-ovnkube-script-lib\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206660 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/116ae59c-ca9a-4cb0-ae05-384d0d6ba864-serviceca\") pod \"node-ca-bzgjx\" (UID: \"116ae59c-ca9a-4cb0-ae05-384d0d6ba864\") " pod="openshift-image-registry/node-ca-bzgjx" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206684 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-779dg\" (UniqueName: \"kubernetes.io/projected/116ae59c-ca9a-4cb0-ae05-384d0d6ba864-kube-api-access-779dg\") pod \"node-ca-bzgjx\" (UID: \"116ae59c-ca9a-4cb0-ae05-384d0d6ba864\") " pod="openshift-image-registry/node-ca-bzgjx" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206708 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-kubelet-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206750 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-etc-selinux\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206779 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-os-release\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206807 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-etc-openvswitch\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206827 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-socket-dir-parent\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206832 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d420c798-c1c3-462e-b030-fbabe9480da0-ovn-node-metrics-cert\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206876 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnwv7\" (UniqueName: \"kubernetes.io/projected/75e2573c-b255-4b0f-8879-cc5825e6d7c6-kube-api-access-pnwv7\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206909 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75e2573c-b255-4b0f-8879-cc5825e6d7c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.206965 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.233194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.207948 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75e2573c-b255-4b0f-8879-cc5825e6d7c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.208077 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.208132 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-cnibin\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.208468 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-etc-selinux\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211080 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42d4c87-751f-4648-8f1a-1ebafc59b993-tmp\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211129 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-kubelet-dir\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211204 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/116ae59c-ca9a-4cb0-ae05-384d0d6ba864-host\") pod \"node-ca-bzgjx\" (UID: \"116ae59c-ca9a-4cb0-ae05-384d0d6ba864\") " pod="openshift-image-registry/node-ca-bzgjx" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211282 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75e2573c-b255-4b0f-8879-cc5825e6d7c6-os-release\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211678 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d420c798-c1c3-462e-b030-fbabe9480da0-ovn-node-metrics-cert\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211758 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-etc-openvswitch\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc0ef685-669f-4c4e-a941-a9fd9e20765f-tmp-dir\") pod \"node-resolver-7dpvq\" (UID: \"fc0ef685-669f-4c4e-a941-a9fd9e20765f\") " pod="openshift-dns/node-resolver-7dpvq" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211815 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-run-netns\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-var-lib-cni-bin\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-conf-dir\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211875 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-kubernetes\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.234223 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211895 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-var-lib-openvswitch\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64v2k\" (UniqueName: \"kubernetes.io/projected/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-kube-api-access-64v2k\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.211937 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-sysctl-d\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.212041 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-sysctl-d\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.212243 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc0ef685-669f-4c4e-a941-a9fd9e20765f-tmp-dir\") pod \"node-resolver-7dpvq\" (UID: \"fc0ef685-669f-4c4e-a941-a9fd9e20765f\") " pod="openshift-dns/node-resolver-7dpvq" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.213096 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d50c911c-c8a1-49e8-9636-a62f3a2c9ff1-agent-certs\") pod \"konnectivity-agent-7ggdn\" (UID: \"d50c911c-c8a1-49e8-9636-a62f3a2c9ff1\") " pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.221267 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-tuned\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.221358 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-multus-conf-dir\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.221392 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-run-netns\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.221424 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-host-var-lib-cni-bin\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.221459 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d420c798-c1c3-462e-b030-fbabe9480da0-var-lib-openvswitch\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.221494 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a42d4c87-751f-4648-8f1a-1ebafc59b993-etc-kubernetes\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.223458 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d420c798-c1c3-462e-b030-fbabe9480da0-ovnkube-script-lib\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.223862 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d420c798-c1c3-462e-b030-fbabe9480da0-env-overrides\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.226381 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:28.235137 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.226541 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret podName:917de4b2-08fe-4ab6-ba15-69da63fa81cc nodeName:}" failed. No retries permitted until 2026-07-14 22:57:28.726515668 +0000 UTC m=+3.158760628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret") pod "global-pull-secret-syncer-7tk8s" (UID: "917de4b2-08fe-4ab6-ba15-69da63fa81cc") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.226898 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/116ae59c-ca9a-4cb0-ae05-384d0d6ba864-serviceca\") pod \"node-ca-bzgjx\" (UID: \"116ae59c-ca9a-4cb0-ae05-384d0d6ba864\") " pod="openshift-image-registry/node-ca-bzgjx" Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.228214 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.228233 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.228258 2568 projected.go:196] Error preparing data for projected volume kube-api-access-b6vhk for pod openshift-network-diagnostics/network-check-target-q5g45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.228321 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk podName:236456e0-bf2f-4312-bf4d-97956e97c7ad nodeName:}" failed. No retries permitted until 2026-07-14 22:57:28.72830648 +0000 UTC m=+3.160551433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b6vhk" (UniqueName: "kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk") pod "network-check-target-q5g45" (UID: "236456e0-bf2f-4312-bf4d-97956e97c7ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.234845 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfp4j\" (UniqueName: \"kubernetes.io/projected/5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88-kube-api-access-dfp4j\") pod \"aws-ebs-csi-driver-node-586lc\" (UID: \"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.235328 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7tgl\" (UniqueName: \"kubernetes.io/projected/c60e6c84-2ebd-4ca0-bc49-5f1896a5677a-kube-api-access-k7tgl\") pod \"iptables-alerter-vm2zm\" (UID: \"c60e6c84-2ebd-4ca0-bc49-5f1896a5677a\") " pod="openshift-network-operator/iptables-alerter-vm2zm" Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.235753 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnwv7\" (UniqueName: \"kubernetes.io/projected/75e2573c-b255-4b0f-8879-cc5825e6d7c6-kube-api-access-pnwv7\") pod \"multus-additional-cni-plugins-z4zvr\" (UID: \"75e2573c-b255-4b0f-8879-cc5825e6d7c6\") " pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.235762 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs698\" (UniqueName: \"kubernetes.io/projected/73558940-4ec3-47d2-a883-c0d5d6341f31-kube-api-access-cs698\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.236184 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tls2f\" (UniqueName: \"kubernetes.io/projected/d420c798-c1c3-462e-b030-fbabe9480da0-kube-api-access-tls2f\") pod \"ovnkube-node-vcdms\" (UID: \"d420c798-c1c3-462e-b030-fbabe9480da0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.236219 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sct6p\" (UniqueName: \"kubernetes.io/projected/a42d4c87-751f-4648-8f1a-1ebafc59b993-kube-api-access-sct6p\") pod \"tuned-nwqrk\" (UID: \"a42d4c87-751f-4648-8f1a-1ebafc59b993\") " pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.236662 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt9sj\" (UniqueName: \"kubernetes.io/projected/fc0ef685-669f-4c4e-a941-a9fd9e20765f-kube-api-access-vt9sj\") pod \"node-resolver-7dpvq\" (UID: \"fc0ef685-669f-4c4e-a941-a9fd9e20765f\") " pod="openshift-dns/node-resolver-7dpvq" Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.237128 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-779dg\" (UniqueName: \"kubernetes.io/projected/116ae59c-ca9a-4cb0-ae05-384d0d6ba864-kube-api-access-779dg\") pod \"node-ca-bzgjx\" (UID: \"116ae59c-ca9a-4cb0-ae05-384d0d6ba864\") " pod="openshift-image-registry/node-ca-bzgjx" Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.238165 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64v2k\" (UniqueName: \"kubernetes.io/projected/197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9-kube-api-access-64v2k\") pod \"multus-wlhk2\" (UID: \"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9\") " pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.387350 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.309880 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:28.388761 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.320032 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wlhk2" Jul 14 22:57:28.388761 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.342281 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vm2zm" Jul 14 22:57:28.388761 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.349208 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bzgjx" Jul 14 22:57:28.388761 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.358914 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" Jul 14 22:57:28.388761 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.370464 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" Jul 14 22:57:28.388761 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.378065 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" Jul 14 22:57:28.388761 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.384675 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:28.498320 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.391329 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7dpvq" Jul 14 22:57:28.716296 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.716203 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:28.716454 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.716376 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:28.716454 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.716439 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs podName:73558940-4ec3-47d2-a883-c0d5d6341f31 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:29.716423867 +0000 UTC m=+4.148668824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs") pod "network-metrics-daemon-p8fj7" (UID: "73558940-4ec3-47d2-a883-c0d5d6341f31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:28.817511 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.817471 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:28.817701 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:28.817540 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vhk\" (UniqueName: \"kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk\") pod \"network-check-target-q5g45\" (UID: \"236456e0-bf2f-4312-bf4d-97956e97c7ad\") " pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:28.817701 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.817637 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:28.817701 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.817676 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:57:28.817701 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.817695 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:57:28.817882 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.817707 2568 projected.go:196] Error preparing data for projected volume kube-api-access-b6vhk for pod openshift-network-diagnostics/network-check-target-q5g45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:28.817882 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.817714 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret podName:917de4b2-08fe-4ab6-ba15-69da63fa81cc nodeName:}" failed. No retries permitted until 2026-07-14 22:57:29.817695295 +0000 UTC m=+4.249940248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret") pod "global-pull-secret-syncer-7tk8s" (UID: "917de4b2-08fe-4ab6-ba15-69da63fa81cc") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:28.817882 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:28.817753 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk podName:236456e0-bf2f-4312-bf4d-97956e97c7ad nodeName:}" failed. No retries permitted until 2026-07-14 22:57:29.817742166 +0000 UTC m=+4.249987117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6vhk" (UniqueName: "kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk") pod "network-check-target-q5g45" (UID: "236456e0-bf2f-4312-bf4d-97956e97c7ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:29.043942 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:29.043866 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 22:52:28 +0000 UTC" deadline="2028-03-01 19:34:55.157235133 +0000 UTC" Jul 14 22:57:29.043942 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:29.043897 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14300h37m26.113341854s" Jul 14 22:57:29.297367 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:29.297277 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 22:57:29.350278 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:29.350235 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60e6c84_2ebd_4ca0_bc49_5f1896a5677a.slice/crio-8d6d363ba492e673008580601b7c30cc4147d0e1069f9cc8e7a76973af157193 WatchSource:0}: Error finding container 8d6d363ba492e673008580601b7c30cc4147d0e1069f9cc8e7a76973af157193: Status 404 returned error can't find the container with id 8d6d363ba492e673008580601b7c30cc4147d0e1069f9cc8e7a76973af157193 Jul 14 22:57:29.352028 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:29.351893 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42d4c87_751f_4648_8f1a_1ebafc59b993.slice/crio-44100164e1477afd05186975f246d68facf7fe0492a32a18060f87645e2de3d8 WatchSource:0}: Error finding container 44100164e1477afd05186975f246d68facf7fe0492a32a18060f87645e2de3d8: Status 404 returned error can't find the container with id 44100164e1477afd05186975f246d68facf7fe0492a32a18060f87645e2de3d8 Jul 14 22:57:29.355720 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:29.355695 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod197b6bf9_7ea1_4d9b_89ea_75fabaaf39d9.slice/crio-e1c05eb4ae6f48b0e9c4016c9ae946769874faa3e2749145fdf04b50e4507c22 WatchSource:0}: Error finding container e1c05eb4ae6f48b0e9c4016c9ae946769874faa3e2749145fdf04b50e4507c22: Status 404 returned error can't find the container with id e1c05eb4ae6f48b0e9c4016c9ae946769874faa3e2749145fdf04b50e4507c22 Jul 14 22:57:29.356440 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:29.356414 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f02c60d_0d49_4cde_8dbc_3cb7a1f67f88.slice/crio-8245e401b73300c3382040ab7817c3556ede00a3c757810be7b5bc3ca068c75b WatchSource:0}: Error finding container 8245e401b73300c3382040ab7817c3556ede00a3c757810be7b5bc3ca068c75b: Status 404 returned error can't find the container with id 8245e401b73300c3382040ab7817c3556ede00a3c757810be7b5bc3ca068c75b Jul 14 22:57:29.358556 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:29.358533 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e2573c_b255_4b0f_8879_cc5825e6d7c6.slice/crio-febafdac0313fe3033f53c506cacb55910ece37473813e055ac8d82b9a8a90b9 WatchSource:0}: Error finding container febafdac0313fe3033f53c506cacb55910ece37473813e055ac8d82b9a8a90b9: Status 404 returned error can't find the container with id febafdac0313fe3033f53c506cacb55910ece37473813e055ac8d82b9a8a90b9 Jul 14 22:57:29.360304 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:29.360264 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd420c798_c1c3_462e_b030_fbabe9480da0.slice/crio-5c5c576d7417b3fe82b41f107d227b993c7df5659ae4db05638d353f7c272e7d WatchSource:0}: Error finding container 5c5c576d7417b3fe82b41f107d227b993c7df5659ae4db05638d353f7c272e7d: Status 404 returned error can't find the container with id 5c5c576d7417b3fe82b41f107d227b993c7df5659ae4db05638d353f7c272e7d Jul 14 22:57:29.361194 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:29.361172 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0ef685_669f_4c4e_a941_a9fd9e20765f.slice/crio-a627f73259b2956de0becdbd17d39fb50743044fee0d30d96e91fef77142ef1e WatchSource:0}: Error finding container a627f73259b2956de0becdbd17d39fb50743044fee0d30d96e91fef77142ef1e: Status 404 returned error can't find the container with id a627f73259b2956de0becdbd17d39fb50743044fee0d30d96e91fef77142ef1e Jul 14 22:57:29.362036 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:57:29.362006 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd50c911c_c8a1_49e8_9636_a62f3a2c9ff1.slice/crio-651bb8d35d7c33e5ca9b6f500bcce82ee360bf0c7b7ebb8d1a776be7c828991b WatchSource:0}: Error finding container 651bb8d35d7c33e5ca9b6f500bcce82ee360bf0c7b7ebb8d1a776be7c828991b: Status 404 returned error can't find the container with id 651bb8d35d7c33e5ca9b6f500bcce82ee360bf0c7b7ebb8d1a776be7c828991b Jul 14 22:57:29.724391 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:29.724128 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:29.724531 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:29.724279 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:29.724531 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:29.724511 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs podName:73558940-4ec3-47d2-a883-c0d5d6341f31 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:31.72449312 +0000 UTC m=+6.156738084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs") pod "network-metrics-daemon-p8fj7" (UID: "73558940-4ec3-47d2-a883-c0d5d6341f31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:29.825073 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:29.824980 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:29.825233 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:29.825136 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:29.825233 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:29.825160 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vhk\" (UniqueName: \"kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk\") pod \"network-check-target-q5g45\" (UID: \"236456e0-bf2f-4312-bf4d-97956e97c7ad\") " pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:29.825233 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:29.825206 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret podName:917de4b2-08fe-4ab6-ba15-69da63fa81cc nodeName:}" failed. No retries permitted until 2026-07-14 22:57:31.825186367 +0000 UTC m=+6.257431318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret") pod "global-pull-secret-syncer-7tk8s" (UID: "917de4b2-08fe-4ab6-ba15-69da63fa81cc") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:29.825420 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:29.825292 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:57:29.825420 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:29.825310 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:57:29.825420 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:29.825323 2568 projected.go:196] Error preparing data for projected volume kube-api-access-b6vhk for pod openshift-network-diagnostics/network-check-target-q5g45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:29.825420 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:29.825388 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk podName:236456e0-bf2f-4312-bf4d-97956e97c7ad nodeName:}" failed. No retries permitted until 2026-07-14 22:57:31.825372039 +0000 UTC m=+6.257617007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6vhk" (UniqueName: "kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk") pod "network-check-target-q5g45" (UID: "236456e0-bf2f-4312-bf4d-97956e97c7ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:30.045048 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.044927 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 22:52:28 +0000 UTC" deadline="2028-03-19 13:49:41.61111553 +0000 UTC" Jul 14 22:57:30.045048 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.044989 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14726h52m11.566130544s" Jul 14 22:57:30.168732 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.168656 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:30.168908 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:30.168767 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:30.169167 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.169149 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:30.169279 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:30.169259 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:30.169354 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.169325 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:30.169434 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:30.169416 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:30.207358 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.206812 2568 generic.go:356] "Generic (PLEG): container finished" podID="c8f5ae50e2c9b9caf6ad8967394ab762" containerID="674bd8f6fb97b5b0429c171cb4858c3ae3b8a97d5997bb8d3f3f4ca7fff984e5" exitCode=0 Jul 14 22:57:30.207358 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.207063 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" event={"ID":"c8f5ae50e2c9b9caf6ad8967394ab762","Type":"ContainerDied","Data":"674bd8f6fb97b5b0429c171cb4858c3ae3b8a97d5997bb8d3f3f4ca7fff984e5"} Jul 14 22:57:30.220282 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.220202 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" event={"ID":"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88","Type":"ContainerStarted","Data":"8245e401b73300c3382040ab7817c3556ede00a3c757810be7b5bc3ca068c75b"} Jul 14 22:57:30.232262 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.232194 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bzgjx" event={"ID":"116ae59c-ca9a-4cb0-ae05-384d0d6ba864","Type":"ContainerStarted","Data":"b3347c6d7462c0b27962445779baffca6256f8d840d65a1c121be93daed7829f"} Jul 14 22:57:30.235998 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.235922 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7dpvq" event={"ID":"fc0ef685-669f-4c4e-a941-a9fd9e20765f","Type":"ContainerStarted","Data":"a627f73259b2956de0becdbd17d39fb50743044fee0d30d96e91fef77142ef1e"} Jul 14 22:57:30.246170 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.246145 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" event={"ID":"d420c798-c1c3-462e-b030-fbabe9480da0","Type":"ContainerStarted","Data":"5c5c576d7417b3fe82b41f107d227b993c7df5659ae4db05638d353f7c272e7d"} Jul 14 22:57:30.258297 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.258235 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" event={"ID":"75e2573c-b255-4b0f-8879-cc5825e6d7c6","Type":"ContainerStarted","Data":"febafdac0313fe3033f53c506cacb55910ece37473813e055ac8d82b9a8a90b9"} Jul 14 22:57:30.268685 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.268441 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wlhk2" event={"ID":"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9","Type":"ContainerStarted","Data":"e1c05eb4ae6f48b0e9c4016c9ae946769874faa3e2749145fdf04b50e4507c22"} Jul 14 22:57:30.271835 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.271809 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" event={"ID":"a42d4c87-751f-4648-8f1a-1ebafc59b993","Type":"ContainerStarted","Data":"44100164e1477afd05186975f246d68facf7fe0492a32a18060f87645e2de3d8"} Jul 14 22:57:30.287647 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.287608 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-11.ec2.internal" event={"ID":"0a51735bdb7a0293d22b75abc2bc9c15","Type":"ContainerStarted","Data":"76975af57e387b1f6b85ddeb408f25a0c9d8177e5874c39a375d30cee97ebe84"} Jul 14 22:57:30.293910 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.293838 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7ggdn" event={"ID":"d50c911c-c8a1-49e8-9636-a62f3a2c9ff1","Type":"ContainerStarted","Data":"651bb8d35d7c33e5ca9b6f500bcce82ee360bf0c7b7ebb8d1a776be7c828991b"} Jul 14 22:57:30.307085 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:30.307055 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vm2zm" event={"ID":"c60e6c84-2ebd-4ca0-bc49-5f1896a5677a","Type":"ContainerStarted","Data":"8d6d363ba492e673008580601b7c30cc4147d0e1069f9cc8e7a76973af157193"} Jul 14 22:57:31.316449 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:31.316407 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" event={"ID":"c8f5ae50e2c9b9caf6ad8967394ab762","Type":"ContainerStarted","Data":"2513f1595b33afdd06be0522303bbb0c0027c4365b844aef78b8813b915a0032"} Jul 14 22:57:31.335294 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:31.335227 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-11.ec2.internal" podStartSLOduration=4.335206799 podStartE2EDuration="4.335206799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:30.304204967 +0000 UTC m=+4.736449942" watchObservedRunningTime="2026-07-14 22:57:31.335206799 +0000 UTC m=+5.767451776" Jul 14 22:57:31.744572 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:31.744477 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:31.744781 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:31.744748 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:31.744856 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:31.744821 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs podName:73558940-4ec3-47d2-a883-c0d5d6341f31 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:35.74480129 +0000 UTC m=+10.177046248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs") pod "network-metrics-daemon-p8fj7" (UID: "73558940-4ec3-47d2-a883-c0d5d6341f31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:31.845983 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:31.845946 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:31.846163 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:31.846011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vhk\" (UniqueName: \"kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk\") pod \"network-check-target-q5g45\" (UID: \"236456e0-bf2f-4312-bf4d-97956e97c7ad\") " pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:31.846223 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:31.846187 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:57:31.846223 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:31.846210 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:57:31.846223 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:31.846222 2568 projected.go:196] Error preparing data for projected volume kube-api-access-b6vhk for pod openshift-network-diagnostics/network-check-target-q5g45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:31.846446 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:31.846279 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk podName:236456e0-bf2f-4312-bf4d-97956e97c7ad nodeName:}" failed. No retries permitted until 2026-07-14 22:57:35.846261396 +0000 UTC m=+10.278506352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6vhk" (UniqueName: "kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk") pod "network-check-target-q5g45" (UID: "236456e0-bf2f-4312-bf4d-97956e97c7ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:31.846813 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:31.846692 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:31.846813 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:31.846758 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret podName:917de4b2-08fe-4ab6-ba15-69da63fa81cc nodeName:}" failed. No retries permitted until 2026-07-14 22:57:35.846742317 +0000 UTC m=+10.278987276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret") pod "global-pull-secret-syncer-7tk8s" (UID: "917de4b2-08fe-4ab6-ba15-69da63fa81cc") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:32.169849 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:32.169003 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:32.169849 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:32.169131 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:32.169849 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:32.169505 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:32.169849 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:32.169629 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:32.169849 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:32.169697 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:32.169849 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:32.169767 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:34.164536 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:34.164451 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:34.164536 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:34.164477 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:34.165055 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:34.164580 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:34.165055 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:34.164618 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:34.165055 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:34.164709 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:34.165055 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:34.164786 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:35.782823 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:35.782779 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:35.783263 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:35.782915 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:35.783263 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:35.782974 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs podName:73558940-4ec3-47d2-a883-c0d5d6341f31 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:43.782958496 +0000 UTC m=+18.215203464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs") pod "network-metrics-daemon-p8fj7" (UID: "73558940-4ec3-47d2-a883-c0d5d6341f31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:35.884061 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:35.883817 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:35.884061 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:35.883886 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vhk\" (UniqueName: \"kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk\") pod \"network-check-target-q5g45\" (UID: \"236456e0-bf2f-4312-bf4d-97956e97c7ad\") " pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:35.884061 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:35.883934 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:35.884061 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:35.883976 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:57:35.884061 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:35.883992 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:57:35.884061 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:35.883998 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret podName:917de4b2-08fe-4ab6-ba15-69da63fa81cc nodeName:}" failed. No retries permitted until 2026-07-14 22:57:43.883978704 +0000 UTC m=+18.316223664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret") pod "global-pull-secret-syncer-7tk8s" (UID: "917de4b2-08fe-4ab6-ba15-69da63fa81cc") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:35.884061 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:35.884005 2568 projected.go:196] Error preparing data for projected volume kube-api-access-b6vhk for pod openshift-network-diagnostics/network-check-target-q5g45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:35.884061 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:35.884036 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk podName:236456e0-bf2f-4312-bf4d-97956e97c7ad nodeName:}" failed. No retries permitted until 2026-07-14 22:57:43.884027064 +0000 UTC m=+18.316272030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6vhk" (UniqueName: "kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk") pod "network-check-target-q5g45" (UID: "236456e0-bf2f-4312-bf4d-97956e97c7ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:36.165026 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:36.164686 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:36.165026 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:36.164749 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:36.165026 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:36.164871 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:36.165026 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:36.164889 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:36.165350 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:36.165064 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:36.168406 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:36.165657 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:38.163685 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:38.163656 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:38.164086 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:38.163656 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:38.164086 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:38.163777 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:38.164086 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:38.163793 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:38.164086 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:38.163906 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:38.164086 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:38.164035 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:40.163956 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:40.163638 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:40.163956 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:40.163643 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:40.163956 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:40.163753 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:40.163956 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:40.163852 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:40.163956 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:40.163895 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:40.164455 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:40.163970 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:42.166245 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:42.166209 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:42.166690 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:42.166309 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:42.166690 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:42.166319 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:42.166690 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:42.166348 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:42.166690 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:42.166417 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:42.166690 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:42.166506 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:43.843816 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:43.843782 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:43.844194 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:43.843888 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:43.844194 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:43.843932 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs podName:73558940-4ec3-47d2-a883-c0d5d6341f31 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:59.84392048 +0000 UTC m=+34.276165431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs") pod "network-metrics-daemon-p8fj7" (UID: "73558940-4ec3-47d2-a883-c0d5d6341f31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:43.944327 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:43.944295 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:43.944327 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:43.944352 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vhk\" (UniqueName: \"kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk\") pod \"network-check-target-q5g45\" (UID: \"236456e0-bf2f-4312-bf4d-97956e97c7ad\") " pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:43.944524 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:43.944455 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:57:43.944524 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:43.944468 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:57:43.944524 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:43.944477 2568 projected.go:196] Error preparing data for projected volume kube-api-access-b6vhk for pod openshift-network-diagnostics/network-check-target-q5g45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:43.944524 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:43.944520 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk podName:236456e0-bf2f-4312-bf4d-97956e97c7ad nodeName:}" failed. No retries permitted until 2026-07-14 22:57:59.944506785 +0000 UTC m=+34.376751741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6vhk" (UniqueName: "kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk") pod "network-check-target-q5g45" (UID: "236456e0-bf2f-4312-bf4d-97956e97c7ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:43.944655 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:43.944529 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:43.944655 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:43.944572 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret podName:917de4b2-08fe-4ab6-ba15-69da63fa81cc nodeName:}" failed. No retries permitted until 2026-07-14 22:57:59.944562171 +0000 UTC m=+34.376807128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret") pod "global-pull-secret-syncer-7tk8s" (UID: "917de4b2-08fe-4ab6-ba15-69da63fa81cc") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:44.166240 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:44.166157 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:44.166240 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:44.166190 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:44.166240 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:44.166190 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:44.166517 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:44.166271 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:44.166517 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:44.166370 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:44.166517 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:44.166470 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:46.165040 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:46.165002 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:46.165486 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:46.165094 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:46.165486 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:46.165137 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:46.165486 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:46.165144 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:46.165486 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:46.165221 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:46.165486 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:46.165293 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:48.164365 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.163604 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:48.164365 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:48.163728 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:48.164365 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.164088 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:48.164365 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:48.164190 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:48.164365 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.164239 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:48.164365 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:48.164308 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:48.353423 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.352691 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" event={"ID":"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88","Type":"ContainerStarted","Data":"c6353d1882024c771195f75ae90dc9e2ed214f7cb41f966cd3c97bd7957d4aec"} Jul 14 22:57:48.355154 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.355014 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bzgjx" event={"ID":"116ae59c-ca9a-4cb0-ae05-384d0d6ba864","Type":"ContainerStarted","Data":"c9215f50c63e54315a82ab2dd13c9d621220afadbbc294488259409d92fae98f"} Jul 14 22:57:48.357479 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.356940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7dpvq" event={"ID":"fc0ef685-669f-4c4e-a941-a9fd9e20765f","Type":"ContainerStarted","Data":"deace9abd7f26277c6db2f12d714eb79b62d7334ba1c36532eb7ed7b3158768e"} Jul 14 22:57:48.359711 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.359684 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" event={"ID":"d420c798-c1c3-462e-b030-fbabe9480da0","Type":"ContainerStarted","Data":"c40cdefa77e7771a50df6a267632661837077ff96224d2f60c5ff27746e66aa9"} Jul 14 22:57:48.359830 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.359773 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" event={"ID":"d420c798-c1c3-462e-b030-fbabe9480da0","Type":"ContainerStarted","Data":"871ccdf8bff7cd29efb961d77a302d61a659dc6f362df9c707d58717ecfdf0ca"} Jul 14 22:57:48.361264 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.361222 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" event={"ID":"75e2573c-b255-4b0f-8879-cc5825e6d7c6","Type":"ContainerStarted","Data":"11a68c1ea0071aacc67dfad2e48c5d9337e57da69f34ca08a838926d0f984c29"} Jul 14 22:57:48.362863 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.362841 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wlhk2" event={"ID":"197b6bf9-7ea1-4d9b-89ea-75fabaaf39d9","Type":"ContainerStarted","Data":"881adabd130e0f4b6cea9d25d8cd50fe3bdad8af768396043b57f8b4536845d2"} Jul 14 22:57:48.364443 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.364410 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" event={"ID":"a42d4c87-751f-4648-8f1a-1ebafc59b993","Type":"ContainerStarted","Data":"8176325ced58994018b6e38398f49cbaf465a206b7796edf03021ebb4f44a30c"} Jul 14 22:57:48.365804 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.365778 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7ggdn" event={"ID":"d50c911c-c8a1-49e8-9636-a62f3a2c9ff1","Type":"ContainerStarted","Data":"4da5fc5fa975cba9e7acfe617ad83ba9b6b8593df0a4b5f482dd21be99ae63b6"} Jul 14 22:57:48.373637 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.373258 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bzgjx" podStartSLOduration=3.649903394 podStartE2EDuration="22.373238079s" totalImagesPullingTime="18.723334685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:48.372109824 +0000 UTC m=+22.804354800" watchObservedRunningTime="2026-07-14 22:57:48.373238079 +0000 UTC m=+22.805483054" Jul 14 22:57:48.373637 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.373377 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-11.ec2.internal" podStartSLOduration=21.373368046 podStartE2EDuration="21.373368046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:31.336270915 +0000 UTC m=+5.768515890" watchObservedRunningTime="2026-07-14 22:57:48.373368046 +0000 UTC m=+22.805613021" Jul 14 22:57:48.420777 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.420729 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nwqrk" podStartSLOduration=3.684747859 podStartE2EDuration="22.420713593s" totalImagesPullingTime="18.735965734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:48.388720703 +0000 UTC m=+22.820965680" watchObservedRunningTime="2026-07-14 22:57:48.420713593 +0000 UTC m=+22.852958568" Jul 14 22:57:48.452519 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.452473 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wlhk2" podStartSLOduration=3.669927094 podStartE2EDuration="22.45245755s" totalImagesPullingTime="18.782530456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:48.420555325 +0000 UTC m=+22.852800299" watchObservedRunningTime="2026-07-14 22:57:48.45245755 +0000 UTC m=+22.884702524" Jul 14 22:57:48.479324 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.479281 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7ggdn" podStartSLOduration=8.080814563 podStartE2EDuration="22.479262919s" totalImagesPullingTime="14.398448356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:48.466043244 +0000 UTC m=+22.898288218" watchObservedRunningTime="2026-07-14 22:57:48.479262919 +0000 UTC m=+22.911507896" Jul 14 22:57:48.479755 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:48.479726 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7dpvq" podStartSLOduration=3.755348235 podStartE2EDuration="22.479720444s" totalImagesPullingTime="18.724372209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:48.479356911 +0000 UTC m=+22.911601874" watchObservedRunningTime="2026-07-14 22:57:48.479720444 +0000 UTC m=+22.911965417" Jul 14 22:57:49.371432 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:49.371383 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" event={"ID":"d420c798-c1c3-462e-b030-fbabe9480da0","Type":"ContainerStarted","Data":"c4188cf7ba312b9d7e9cd3d64a20318a684dee95aea82fccb2406c07e0e253a0"} Jul 14 22:57:49.372147 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:49.371578 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" event={"ID":"d420c798-c1c3-462e-b030-fbabe9480da0","Type":"ContainerStarted","Data":"dde87d8ff8b4c38db28ef5e0c5ef504f345927c5f7b0bd315c999af8d22155ab"} Jul 14 22:57:49.372147 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:49.371637 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" event={"ID":"d420c798-c1c3-462e-b030-fbabe9480da0","Type":"ContainerStarted","Data":"5349cbb4f932b680cd9f416746b08ef73fd5956889cb9815a0daf5c4d216f156"} Jul 14 22:57:49.372147 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:49.371683 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" event={"ID":"d420c798-c1c3-462e-b030-fbabe9480da0","Type":"ContainerStarted","Data":"528799885b07df72b5530b83515768e901be7273c259ef608c817820c99671ca"} Jul 14 22:57:49.373183 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:49.373156 2568 generic.go:356] "Generic (PLEG): container finished" podID="75e2573c-b255-4b0f-8879-cc5825e6d7c6" containerID="11a68c1ea0071aacc67dfad2e48c5d9337e57da69f34ca08a838926d0f984c29" exitCode=0 Jul 14 22:57:49.373327 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:49.373277 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" event={"ID":"75e2573c-b255-4b0f-8879-cc5825e6d7c6","Type":"ContainerDied","Data":"11a68c1ea0071aacc67dfad2e48c5d9337e57da69f34ca08a838926d0f984c29"} Jul 14 22:57:49.535873 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:49.535843 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 22:57:50.066729 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:50.066626 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T22:57:49.53586425Z","UUID":"97eb8e73-f93b-474a-abf6-befbce646a38","Handler":null,"Name":"","Endpoint":""} Jul 14 22:57:50.068294 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:50.068264 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 22:57:50.068442 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:50.068308 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 22:57:50.163504 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:50.163471 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:50.163675 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:50.163471 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:50.163675 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:50.163611 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:50.163830 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:50.163798 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:50.163830 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:50.163817 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:50.164010 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:50.163902 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:50.377703 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:50.377666 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vm2zm" event={"ID":"c60e6c84-2ebd-4ca0-bc49-5f1896a5677a","Type":"ContainerStarted","Data":"a18df6480d1396ccbffc2c9d489277fee881787fc50fa0057bf6d12549e6b7d6"} Jul 14 22:57:50.379837 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:50.379810 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" event={"ID":"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88","Type":"ContainerStarted","Data":"66806fae925102c38ed50f496bd69a2364d27c60bacce8a59618dfdb98793f86"} Jul 14 22:57:50.392956 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:50.392914 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vm2zm" podStartSLOduration=5.658601642 podStartE2EDuration="24.39290244s" totalImagesPullingTime="18.734300798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:50.392161431 +0000 UTC m=+24.824406406" watchObservedRunningTime="2026-07-14 22:57:50.39290244 +0000 UTC m=+24.825147414" Jul 14 22:57:51.385210 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:51.385171 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" event={"ID":"5f02c60d-0d49-4cde-8dbc-3cb7a1f67f88","Type":"ContainerStarted","Data":"1cf74550cb9333cf48fb350c4db416c93620bbe3b50d742ea7ba13bd15f39d5f"} Jul 14 22:57:51.388880 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:51.388851 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" event={"ID":"d420c798-c1c3-462e-b030-fbabe9480da0","Type":"ContainerStarted","Data":"b1ced6c4cce857ef56446cda860460968759cac61c9f951034527a7575b0602c"} Jul 14 22:57:51.405251 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:51.405174 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-586lc" podStartSLOduration=4.486006082 podStartE2EDuration="25.405158789s" totalImagesPullingTime="20.919152707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:51.404799071 +0000 UTC m=+25.837044061" watchObservedRunningTime="2026-07-14 22:57:51.405158789 +0000 UTC m=+25.837403773" Jul 14 22:57:52.163823 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:52.163788 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:52.164001 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:52.163797 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:52.164001 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:52.163922 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:52.164001 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:52.163932 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:52.164174 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:52.164022 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:52.164174 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:52.164118 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:53.319238 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:53.318961 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:53.320004 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:53.319540 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:53.394767 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:53.394734 2568 generic.go:356] "Generic (PLEG): container finished" podID="75e2573c-b255-4b0f-8879-cc5825e6d7c6" containerID="ca865d974baa2608d09bed9778c29d019daeaf04b0b043e71bf6d563038f2415" exitCode=0 Jul 14 22:57:53.394918 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:53.394819 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" event={"ID":"75e2573c-b255-4b0f-8879-cc5825e6d7c6","Type":"ContainerDied","Data":"ca865d974baa2608d09bed9778c29d019daeaf04b0b043e71bf6d563038f2415"} Jul 14 22:57:53.398249 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:53.398230 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" event={"ID":"d420c798-c1c3-462e-b030-fbabe9480da0","Type":"ContainerStarted","Data":"3dacc60cb2da7b75a32e0d14ebf4f62f48528c7ba5564baa3206a9e7c0a32d87"} Jul 14 22:57:53.398438 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:53.398422 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:53.398897 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:53.398881 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7ggdn" Jul 14 22:57:53.480442 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:53.480394 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" podStartSLOduration=8.675712056 podStartE2EDuration="27.480378351s" totalImagesPullingTime="18.804666295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:53.479695256 +0000 UTC m=+27.911940231" watchObservedRunningTime="2026-07-14 22:57:53.480378351 +0000 UTC m=+27.912623326" Jul 14 22:57:54.164390 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:54.164198 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:54.164586 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:54.164198 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:54.164586 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:54.164470 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:54.164586 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:54.164257 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:54.164586 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:54.164529 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:54.164721 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:54.164657 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:54.400516 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:54.400484 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 14 22:57:54.400972 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:54.400956 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:54.401063 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:54.401052 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:54.415676 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:54.415619 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:54.415789 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:54.415718 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:55.404411 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:55.404381 2568 generic.go:356] "Generic (PLEG): container finished" podID="75e2573c-b255-4b0f-8879-cc5825e6d7c6" containerID="0b04ee3edb944b5e1e9760ada3ff384af5c89a6e103d51ea65d4b75fae69255d" exitCode=0 Jul 14 22:57:55.404898 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:55.404472 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" event={"ID":"75e2573c-b255-4b0f-8879-cc5825e6d7c6","Type":"ContainerDied","Data":"0b04ee3edb944b5e1e9760ada3ff384af5c89a6e103d51ea65d4b75fae69255d"} Jul 14 22:57:55.404898 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:55.404555 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 14 22:57:56.164259 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:56.164227 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:56.164453 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:56.164282 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:56.164453 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:56.164375 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:56.164453 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:56.164394 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:56.164611 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:56.164531 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:56.164668 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:56.164617 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:56.406524 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:56.406504 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 14 22:57:56.757613 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:56.757539 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:57:57.410801 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:57.410768 2568 generic.go:356] "Generic (PLEG): container finished" podID="75e2573c-b255-4b0f-8879-cc5825e6d7c6" containerID="f23d2935c1dd3f661700187e04edef6713b1647f67533e9c2e5a3e3b9bc8646c" exitCode=0 Jul 14 22:57:57.411209 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:57.410862 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" event={"ID":"75e2573c-b255-4b0f-8879-cc5825e6d7c6","Type":"ContainerDied","Data":"f23d2935c1dd3f661700187e04edef6713b1647f67533e9c2e5a3e3b9bc8646c"} Jul 14 22:57:58.164644 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:58.164500 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:58.164644 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:58.164514 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:58.164644 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:58.164500 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:58.164644 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:58.164606 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:57:58.165122 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:58.164685 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:57:58.165122 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:58.164769 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:57:59.867818 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:59.867786 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:57:59.868330 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:59.867912 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:59.868330 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:59.867979 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs podName:73558940-4ec3-47d2-a883-c0d5d6341f31 nodeName:}" failed. No retries permitted until 2026-07-14 22:58:31.867957245 +0000 UTC m=+66.300202199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs") pod "network-metrics-daemon-p8fj7" (UID: "73558940-4ec3-47d2-a883-c0d5d6341f31") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:59.968215 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:59.968187 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:57:59.968402 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:57:59.968237 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vhk\" (UniqueName: \"kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk\") pod \"network-check-target-q5g45\" (UID: \"236456e0-bf2f-4312-bf4d-97956e97c7ad\") " pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:57:59.968402 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:59.968354 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:57:59.968402 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:59.968362 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:59.968566 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:59.968431 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret podName:917de4b2-08fe-4ab6-ba15-69da63fa81cc nodeName:}" failed. No retries permitted until 2026-07-14 22:58:31.968411995 +0000 UTC m=+66.400656960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret") pod "global-pull-secret-syncer-7tk8s" (UID: "917de4b2-08fe-4ab6-ba15-69da63fa81cc") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:59.968566 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:59.968373 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:57:59.968566 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:59.968488 2568 projected.go:196] Error preparing data for projected volume kube-api-access-b6vhk for pod openshift-network-diagnostics/network-check-target-q5g45: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:59.968566 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:57:59.968552 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk podName:236456e0-bf2f-4312-bf4d-97956e97c7ad nodeName:}" failed. No retries permitted until 2026-07-14 22:58:31.968535425 +0000 UTC m=+66.400780392 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6vhk" (UniqueName: "kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk") pod "network-check-target-q5g45" (UID: "236456e0-bf2f-4312-bf4d-97956e97c7ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:58:00.164275 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:00.164196 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:58:00.164275 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:00.164238 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:58:00.164275 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:00.164241 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:58:00.164527 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:00.164326 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:58:00.164527 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:00.164446 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:58:00.164641 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:00.164523 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:58:00.295063 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:00.294976 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q5g45"] Jul 14 22:58:00.299542 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:00.299499 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7tk8s"] Jul 14 22:58:00.300305 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:00.300274 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8fj7"] Jul 14 22:58:00.420469 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:00.420282 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:58:00.420469 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:00.420450 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:58:00.420653 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:00.420285 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:58:00.420653 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:00.420553 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:58:00.420653 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:00.420282 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:58:00.420653 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:00.420625 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:58:02.164577 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:02.164401 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:58:02.165082 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:02.164400 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:58:02.165082 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:02.164671 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:58:02.165082 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:02.164468 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:58:02.165082 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:02.164782 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:58:02.165082 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:02.164795 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:58:02.427392 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:02.427354 2568 generic.go:356] "Generic (PLEG): container finished" podID="75e2573c-b255-4b0f-8879-cc5825e6d7c6" containerID="cfa6fcea16a65e9ca87021c6aa001fc353e4bc8807cd7b4461c2ffb241c55afb" exitCode=0 Jul 14 22:58:02.427576 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:02.427400 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" event={"ID":"75e2573c-b255-4b0f-8879-cc5825e6d7c6","Type":"ContainerDied","Data":"cfa6fcea16a65e9ca87021c6aa001fc353e4bc8807cd7b4461c2ffb241c55afb"} Jul 14 22:58:03.434397 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:03.434363 2568 generic.go:356] "Generic (PLEG): container finished" podID="75e2573c-b255-4b0f-8879-cc5825e6d7c6" containerID="e2c90e1f52e81da1056c6e9bbdf304a4ba97bb75052e84d62c65370cf5d22f38" exitCode=0 Jul 14 22:58:03.434839 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:03.434421 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" event={"ID":"75e2573c-b255-4b0f-8879-cc5825e6d7c6","Type":"ContainerDied","Data":"e2c90e1f52e81da1056c6e9bbdf304a4ba97bb75052e84d62c65370cf5d22f38"} Jul 14 22:58:04.163819 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.163784 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:58:04.163975 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.163784 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:58:04.163975 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:04.163898 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5g45" podUID="236456e0-bf2f-4312-bf4d-97956e97c7ad" Jul 14 22:58:04.164051 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:04.164020 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8fj7" podUID="73558940-4ec3-47d2-a883-c0d5d6341f31" Jul 14 22:58:04.164085 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.164052 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:58:04.164118 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:04.164107 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7tk8s" podUID="917de4b2-08fe-4ab6-ba15-69da63fa81cc" Jul 14 22:58:04.443119 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.443023 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" event={"ID":"75e2573c-b255-4b0f-8879-cc5825e6d7c6","Type":"ContainerStarted","Data":"ef6823fb0b529a100a2cdcc4e90f539d6e9ac1f62791083bed8c0c84c0773e60"} Jul 14 22:58:04.469175 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.469134 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z4zvr" podStartSLOduration=8.676225288 podStartE2EDuration="38.469121463s" totalImagesPullingTime="29.792896175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:04.468893623 +0000 UTC m=+38.901138597" watchObservedRunningTime="2026-07-14 22:58:04.469121463 +0000 UTC m=+38.901366436" Jul 14 22:58:04.869484 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.869456 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-11.ec2.internal" event="NodeReady" Jul 14 22:58:04.869618 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.869588 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 22:58:04.913516 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.913487 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9kd6n"] Jul 14 22:58:04.915472 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.915456 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:04.916595 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.916571 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w979j"] Jul 14 22:58:04.918051 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.918033 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w979j" Jul 14 22:58:04.918304 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.918286 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 22:58:04.918518 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.918494 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9vm8v\"" Jul 14 22:58:04.918612 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.918539 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 22:58:04.918612 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.918548 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 22:58:04.918612 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.918547 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 22:58:04.919833 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.919817 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 22:58:04.919833 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.919826 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 22:58:04.920157 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.920143 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 22:58:04.920312 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.920300 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nt85j\"" Jul 14 22:58:04.926263 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.926244 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9kd6n"] Jul 14 22:58:04.929738 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:04.929714 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w979j"] Jul 14 22:58:05.008946 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.008916 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.008946 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.008949 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-crio-socket\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.009139 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.008970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.009139 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.008985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lbwt\" (UniqueName: \"kubernetes.io/projected/cabc20f3-751e-4433-9dd3-a1a5b248cefe-kube-api-access-2lbwt\") pod \"ingress-canary-w979j\" (UID: \"cabc20f3-751e-4433-9dd3-a1a5b248cefe\") " pod="openshift-ingress-canary/ingress-canary-w979j" Jul 14 22:58:05.009139 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.009075 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-data-volume\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.009139 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.009110 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cabc20f3-751e-4433-9dd3-a1a5b248cefe-cert\") pod \"ingress-canary-w979j\" (UID: \"cabc20f3-751e-4433-9dd3-a1a5b248cefe\") " pod="openshift-ingress-canary/ingress-canary-w979j" Jul 14 22:58:05.009277 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.009166 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmd5m\" (UniqueName: \"kubernetes.io/projected/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-kube-api-access-kmd5m\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.016370 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.016328 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kc5rv"] Jul 14 22:58:05.018040 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.018026 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.020460 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.020442 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 22:58:05.020553 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.020442 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdwsb\"" Jul 14 22:58:05.020596 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.020581 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 22:58:05.030536 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.030516 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kc5rv"] Jul 14 22:58:05.110193 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110161 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.110193 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110197 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lbwt\" (UniqueName: \"kubernetes.io/projected/cabc20f3-751e-4433-9dd3-a1a5b248cefe-kube-api-access-2lbwt\") pod \"ingress-canary-w979j\" (UID: \"cabc20f3-751e-4433-9dd3-a1a5b248cefe\") " pod="openshift-ingress-canary/ingress-canary-w979j" Jul 14 22:58:05.110414 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jbsj\" (UniqueName: \"kubernetes.io/projected/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-kube-api-access-9jbsj\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.110414 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-data-volume\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.110414 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110304 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cabc20f3-751e-4433-9dd3-a1a5b248cefe-cert\") pod \"ingress-canary-w979j\" (UID: \"cabc20f3-751e-4433-9dd3-a1a5b248cefe\") " pod="openshift-ingress-canary/ingress-canary-w979j" Jul 14 22:58:05.110414 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110406 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmd5m\" (UniqueName: \"kubernetes.io/projected/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-kube-api-access-kmd5m\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.110611 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110531 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-metrics-tls\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.110611 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.110687 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110623 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-config-volume\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.110687 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-tmp-dir\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.110687 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110676 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-crio-socket\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.110854 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110835 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.110903 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.110848 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-crio-socket\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.111229 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.111208 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-data-volume\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.114212 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.114184 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.114317 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.114297 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cabc20f3-751e-4433-9dd3-a1a5b248cefe-cert\") pod \"ingress-canary-w979j\" (UID: \"cabc20f3-751e-4433-9dd3-a1a5b248cefe\") " pod="openshift-ingress-canary/ingress-canary-w979j" Jul 14 22:58:05.121508 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.121444 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmd5m\" (UniqueName: \"kubernetes.io/projected/7e6bda43-eac3-4a28-8eae-73cb9f3a6bca-kube-api-access-kmd5m\") pod \"insights-runtime-extractor-9kd6n\" (UID: \"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca\") " pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.121508 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.121480 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lbwt\" (UniqueName: \"kubernetes.io/projected/cabc20f3-751e-4433-9dd3-a1a5b248cefe-kube-api-access-2lbwt\") pod \"ingress-canary-w979j\" (UID: \"cabc20f3-751e-4433-9dd3-a1a5b248cefe\") " pod="openshift-ingress-canary/ingress-canary-w979j" Jul 14 22:58:05.211769 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.211738 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-metrics-tls\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.211926 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.211775 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-config-volume\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.211926 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.211792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-tmp-dir\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.211926 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.211814 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jbsj\" (UniqueName: \"kubernetes.io/projected/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-kube-api-access-9jbsj\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.212162 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.212140 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-tmp-dir\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.212365 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.212326 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-config-volume\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.213953 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.213931 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-metrics-tls\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.220244 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.220222 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jbsj\" (UniqueName: \"kubernetes.io/projected/0ebfe428-93a5-4958-91d4-5c8d6110a4a8-kube-api-access-9jbsj\") pod \"dns-default-kc5rv\" (UID: \"0ebfe428-93a5-4958-91d4-5c8d6110a4a8\") " pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.226783 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.226765 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9kd6n" Jul 14 22:58:05.231169 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.231156 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w979j" Jul 14 22:58:05.325834 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.325637 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:05.365942 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.365908 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w979j"] Jul 14 22:58:05.370813 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:05.370787 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcabc20f3_751e_4433_9dd3_a1a5b248cefe.slice/crio-b49fecf6e6dfba5bafa0dc0121dc430ab176a7f6bb21ad803ee43210300e3329 WatchSource:0}: Error finding container b49fecf6e6dfba5bafa0dc0121dc430ab176a7f6bb21ad803ee43210300e3329: Status 404 returned error can't find the container with id b49fecf6e6dfba5bafa0dc0121dc430ab176a7f6bb21ad803ee43210300e3329 Jul 14 22:58:05.374634 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.374613 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9kd6n"] Jul 14 22:58:05.377604 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:05.377573 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6bda43_eac3_4a28_8eae_73cb9f3a6bca.slice/crio-405e8af55502f1ef8ee2c2c1767f11559f758d6b4ce36c3c70f7d721a265c5cb WatchSource:0}: Error finding container 405e8af55502f1ef8ee2c2c1767f11559f758d6b4ce36c3c70f7d721a265c5cb: Status 404 returned error can't find the container with id 405e8af55502f1ef8ee2c2c1767f11559f758d6b4ce36c3c70f7d721a265c5cb Jul 14 22:58:05.446662 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.446626 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w979j" event={"ID":"cabc20f3-751e-4433-9dd3-a1a5b248cefe","Type":"ContainerStarted","Data":"b49fecf6e6dfba5bafa0dc0121dc430ab176a7f6bb21ad803ee43210300e3329"} Jul 14 22:58:05.447739 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.447717 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9kd6n" event={"ID":"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca","Type":"ContainerStarted","Data":"405e8af55502f1ef8ee2c2c1767f11559f758d6b4ce36c3c70f7d721a265c5cb"} Jul 14 22:58:05.457372 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:05.457329 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kc5rv"] Jul 14 22:58:05.460856 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:05.460833 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ebfe428_93a5_4958_91d4_5c8d6110a4a8.slice/crio-50ddc0d63045ed1a32a09413a316ed4a9fd9918567ac4faaed2374db3d880200 WatchSource:0}: Error finding container 50ddc0d63045ed1a32a09413a316ed4a9fd9918567ac4faaed2374db3d880200: Status 404 returned error can't find the container with id 50ddc0d63045ed1a32a09413a316ed4a9fd9918567ac4faaed2374db3d880200 Jul 14 22:58:06.165472 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.165441 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:58:06.166852 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.166193 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:58:06.167996 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.167058 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:58:06.171977 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.171192 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 22:58:06.171977 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.171434 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 22:58:06.171977 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.171640 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 22:58:06.171977 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.171646 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wx244\"" Jul 14 22:58:06.171977 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.171767 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d24rt\"" Jul 14 22:58:06.171977 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.171859 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 22:58:06.454377 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.454278 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kc5rv" event={"ID":"0ebfe428-93a5-4958-91d4-5c8d6110a4a8","Type":"ContainerStarted","Data":"50ddc0d63045ed1a32a09413a316ed4a9fd9918567ac4faaed2374db3d880200"} Jul 14 22:58:06.513725 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.512746 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59cf5d8777-4pwzq"] Jul 14 22:58:06.517083 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.514938 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.521230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.518486 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q5xp8\"" Jul 14 22:58:06.521230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.518863 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 22:58:06.521230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.519301 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 22:58:06.521230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.519572 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 22:58:06.521230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.519767 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 22:58:06.521230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.519973 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 22:58:06.521230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.520292 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 22:58:06.526684 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.525936 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 22:58:06.530291 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.530269 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 22:58:06.535192 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.534021 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cf5d8777-4pwzq"] Jul 14 22:58:06.627535 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.627152 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-serving-cert\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.627535 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.627198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-service-ca\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.627535 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.627286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-oauth-config\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.627535 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.627314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-trusted-ca-bundle\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.627535 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.627352 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-oauth-serving-cert\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.627535 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.627379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdwmv\" (UniqueName: \"kubernetes.io/projected/671a3b07-739e-4e17-91a3-b00aefcade4c-kube-api-access-cdwmv\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.627535 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.627431 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-console-config\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.674489 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.674456 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92"] Jul 14 22:58:06.676604 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.676570 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92" Jul 14 22:58:06.678594 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.678574 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 14 22:58:06.678828 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.678804 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9l42d\"" Jul 14 22:58:06.688272 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.688249 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92"] Jul 14 22:58:06.728526 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.728446 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-console-config\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.728526 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.728507 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5359541d-20fb-4248-905f-b2cd92f46f2a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7zw92\" (UID: \"5359541d-20fb-4248-905f-b2cd92f46f2a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92" Jul 14 22:58:06.728739 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.728545 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-serving-cert\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.728739 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.728576 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-service-ca\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.728739 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.728649 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-oauth-config\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.728739 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.728664 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-trusted-ca-bundle\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.728739 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.728691 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-oauth-serving-cert\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.728739 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.728712 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdwmv\" (UniqueName: \"kubernetes.io/projected/671a3b07-739e-4e17-91a3-b00aefcade4c-kube-api-access-cdwmv\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.733861 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.733830 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-console-config\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.734228 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.734177 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-oauth-serving-cert\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.734836 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.734814 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-trusted-ca-bundle\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.740546 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.740425 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-service-ca\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.741642 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.741585 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-oauth-config\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.742943 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.742922 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdwmv\" (UniqueName: \"kubernetes.io/projected/671a3b07-739e-4e17-91a3-b00aefcade4c-kube-api-access-cdwmv\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.743449 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.743431 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-serving-cert\") pod \"console-59cf5d8777-4pwzq\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:06.829788 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.829711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5359541d-20fb-4248-905f-b2cd92f46f2a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7zw92\" (UID: \"5359541d-20fb-4248-905f-b2cd92f46f2a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92" Jul 14 22:58:06.829996 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:06.829884 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 14 22:58:06.830062 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:06.830010 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5359541d-20fb-4248-905f-b2cd92f46f2a-tls-certificates podName:5359541d-20fb-4248-905f-b2cd92f46f2a nodeName:}" failed. No retries permitted until 2026-07-14 22:58:07.329986851 +0000 UTC m=+41.762231805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5359541d-20fb-4248-905f-b2cd92f46f2a-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-7zw92" (UID: "5359541d-20fb-4248-905f-b2cd92f46f2a") : secret "prometheus-operator-admission-webhook-tls" not found Jul 14 22:58:06.837808 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:06.837750 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:07.004683 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:07.004609 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cf5d8777-4pwzq"] Jul 14 22:58:07.333417 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:07.333319 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5359541d-20fb-4248-905f-b2cd92f46f2a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7zw92\" (UID: \"5359541d-20fb-4248-905f-b2cd92f46f2a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92" Jul 14 22:58:07.336140 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:07.336111 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5359541d-20fb-4248-905f-b2cd92f46f2a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7zw92\" (UID: \"5359541d-20fb-4248-905f-b2cd92f46f2a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92" Jul 14 22:58:07.459974 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:07.459940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5d8777-4pwzq" event={"ID":"671a3b07-739e-4e17-91a3-b00aefcade4c","Type":"ContainerStarted","Data":"2b22ad007f5c8dc3ffc1447f045a6eb10828c67cc3568944a008285a9966f58c"} Jul 14 22:58:07.590585 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:07.590508 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92" Jul 14 22:58:11.530729 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:11.530701 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92"] Jul 14 22:58:11.534413 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:11.534363 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5359541d_20fb_4248_905f_b2cd92f46f2a.slice/crio-d309f6383d479c8173c0e4c61bc47cefb4064b74998bed4a0c8b6f28f8690999 WatchSource:0}: Error finding container d309f6383d479c8173c0e4c61bc47cefb4064b74998bed4a0c8b6f28f8690999: Status 404 returned error can't find the container with id d309f6383d479c8173c0e4c61bc47cefb4064b74998bed4a0c8b6f28f8690999 Jul 14 22:58:12.475716 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:12.475675 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kc5rv" event={"ID":"0ebfe428-93a5-4958-91d4-5c8d6110a4a8","Type":"ContainerStarted","Data":"20452db953c77f417a8a8f26bed442125e23385e51a7808a8f3cc4cf13d9cc7e"} Jul 14 22:58:12.477650 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:12.477615 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w979j" event={"ID":"cabc20f3-751e-4433-9dd3-a1a5b248cefe","Type":"ContainerStarted","Data":"2878d1ee90dc49cc07626a170ba837b23d4d82520aaf967c68fbaf11e0623d31"} Jul 14 22:58:12.478956 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:12.478926 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92" event={"ID":"5359541d-20fb-4248-905f-b2cd92f46f2a","Type":"ContainerStarted","Data":"d309f6383d479c8173c0e4c61bc47cefb4064b74998bed4a0c8b6f28f8690999"} Jul 14 22:58:12.492105 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:12.492061 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w979j" podStartSLOduration=2.467126575 podStartE2EDuration="8.492044131s" totalImagesPullingTime="6.024917556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:12.491589568 +0000 UTC m=+46.923834546" watchObservedRunningTime="2026-07-14 22:58:12.492044131 +0000 UTC m=+46.924289083" Jul 14 22:58:13.483047 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:13.483006 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kc5rv" event={"ID":"0ebfe428-93a5-4958-91d4-5c8d6110a4a8","Type":"ContainerStarted","Data":"31700dbe3314856faad073979f6cf1ad9a2276c782767cfe5c414dd9ebe576d4"} Jul 14 22:58:13.483497 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:13.483116 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:13.484574 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:13.484544 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5d8777-4pwzq" event={"ID":"671a3b07-739e-4e17-91a3-b00aefcade4c","Type":"ContainerStarted","Data":"0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af"} Jul 14 22:58:13.485967 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:13.485940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9kd6n" event={"ID":"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca","Type":"ContainerStarted","Data":"db82e7482598e0fecde19d2b3414a3c42c112194a652b0d947264f365cf322c2"} Jul 14 22:58:13.500638 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:13.500592 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kc5rv" podStartSLOduration=2.575354463 podStartE2EDuration="8.500575116s" totalImagesPullingTime="5.925220653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:13.499663373 +0000 UTC m=+47.931908349" watchObservedRunningTime="2026-07-14 22:58:13.500575116 +0000 UTC m=+47.932820104" Jul 14 22:58:13.521362 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:13.521222 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59cf5d8777-4pwzq" podStartSLOduration=1.260690039 podStartE2EDuration="7.521203023s" totalImagesPullingTime="6.260512984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:13.520875347 +0000 UTC m=+47.953120321" watchObservedRunningTime="2026-07-14 22:58:13.521203023 +0000 UTC m=+47.953447997" Jul 14 22:58:14.490007 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.489950 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92" event={"ID":"5359541d-20fb-4248-905f-b2cd92f46f2a","Type":"ContainerStarted","Data":"5f7e62f37f3433fcc046e27079d233e39dfb36d1fe49032237fa1ffcb9ac0576"} Jul 14 22:58:14.490374 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.490129 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92" Jul 14 22:58:14.491942 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.491914 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9kd6n" event={"ID":"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca","Type":"ContainerStarted","Data":"c82d3d85274cd36f3ea673d08f1687e62d32ec5a1f5dc45e43c96206f6926ffa"} Jul 14 22:58:14.495065 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.495047 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92" Jul 14 22:58:14.508348 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.508295 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7zw92" podStartSLOduration=5.718103446 podStartE2EDuration="8.508282005s" totalImagesPullingTime="2.790178559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:14.507773661 +0000 UTC m=+48.940018636" watchObservedRunningTime="2026-07-14 22:58:14.508282005 +0000 UTC m=+48.940526957" Jul 14 22:58:14.766039 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.766009 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-sxwsk"] Jul 14 22:58:14.786836 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.786806 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-sxwsk"] Jul 14 22:58:14.786973 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.786901 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:14.789028 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.789008 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 14 22:58:14.789164 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.789075 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8x7ml\"" Jul 14 22:58:14.789164 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.789084 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 22:58:14.789164 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.789126 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 14 22:58:14.789804 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.789786 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 22:58:14.789919 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.789822 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 22:58:14.893902 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.893863 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3444b25-996f-415b-a17c-3abaf6faa1d3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:14.894076 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.893980 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3444b25-996f-415b-a17c-3abaf6faa1d3-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:14.894076 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.894017 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3444b25-996f-415b-a17c-3abaf6faa1d3-metrics-client-ca\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:14.894076 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.894036 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8xzh\" (UniqueName: \"kubernetes.io/projected/d3444b25-996f-415b-a17c-3abaf6faa1d3-kube-api-access-v8xzh\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:14.994764 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.994723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3444b25-996f-415b-a17c-3abaf6faa1d3-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:14.994764 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.994760 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3444b25-996f-415b-a17c-3abaf6faa1d3-metrics-client-ca\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:14.995071 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.994777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8xzh\" (UniqueName: \"kubernetes.io/projected/d3444b25-996f-415b-a17c-3abaf6faa1d3-kube-api-access-v8xzh\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:14.995071 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.994915 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3444b25-996f-415b-a17c-3abaf6faa1d3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:14.995071 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:14.995049 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 14 22:58:14.995253 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:14.995125 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3444b25-996f-415b-a17c-3abaf6faa1d3-prometheus-operator-tls podName:d3444b25-996f-415b-a17c-3abaf6faa1d3 nodeName:}" failed. No retries permitted until 2026-07-14 22:58:15.495104495 +0000 UTC m=+49.927349449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d3444b25-996f-415b-a17c-3abaf6faa1d3-prometheus-operator-tls") pod "prometheus-operator-64785b6675-sxwsk" (UID: "d3444b25-996f-415b-a17c-3abaf6faa1d3") : secret "prometheus-operator-tls" not found Jul 14 22:58:14.995605 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.995577 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3444b25-996f-415b-a17c-3abaf6faa1d3-metrics-client-ca\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:14.997640 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:14.997618 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3444b25-996f-415b-a17c-3abaf6faa1d3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:15.003370 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:15.003328 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8xzh\" (UniqueName: \"kubernetes.io/projected/d3444b25-996f-415b-a17c-3abaf6faa1d3-kube-api-access-v8xzh\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:15.499066 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:15.499033 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3444b25-996f-415b-a17c-3abaf6faa1d3-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:15.501763 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:15.501740 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3444b25-996f-415b-a17c-3abaf6faa1d3-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-sxwsk\" (UID: \"d3444b25-996f-415b-a17c-3abaf6faa1d3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:15.697635 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:15.697597 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" Jul 14 22:58:15.840706 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:15.840674 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-sxwsk"] Jul 14 22:58:15.844545 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:15.844519 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3444b25_996f_415b_a17c_3abaf6faa1d3.slice/crio-f6e1f344081b0041403bf96f3062285b94047068cfdf7dddf482d928b90254c9 WatchSource:0}: Error finding container f6e1f344081b0041403bf96f3062285b94047068cfdf7dddf482d928b90254c9: Status 404 returned error can't find the container with id f6e1f344081b0041403bf96f3062285b94047068cfdf7dddf482d928b90254c9 Jul 14 22:58:16.500647 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:16.500608 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" event={"ID":"d3444b25-996f-415b-a17c-3abaf6faa1d3","Type":"ContainerStarted","Data":"f6e1f344081b0041403bf96f3062285b94047068cfdf7dddf482d928b90254c9"} Jul 14 22:58:16.838274 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:16.838188 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:16.838440 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:16.838330 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:16.839645 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:16.839620 2568 patch_prober.go:28] interesting pod/console-59cf5d8777-4pwzq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 14 22:58:16.839876 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:16.839668 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-59cf5d8777-4pwzq" podUID="671a3b07-739e-4e17-91a3-b00aefcade4c" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 14 22:58:18.508771 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:18.508730 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9kd6n" event={"ID":"7e6bda43-eac3-4a28-8eae-73cb9f3a6bca","Type":"ContainerStarted","Data":"e9765bdf4c8a29edf9da9390fb163210c51cb728032776db95b13cdc45bf8e3c"} Jul 14 22:58:18.526913 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:18.526863 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9kd6n" podStartSLOduration=2.69522116 podStartE2EDuration="14.526847627s" totalImagesPullingTime="11.831626467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:58:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:18.526523848 +0000 UTC m=+52.958768823" watchObservedRunningTime="2026-07-14 22:58:18.526847627 +0000 UTC m=+52.959092601" Jul 14 22:58:19.513262 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:19.513226 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" event={"ID":"d3444b25-996f-415b-a17c-3abaf6faa1d3","Type":"ContainerStarted","Data":"30b6c605e6a525a7ab5662b8083d3f61f175ffa375ef7fd2522bafceeebc1f3f"} Jul 14 22:58:19.513739 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:19.513287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" event={"ID":"d3444b25-996f-415b-a17c-3abaf6faa1d3","Type":"ContainerStarted","Data":"ab4f9551eb5e8cac9ff2afa0db38c79ae66852d9c2e9f4445a88d0bfb5fd9b46"} Jul 14 22:58:19.530221 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:19.530176 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-sxwsk" podStartSLOduration=2.649754437 podStartE2EDuration="5.530160511s" totalImagesPullingTime="2.880406074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:19.53009372 +0000 UTC m=+53.962338695" watchObservedRunningTime="2026-07-14 22:58:19.530160511 +0000 UTC m=+53.962405484" Jul 14 22:58:21.110259 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.110229 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9"] Jul 14 22:58:21.132140 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.132092 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9"] Jul 14 22:58:21.132323 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.132169 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.134294 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.134269 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 14 22:58:21.134430 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.134310 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7sswh\"" Jul 14 22:58:21.134430 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.134313 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 14 22:58:21.139579 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.139551 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9g6bm"] Jul 14 22:58:21.162761 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.162736 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d92mj"] Jul 14 22:58:21.162858 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.162842 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.165035 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.165018 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 14 22:58:21.165158 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.165084 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 14 22:58:21.165158 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.165087 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mb2z5\"" Jul 14 22:58:21.165264 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.165132 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 14 22:58:21.186752 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.186734 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9g6bm"] Jul 14 22:58:21.186853 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.186829 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.189002 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.188971 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 22:58:21.189002 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.188984 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 22:58:21.189140 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.189022 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 22:58:21.189140 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.189026 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ztnh6\"" Jul 14 22:58:21.245879 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.245851 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-sys\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.245879 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.245883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-accelerators-collector-config\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.246066 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.245904 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.246066 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.245919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.246066 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.245959 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.246066 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94d2ff34-d6d3-42c9-a4da-07739b4b044b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.246066 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246061 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-tls\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.246285 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246079 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94d2ff34-d6d3-42c9-a4da-07739b4b044b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.246285 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246097 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-root\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.246285 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246133 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ttnx\" (UniqueName: \"kubernetes.io/projected/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-kube-api-access-5ttnx\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.246285 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246171 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47gms\" (UniqueName: \"kubernetes.io/projected/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-api-access-47gms\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.246285 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246196 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-wtmp\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.246285 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246219 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-metrics-client-ca\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.246285 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246237 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d2ff34-d6d3-42c9-a4da-07739b4b044b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.246285 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246252 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-775qt\" (UniqueName: \"kubernetes.io/projected/94d2ff34-d6d3-42c9-a4da-07739b4b044b-kube-api-access-775qt\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.246285 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.246748 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246307 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.246748 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.246748 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.246412 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-textfile\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.347354 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.347354 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94d2ff34-d6d3-42c9-a4da-07739b4b044b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.347557 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-tls\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.347557 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347431 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94d2ff34-d6d3-42c9-a4da-07739b4b044b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.347557 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347459 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-root\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.347557 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347481 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ttnx\" (UniqueName: \"kubernetes.io/projected/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-kube-api-access-5ttnx\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.347557 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47gms\" (UniqueName: \"kubernetes.io/projected/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-api-access-47gms\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.347798 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347560 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-wtmp\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.347798 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347584 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-metrics-client-ca\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.347798 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347619 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d2ff34-d6d3-42c9-a4da-07739b4b044b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.347798 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347640 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-775qt\" (UniqueName: \"kubernetes.io/projected/94d2ff34-d6d3-42c9-a4da-07739b4b044b-kube-api-access-775qt\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.347798 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347675 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.347798 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347702 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.347798 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347758 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.348111 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347816 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-textfile\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.348111 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347841 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-sys\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.348111 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347878 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-accelerators-collector-config\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.348111 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:21.347912 2568 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 14 22:58:21.348111 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347926 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.348111 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.347950 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.348363 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:21.347983 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-tls podName:f9e4cadc-0df3-46e3-86d1-b44a37d2a358 nodeName:}" failed. No retries permitted until 2026-07-14 22:58:21.847960176 +0000 UTC m=+56.280205142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-9g6bm" (UID: "f9e4cadc-0df3-46e3-86d1-b44a37d2a358") : secret "kube-state-metrics-tls" not found Jul 14 22:58:21.349939 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.349662 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-root\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.352162 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.350684 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-wtmp\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.352162 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.351230 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-metrics-client-ca\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.352162 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.351672 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.352162 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.352159 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94d2ff34-d6d3-42c9-a4da-07739b4b044b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.352162 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.352605 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-tls\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.352162 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.352798 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.352162 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.353231 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94d2ff34-d6d3-42c9-a4da-07739b4b044b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.352162 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.355008 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d2ff34-d6d3-42c9-a4da-07739b4b044b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.352162 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.355157 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-sys\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.352162 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.355230 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.355938 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.355426 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-textfile\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.355938 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.355788 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.358168 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.356055 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.358168 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.356493 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-node-exporter-accelerators-collector-config\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.360888 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.360732 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47gms\" (UniqueName: \"kubernetes.io/projected/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-api-access-47gms\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.360888 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.360846 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ttnx\" (UniqueName: \"kubernetes.io/projected/2cd554f0-2f94-4fa3-b9b5-b6084ab5b882-kube-api-access-5ttnx\") pod \"node-exporter-d92mj\" (UID: \"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882\") " pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.362842 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.362822 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-775qt\" (UniqueName: \"kubernetes.io/projected/94d2ff34-d6d3-42c9-a4da-07739b4b044b-kube-api-access-775qt\") pod \"openshift-state-metrics-84bd68b896-6h4j9\" (UID: \"94d2ff34-d6d3-42c9-a4da-07739b4b044b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.442010 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.441975 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" Jul 14 22:58:21.495268 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.495241 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d92mj" Jul 14 22:58:21.525496 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:21.525460 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd554f0_2f94_4fa3_b9b5_b6084ab5b882.slice/crio-e4933f91dedc9e42edb968e9efef3af1f6538c6bb114754fd26f2c76e5e20398 WatchSource:0}: Error finding container e4933f91dedc9e42edb968e9efef3af1f6538c6bb114754fd26f2c76e5e20398: Status 404 returned error can't find the container with id e4933f91dedc9e42edb968e9efef3af1f6538c6bb114754fd26f2c76e5e20398 Jul 14 22:58:21.584628 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.584594 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9"] Jul 14 22:58:21.587275 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:21.587249 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d2ff34_d6d3_42c9_a4da_07739b4b044b.slice/crio-fce6c38f2483be47e0eb49aa75d38f5ca07e2ff7226b733975933da542282524 WatchSource:0}: Error finding container fce6c38f2483be47e0eb49aa75d38f5ca07e2ff7226b733975933da542282524: Status 404 returned error can't find the container with id fce6c38f2483be47e0eb49aa75d38f5ca07e2ff7226b733975933da542282524 Jul 14 22:58:21.860751 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.860721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:21.862978 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:21.862953 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9e4cadc-0df3-46e3-86d1-b44a37d2a358-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9g6bm\" (UID: \"f9e4cadc-0df3-46e3-86d1-b44a37d2a358\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:22.071813 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.071781 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" Jul 14 22:58:22.204049 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.204021 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 22:58:22.217288 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.217257 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.220319 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.220278 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 22:58:22.220474 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.220394 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 22:58:22.220664 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.220596 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-74vpr\"" Jul 14 22:58:22.220664 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.220654 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 22:58:22.220835 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.220817 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 22:58:22.220883 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.220866 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 22:58:22.221010 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.220986 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 22:58:22.221085 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.221070 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 22:58:22.221178 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.221163 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 22:58:22.221237 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.220286 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 22:58:22.222569 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.222071 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9g6bm"] Jul 14 22:58:22.224687 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.224652 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 22:58:22.226709 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:22.226673 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e4cadc_0df3_46e3_86d1_b44a37d2a358.slice/crio-3b707c219c62f80dc7d9c6d368b2a0d2f95e89e863533f8e9a6300b13858e63f WatchSource:0}: Error finding container 3b707c219c62f80dc7d9c6d368b2a0d2f95e89e863533f8e9a6300b13858e63f: Status 404 returned error can't find the container with id 3b707c219c62f80dc7d9c6d368b2a0d2f95e89e863533f8e9a6300b13858e63f Jul 14 22:58:22.364622 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364556 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/912f2140-cde4-4348-8bce-cdb97e4d9830-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.364622 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364595 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.364839 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364645 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-web-config\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.364839 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364673 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.364839 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364697 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.364839 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364752 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/912f2140-cde4-4348-8bce-cdb97e4d9830-config-out\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.364839 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364800 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-config-volume\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.364839 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.365053 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364843 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/912f2140-cde4-4348-8bce-cdb97e4d9830-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.365053 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364889 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/912f2140-cde4-4348-8bce-cdb97e4d9830-tls-assets\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.365053 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364905 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/912f2140-cde4-4348-8bce-cdb97e4d9830-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.365053 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364947 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.365053 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.364962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5xg5\" (UniqueName: \"kubernetes.io/projected/912f2140-cde4-4348-8bce-cdb97e4d9830-kube-api-access-s5xg5\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465381 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465348 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465381 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465385 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xg5\" (UniqueName: \"kubernetes.io/projected/912f2140-cde4-4348-8bce-cdb97e4d9830-kube-api-access-s5xg5\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465606 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465411 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/912f2140-cde4-4348-8bce-cdb97e4d9830-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465606 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465606 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-web-config\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465606 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465495 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465606 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465606 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465573 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/912f2140-cde4-4348-8bce-cdb97e4d9830-config-out\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465895 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465637 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-config-volume\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465895 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465669 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465895 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/912f2140-cde4-4348-8bce-cdb97e4d9830-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465895 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465746 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/912f2140-cde4-4348-8bce-cdb97e4d9830-tls-assets\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465895 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465786 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/912f2140-cde4-4348-8bce-cdb97e4d9830-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.465895 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.465794 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/912f2140-cde4-4348-8bce-cdb97e4d9830-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.467405 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.467293 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/912f2140-cde4-4348-8bce-cdb97e4d9830-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.467545 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.467438 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/912f2140-cde4-4348-8bce-cdb97e4d9830-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.468822 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.468785 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.469947 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.469884 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.470217 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.470065 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/912f2140-cde4-4348-8bce-cdb97e4d9830-tls-assets\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.470217 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.470131 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.470476 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.470457 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.470622 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.470599 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-web-config\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.470857 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.470834 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/912f2140-cde4-4348-8bce-cdb97e4d9830-config-out\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.471097 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.471068 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.472485 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.472460 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/912f2140-cde4-4348-8bce-cdb97e4d9830-config-volume\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.473247 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.473226 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5xg5\" (UniqueName: \"kubernetes.io/projected/912f2140-cde4-4348-8bce-cdb97e4d9830-kube-api-access-s5xg5\") pod \"alertmanager-main-0\" (UID: \"912f2140-cde4-4348-8bce-cdb97e4d9830\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.524284 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.524235 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" event={"ID":"f9e4cadc-0df3-46e3-86d1-b44a37d2a358","Type":"ContainerStarted","Data":"3b707c219c62f80dc7d9c6d368b2a0d2f95e89e863533f8e9a6300b13858e63f"} Jul 14 22:58:22.525654 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.525618 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d92mj" event={"ID":"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882","Type":"ContainerStarted","Data":"e4933f91dedc9e42edb968e9efef3af1f6538c6bb114754fd26f2c76e5e20398"} Jul 14 22:58:22.527608 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.527581 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" event={"ID":"94d2ff34-d6d3-42c9-a4da-07739b4b044b","Type":"ContainerStarted","Data":"562fe50b5fb5687a296320fe418a1588c074f8e8dda249e3a896ac11445f1e9d"} Jul 14 22:58:22.527723 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.527633 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" event={"ID":"94d2ff34-d6d3-42c9-a4da-07739b4b044b","Type":"ContainerStarted","Data":"498a823a0137f5e675ec59020d92c40f650b91d745cf89072f3ac61e6c450363"} Jul 14 22:58:22.527723 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.527663 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" event={"ID":"94d2ff34-d6d3-42c9-a4da-07739b4b044b","Type":"ContainerStarted","Data":"fce6c38f2483be47e0eb49aa75d38f5ca07e2ff7226b733975933da542282524"} Jul 14 22:58:22.530804 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.530781 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 22:58:22.843875 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:22.843849 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 22:58:22.848258 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:22.848235 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912f2140_cde4_4348_8bce_cdb97e4d9830.slice/crio-e05190298f9a7c3af9f14195f5e0e3d7dc32ac310f8c639d2b11440170665874 WatchSource:0}: Error finding container e05190298f9a7c3af9f14195f5e0e3d7dc32ac310f8c639d2b11440170665874: Status 404 returned error can't find the container with id e05190298f9a7c3af9f14195f5e0e3d7dc32ac310f8c639d2b11440170665874 Jul 14 22:58:23.212160 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.212128 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8"] Jul 14 22:58:23.231889 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.231664 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8"] Jul 14 22:58:23.231889 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.231813 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.235008 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.234421 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 14 22:58:23.235008 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.234681 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 14 22:58:23.235008 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.234883 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 14 22:58:23.237361 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.235375 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 14 22:58:23.237361 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.235647 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 14 22:58:23.237361 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.235722 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wtr82\"" Jul 14 22:58:23.237361 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.235949 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ebadusq8q1mfh\"" Jul 14 22:58:23.374873 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.374832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.375045 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.374955 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-tls\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.375125 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.375066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.375125 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.375105 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-grpc-tls\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.375230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.375135 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.375230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.375187 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9e51057-3e09-4eb6-ad40-42ac49270d99-metrics-client-ca\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.375329 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.375228 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.375329 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.375261 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjvxh\" (UniqueName: \"kubernetes.io/projected/e9e51057-3e09-4eb6-ad40-42ac49270d99-kube-api-access-fjvxh\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.475837 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.475808 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-tls\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.475998 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.475879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.475998 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.475902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-grpc-tls\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.475998 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.475928 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.475998 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.475973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9e51057-3e09-4eb6-ad40-42ac49270d99-metrics-client-ca\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.475998 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.475999 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.476269 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.476018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjvxh\" (UniqueName: \"kubernetes.io/projected/e9e51057-3e09-4eb6-ad40-42ac49270d99-kube-api-access-fjvxh\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.476269 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.476059 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.477229 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.477156 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9e51057-3e09-4eb6-ad40-42ac49270d99-metrics-client-ca\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.478967 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.478939 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-tls\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.479075 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.479045 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.479509 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.479488 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.479717 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.479694 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.479717 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.479705 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-grpc-tls\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.479880 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.479861 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e9e51057-3e09-4eb6-ad40-42ac49270d99-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.488183 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.488163 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjvxh\" (UniqueName: \"kubernetes.io/projected/e9e51057-3e09-4eb6-ad40-42ac49270d99-kube-api-access-fjvxh\") pod \"thanos-querier-5dbf874d4c-8qhr8\" (UID: \"e9e51057-3e09-4eb6-ad40-42ac49270d99\") " pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:23.494397 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.494378 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kc5rv" Jul 14 22:58:23.533285 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.533251 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d92mj" event={"ID":"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882","Type":"ContainerStarted","Data":"76afb513c610092d6a9b2ccd1679efe10ff21f4c6c1153c0a6a95d519ec801f0"} Jul 14 22:58:23.534487 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.534457 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"912f2140-cde4-4348-8bce-cdb97e4d9830","Type":"ContainerStarted","Data":"e05190298f9a7c3af9f14195f5e0e3d7dc32ac310f8c639d2b11440170665874"} Jul 14 22:58:23.548822 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:23.548790 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:24.539926 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:24.539892 2568 generic.go:356] "Generic (PLEG): container finished" podID="2cd554f0-2f94-4fa3-b9b5-b6084ab5b882" containerID="76afb513c610092d6a9b2ccd1679efe10ff21f4c6c1153c0a6a95d519ec801f0" exitCode=0 Jul 14 22:58:24.540293 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:24.539953 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d92mj" event={"ID":"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882","Type":"ContainerDied","Data":"76afb513c610092d6a9b2ccd1679efe10ff21f4c6c1153c0a6a95d519ec801f0"} Jul 14 22:58:24.873666 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:24.873557 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8"] Jul 14 22:58:24.877361 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:24.877307 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e51057_3e09_4eb6_ad40_42ac49270d99.slice/crio-7b2917326bd96fb79c8e1c13358723935b64694b80e66bbf0c9e8dd351a3df0a WatchSource:0}: Error finding container 7b2917326bd96fb79c8e1c13358723935b64694b80e66bbf0c9e8dd351a3df0a: Status 404 returned error can't find the container with id 7b2917326bd96fb79c8e1c13358723935b64694b80e66bbf0c9e8dd351a3df0a Jul 14 22:58:25.438356 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.438293 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-857b87c496-bqx4r"] Jul 14 22:58:25.440735 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.440714 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.443522 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.443499 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 14 22:58:25.443975 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.443956 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 22:58:25.444345 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.444309 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jppnj\"" Jul 14 22:58:25.444345 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.444322 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4jvuaaq7ql5hk\"" Jul 14 22:58:25.444491 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.444360 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 14 22:58:25.444491 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.444377 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 14 22:58:25.451635 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.451615 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-857b87c496-bqx4r"] Jul 14 22:58:25.545494 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.545461 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" event={"ID":"f9e4cadc-0df3-46e3-86d1-b44a37d2a358","Type":"ContainerStarted","Data":"cb5c50ff880b16ff3126f94f7c0229bf296735fefd7c3243b2f8293c8f853d67"} Jul 14 22:58:25.545913 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.545524 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" event={"ID":"f9e4cadc-0df3-46e3-86d1-b44a37d2a358","Type":"ContainerStarted","Data":"09a1b3992c618a1dabf3efc7099ffc7ceb359bfc37c742601e321243293ec13b"} Jul 14 22:58:25.545913 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.545555 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" event={"ID":"f9e4cadc-0df3-46e3-86d1-b44a37d2a358","Type":"ContainerStarted","Data":"2bf8d0cb0966a1dc98b3fa757d1732f3f324dc7f317cbaced266ef797e684d30"} Jul 14 22:58:25.546999 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.546977 2568 generic.go:356] "Generic (PLEG): container finished" podID="912f2140-cde4-4348-8bce-cdb97e4d9830" containerID="7eddeeef486545982144fcc2394ba2a8cfd1ca17c2b93be0d278f2307e3bedbf" exitCode=0 Jul 14 22:58:25.547127 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.547024 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"912f2140-cde4-4348-8bce-cdb97e4d9830","Type":"ContainerDied","Data":"7eddeeef486545982144fcc2394ba2a8cfd1ca17c2b93be0d278f2307e3bedbf"} Jul 14 22:58:25.548287 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.548261 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" event={"ID":"e9e51057-3e09-4eb6-ad40-42ac49270d99","Type":"ContainerStarted","Data":"7b2917326bd96fb79c8e1c13358723935b64694b80e66bbf0c9e8dd351a3df0a"} Jul 14 22:58:25.550614 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.550590 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d92mj" event={"ID":"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882","Type":"ContainerStarted","Data":"978486683f1aa8665418a5105cb4bd4145f6e0dcbf42687e530277af197327dc"} Jul 14 22:58:25.550706 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.550637 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d92mj" event={"ID":"2cd554f0-2f94-4fa3-b9b5-b6084ab5b882","Type":"ContainerStarted","Data":"235f709ef4c241a8e61675290a659e35a9c98ca84178bdd70e544d7eefe9ef69"} Jul 14 22:58:25.552604 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.552585 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" event={"ID":"94d2ff34-d6d3-42c9-a4da-07739b4b044b","Type":"ContainerStarted","Data":"761dbda0e78d968dcaa5419aedda04d0e8a09f80a031c22ef9ef3b4c753014ec"} Jul 14 22:58:25.565160 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.565098 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-9g6bm" podStartSLOduration=2.057735565 podStartE2EDuration="4.565084982s" totalImagesPullingTime="2.507349417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:25.564171376 +0000 UTC m=+59.996416352" watchObservedRunningTime="2026-07-14 22:58:25.565084982 +0000 UTC m=+59.997329955" Jul 14 22:58:25.582267 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.582224 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d92mj" podStartSLOduration=2.633447144 podStartE2EDuration="4.582210273s" totalImagesPullingTime="1.852989143s" totalInitContainerRuntime="95.773986ms" isStatefulPod=true podCreationTimestamp="2026-07-14 22:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:25.580886153 +0000 UTC m=+60.013131139" watchObservedRunningTime="2026-07-14 22:58:25.582210273 +0000 UTC m=+60.014455225" Jul 14 22:58:25.592032 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.592005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0868b932-2703-4b76-b5cb-871b5a278ddd-audit-log\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.592143 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.592038 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0868b932-2703-4b76-b5cb-871b5a278ddd-metrics-server-audit-profiles\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.592143 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.592069 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0868b932-2703-4b76-b5cb-871b5a278ddd-secret-metrics-server-tls\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.592143 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.592099 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0868b932-2703-4b76-b5cb-871b5a278ddd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.592277 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.592162 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0868b932-2703-4b76-b5cb-871b5a278ddd-secret-metrics-server-client-certs\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.592277 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.592192 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0868b932-2703-4b76-b5cb-871b5a278ddd-client-ca-bundle\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.592277 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.592230 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znc4t\" (UniqueName: \"kubernetes.io/projected/0868b932-2703-4b76-b5cb-871b5a278ddd-kube-api-access-znc4t\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.598921 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.598869 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6h4j9" podStartSLOduration=1.690332969 podStartE2EDuration="4.598851776s" totalImagesPullingTime="2.908518807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:25.598647185 +0000 UTC m=+60.030892184" watchObservedRunningTime="2026-07-14 22:58:25.598851776 +0000 UTC m=+60.031096751" Jul 14 22:58:25.693752 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.693678 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0868b932-2703-4b76-b5cb-871b5a278ddd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.694894 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.693904 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0868b932-2703-4b76-b5cb-871b5a278ddd-secret-metrics-server-client-certs\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.694894 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.693943 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0868b932-2703-4b76-b5cb-871b5a278ddd-client-ca-bundle\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.694894 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.694043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znc4t\" (UniqueName: \"kubernetes.io/projected/0868b932-2703-4b76-b5cb-871b5a278ddd-kube-api-access-znc4t\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.694894 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.694301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0868b932-2703-4b76-b5cb-871b5a278ddd-audit-log\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.694894 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.694467 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0868b932-2703-4b76-b5cb-871b5a278ddd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.694894 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.694616 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0868b932-2703-4b76-b5cb-871b5a278ddd-audit-log\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.694894 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.694733 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0868b932-2703-4b76-b5cb-871b5a278ddd-metrics-server-audit-profiles\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.694894 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.694896 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0868b932-2703-4b76-b5cb-871b5a278ddd-secret-metrics-server-tls\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.695653 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.695630 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0868b932-2703-4b76-b5cb-871b5a278ddd-metrics-server-audit-profiles\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.696937 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.696911 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0868b932-2703-4b76-b5cb-871b5a278ddd-secret-metrics-server-client-certs\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.697452 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.697430 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0868b932-2703-4b76-b5cb-871b5a278ddd-secret-metrics-server-tls\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.697535 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.697484 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0868b932-2703-4b76-b5cb-871b5a278ddd-client-ca-bundle\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.703425 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.703400 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znc4t\" (UniqueName: \"kubernetes.io/projected/0868b932-2703-4b76-b5cb-871b5a278ddd-kube-api-access-znc4t\") pod \"metrics-server-857b87c496-bqx4r\" (UID: \"0868b932-2703-4b76-b5cb-871b5a278ddd\") " pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.750303 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.750258 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:25.882132 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.882095 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-857b87c496-bqx4r"] Jul 14 22:58:25.885819 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:25.885787 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0868b932_2703_4b76_b5cb_871b5a278ddd.slice/crio-a91f341579a962dca704994dcf763d133707725ae62e4b39125bc347b51f1770 WatchSource:0}: Error finding container a91f341579a962dca704994dcf763d133707725ae62e4b39125bc347b51f1770: Status 404 returned error can't find the container with id a91f341579a962dca704994dcf763d133707725ae62e4b39125bc347b51f1770 Jul 14 22:58:25.911555 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.911520 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt"] Jul 14 22:58:25.914386 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.914363 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" Jul 14 22:58:25.916736 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.916547 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 14 22:58:25.916736 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.916640 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hsbsp\"" Jul 14 22:58:25.924772 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.924728 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt"] Jul 14 22:58:25.998584 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.998494 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn746\" (UniqueName: \"kubernetes.io/projected/c5198eff-383d-4529-ac68-128b6449de91-kube-api-access-wn746\") pod \"monitoring-plugin-5f68df7f58-ghfvt\" (UID: \"c5198eff-383d-4529-ac68-128b6449de91\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" Jul 14 22:58:25.998584 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:25.998538 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c5198eff-383d-4529-ac68-128b6449de91-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-ghfvt\" (UID: \"c5198eff-383d-4529-ac68-128b6449de91\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" Jul 14 22:58:26.100600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:26.099953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn746\" (UniqueName: \"kubernetes.io/projected/c5198eff-383d-4529-ac68-128b6449de91-kube-api-access-wn746\") pod \"monitoring-plugin-5f68df7f58-ghfvt\" (UID: \"c5198eff-383d-4529-ac68-128b6449de91\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" Jul 14 22:58:26.100600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:26.100002 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c5198eff-383d-4529-ac68-128b6449de91-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-ghfvt\" (UID: \"c5198eff-383d-4529-ac68-128b6449de91\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" Jul 14 22:58:26.102194 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:26.102165 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 14 22:58:26.108603 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:26.108580 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn746\" (UniqueName: \"kubernetes.io/projected/c5198eff-383d-4529-ac68-128b6449de91-kube-api-access-wn746\") pod \"monitoring-plugin-5f68df7f58-ghfvt\" (UID: \"c5198eff-383d-4529-ac68-128b6449de91\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" Jul 14 22:58:26.113185 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:26.113160 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c5198eff-383d-4529-ac68-128b6449de91-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-ghfvt\" (UID: \"c5198eff-383d-4529-ac68-128b6449de91\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" Jul 14 22:58:26.229550 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:26.229514 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hsbsp\"" Jul 14 22:58:26.238311 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:26.238273 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" Jul 14 22:58:26.391730 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:26.391699 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt"] Jul 14 22:58:26.394258 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:26.394220 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5198eff_383d_4529_ac68_128b6449de91.slice/crio-195232e0d39edfcc8579592e511093a58d021c181a77d68ad02a253a66ff2e8c WatchSource:0}: Error finding container 195232e0d39edfcc8579592e511093a58d021c181a77d68ad02a253a66ff2e8c: Status 404 returned error can't find the container with id 195232e0d39edfcc8579592e511093a58d021c181a77d68ad02a253a66ff2e8c Jul 14 22:58:26.559599 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:26.559494 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" event={"ID":"c5198eff-383d-4529-ac68-128b6449de91","Type":"ContainerStarted","Data":"195232e0d39edfcc8579592e511093a58d021c181a77d68ad02a253a66ff2e8c"} Jul 14 22:58:26.561900 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:26.561424 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" event={"ID":"0868b932-2703-4b76-b5cb-871b5a278ddd","Type":"ContainerStarted","Data":"a91f341579a962dca704994dcf763d133707725ae62e4b39125bc347b51f1770"} Jul 14 22:58:26.721371 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:26.721274 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cf5d8777-4pwzq"] Jul 14 22:58:27.368157 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.367628 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 22:58:27.370673 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.370650 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.374870 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.374835 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-txm84\"" Jul 14 22:58:27.376609 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.376535 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 22:58:27.376823 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.376800 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 22:58:27.376823 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.376809 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 22:58:27.377007 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.376912 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 22:58:27.377085 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.377070 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 22:58:27.377151 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.377119 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 22:58:27.377308 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.377293 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 22:58:27.377397 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.377374 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 22:58:27.377556 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.377533 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 22:58:27.383054 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.379650 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 22:58:27.383054 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.380501 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 22:58:27.383054 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.381388 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 22:58:27.383673 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.383648 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e7q4mael2fo79\"" Jul 14 22:58:27.387688 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.387666 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 22:58:27.391428 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.391402 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 22:58:27.392885 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.392680 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 22:58:27.440388 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.440359 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdms" Jul 14 22:58:27.514960 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.514928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.514960 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.514965 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.514985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515021 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mjqg\" (UniqueName: \"kubernetes.io/projected/9160e848-b452-451c-a124-04966eda11ea-kube-api-access-8mjqg\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515230 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9160e848-b452-451c-a124-04966eda11ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515548 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515245 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515548 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515404 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9160e848-b452-451c-a124-04966eda11ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515548 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515442 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515548 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515468 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515670 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515548 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515670 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515573 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515670 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515599 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515670 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515620 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515670 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515886 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515703 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515886 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515729 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-config\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515886 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515771 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.515886 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.515797 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.617243 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617149 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.617243 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617200 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-config\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.617243 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617244 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617271 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617311 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617358 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617411 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617436 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mjqg\" (UniqueName: \"kubernetes.io/projected/9160e848-b452-451c-a124-04966eda11ea-kube-api-access-8mjqg\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617475 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617505 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9160e848-b452-451c-a124-04966eda11ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617532 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9160e848-b452-451c-a124-04966eda11ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617588 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617613 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617682 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.619600 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617710 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.620264 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617737 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.620264 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617759 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.620264 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.617785 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.620264 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.618585 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.620264 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.619847 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.620535 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.620500 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.622291 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.621091 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.622291 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.621783 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.622291 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.621926 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.626204 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.625979 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.626577 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.626475 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9160e848-b452-451c-a124-04966eda11ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.628419 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.628370 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9160e848-b452-451c-a124-04966eda11ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.628513 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.628428 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.628513 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.628449 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.628812 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.628787 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.629530 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.629125 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.629530 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.629471 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.629530 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.629501 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.629894 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.629853 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.630329 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.630290 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-config\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.630525 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.630483 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9160e848-b452-451c-a124-04966eda11ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.630908 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.630864 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9160e848-b452-451c-a124-04966eda11ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.633294 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.633220 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mjqg\" (UniqueName: \"kubernetes.io/projected/9160e848-b452-451c-a124-04966eda11ea-kube-api-access-8mjqg\") pod \"prometheus-k8s-0\" (UID: \"9160e848-b452-451c-a124-04966eda11ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:27.692562 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:27.691933 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:28.342157 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:28.342122 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 22:58:28.347757 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:28.347685 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9160e848_b452_451c_a124_04966eda11ea.slice/crio-75bbb6f57c3770fe8efb3dab8e24b1b1852e18b5ba974bec84243c0ecf867ad6 WatchSource:0}: Error finding container 75bbb6f57c3770fe8efb3dab8e24b1b1852e18b5ba974bec84243c0ecf867ad6: Status 404 returned error can't find the container with id 75bbb6f57c3770fe8efb3dab8e24b1b1852e18b5ba974bec84243c0ecf867ad6 Jul 14 22:58:28.572177 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:28.572134 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9160e848-b452-451c-a124-04966eda11ea","Type":"ContainerStarted","Data":"bc9cfdd95c3b641b0de8a50344358bad13414f23bd4770c354079fa61737f5e9"} Jul 14 22:58:28.572382 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:28.572230 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9160e848-b452-451c-a124-04966eda11ea","Type":"ContainerStarted","Data":"75bbb6f57c3770fe8efb3dab8e24b1b1852e18b5ba974bec84243c0ecf867ad6"} Jul 14 22:58:28.575161 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:28.575123 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"912f2140-cde4-4348-8bce-cdb97e4d9830","Type":"ContainerStarted","Data":"4886fdf77b0ca001840654c1d13e698305b52ad94ffd457d1aa330d249221073"} Jul 14 22:58:28.575295 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:28.575190 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"912f2140-cde4-4348-8bce-cdb97e4d9830","Type":"ContainerStarted","Data":"d6c2386e52be22c1c5f5653f6d33e038b1e12284cd944975efac953a240b4e57"} Jul 14 22:58:28.575295 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:28.575231 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"912f2140-cde4-4348-8bce-cdb97e4d9830","Type":"ContainerStarted","Data":"2add2d30422880731f85dc525e72205bd95daa18962168496a3fc88245dd406a"} Jul 14 22:58:28.577786 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:28.577759 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" event={"ID":"e9e51057-3e09-4eb6-ad40-42ac49270d99","Type":"ContainerStarted","Data":"a34e8a66ea891086dec5afecaaff43defb86e98553d3f2673eeb88eba5460b77"} Jul 14 22:58:28.577891 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:28.577816 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" event={"ID":"e9e51057-3e09-4eb6-ad40-42ac49270d99","Type":"ContainerStarted","Data":"24da11a3a6d845d4b2d6a3a99b666ba22fe4b8ef5dc13012b04f9abcb2b7e2c5"} Jul 14 22:58:28.577891 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:28.577844 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" event={"ID":"e9e51057-3e09-4eb6-ad40-42ac49270d99","Type":"ContainerStarted","Data":"ddbab492e149eb7c04ce5efc4c307cf652c586d69f5acb92e3a187f866dfaf6b"} Jul 14 22:58:28.579527 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:28.579501 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" event={"ID":"0868b932-2703-4b76-b5cb-871b5a278ddd","Type":"ContainerStarted","Data":"dd79a9cd64671851df6d00a046de9d08f9e8e006f3a87aa42d9ad4c34ae58681"} Jul 14 22:58:28.630241 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:28.630181 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" podStartSLOduration=1.351059633 podStartE2EDuration="3.63016021s" totalImagesPullingTime="2.279100577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:28.624775934 +0000 UTC m=+63.057020910" watchObservedRunningTime="2026-07-14 22:58:28.63016021 +0000 UTC m=+63.062405189" Jul 14 22:58:29.587613 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.587514 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" event={"ID":"e9e51057-3e09-4eb6-ad40-42ac49270d99","Type":"ContainerStarted","Data":"7beaef3a1dae676083f83cbe4e8b3cad375866b77187b80eaaef72e393e8b3fe"} Jul 14 22:58:29.587768 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.587643 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" event={"ID":"e9e51057-3e09-4eb6-ad40-42ac49270d99","Type":"ContainerStarted","Data":"6907f8067e4861ff3f653703f9abf621cc622646262e515bb68e90220edc2b45"} Jul 14 22:58:29.587768 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.587685 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" event={"ID":"e9e51057-3e09-4eb6-ad40-42ac49270d99","Type":"ContainerStarted","Data":"d93ece33abbfcf290d1545e62241d09f981cce70764543ce7df5249f9e8aba7f"} Jul 14 22:58:29.588107 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.588046 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:29.589720 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.589691 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" event={"ID":"c5198eff-383d-4529-ac68-128b6449de91","Type":"ContainerStarted","Data":"510811492beed208c31a62b69357ad78de2ffc846d925103fdffdbc4de069987"} Jul 14 22:58:29.589827 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.589741 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" Jul 14 22:58:29.591386 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.591323 2568 generic.go:356] "Generic (PLEG): container finished" podID="9160e848-b452-451c-a124-04966eda11ea" containerID="bc9cfdd95c3b641b0de8a50344358bad13414f23bd4770c354079fa61737f5e9" exitCode=0 Jul 14 22:58:29.591386 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.591372 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9160e848-b452-451c-a124-04966eda11ea","Type":"ContainerDied","Data":"bc9cfdd95c3b641b0de8a50344358bad13414f23bd4770c354079fa61737f5e9"} Jul 14 22:58:29.595872 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.595847 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" Jul 14 22:58:29.596307 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.596285 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"912f2140-cde4-4348-8bce-cdb97e4d9830","Type":"ContainerStarted","Data":"93bae832bb2df4dacdac6c346119fc5757ea613709febb615eaabc7cd3a6d2f4"} Jul 14 22:58:29.596433 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.596369 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"912f2140-cde4-4348-8bce-cdb97e4d9830","Type":"ContainerStarted","Data":"5ddc8bf62bcad4b8bb78063705023e4cd30e5b8376a2b6c21856b98f7fec3d98"} Jul 14 22:58:29.596433 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.596421 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"912f2140-cde4-4348-8bce-cdb97e4d9830","Type":"ContainerStarted","Data":"af912115136880b47d10f4448fb226f6a8d9ee3db8168be249dc21bb36904082"} Jul 14 22:58:29.611867 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.610893 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" podStartSLOduration=2.471416242 podStartE2EDuration="6.610873883s" totalImagesPullingTime="4.139457641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:29.609095573 +0000 UTC m=+64.041340546" watchObservedRunningTime="2026-07-14 22:58:29.610873883 +0000 UTC m=+64.043118858" Jul 14 22:58:29.661252 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.661194 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.728913547 podStartE2EDuration="7.661174947s" totalImagesPullingTime="4.903436328s" totalInitContainerRuntime="28.825072ms" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:29.6600059 +0000 UTC m=+64.092250874" watchObservedRunningTime="2026-07-14 22:58:29.661174947 +0000 UTC m=+64.093419923" Jul 14 22:58:29.679967 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:29.679906 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ghfvt" podStartSLOduration=2.264490362 podStartE2EDuration="4.679885362s" totalImagesPullingTime="2.415395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:29.678176251 +0000 UTC m=+64.110421226" watchObservedRunningTime="2026-07-14 22:58:29.679885362 +0000 UTC m=+64.112130338" Jul 14 22:58:31.964928 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:31.964889 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:58:31.967313 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:31.967292 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 22:58:31.978421 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:31.978391 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73558940-4ec3-47d2-a883-c0d5d6341f31-metrics-certs\") pod \"network-metrics-daemon-p8fj7\" (UID: \"73558940-4ec3-47d2-a883-c0d5d6341f31\") " pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:58:31.985270 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:31.985244 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d24rt\"" Jul 14 22:58:31.994069 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:31.994045 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8fj7" Jul 14 22:58:32.065498 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:32.065457 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:58:32.065672 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:32.065579 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vhk\" (UniqueName: \"kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk\") pod \"network-check-target-q5g45\" (UID: \"236456e0-bf2f-4312-bf4d-97956e97c7ad\") " pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:58:32.067967 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:32.067943 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 22:58:32.068071 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:32.067953 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 22:58:32.078569 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:32.078548 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 22:58:32.079186 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:32.079166 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/917de4b2-08fe-4ab6-ba15-69da63fa81cc-original-pull-secret\") pod \"global-pull-secret-syncer-7tk8s\" (UID: \"917de4b2-08fe-4ab6-ba15-69da63fa81cc\") " pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:58:32.089852 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:32.089832 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6vhk\" (UniqueName: \"kubernetes.io/projected/236456e0-bf2f-4312-bf4d-97956e97c7ad-kube-api-access-b6vhk\") pod \"network-check-target-q5g45\" (UID: \"236456e0-bf2f-4312-bf4d-97956e97c7ad\") " pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:58:32.294116 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:32.294036 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wx244\"" Jul 14 22:58:32.300776 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:32.300745 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7tk8s" Jul 14 22:58:32.302864 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:32.302843 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:58:32.955488 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:32.955464 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7tk8s"] Jul 14 22:58:32.958728 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:32.958700 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917de4b2_08fe_4ab6_ba15_69da63fa81cc.slice/crio-f63bb6e0013a4178c483ee4e8b6310196980f54588c9a334f95ab288573b26c5 WatchSource:0}: Error finding container f63bb6e0013a4178c483ee4e8b6310196980f54588c9a334f95ab288573b26c5: Status 404 returned error can't find the container with id f63bb6e0013a4178c483ee4e8b6310196980f54588c9a334f95ab288573b26c5 Jul 14 22:58:33.189960 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:33.189916 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73558940_4ec3_47d2_a883_c0d5d6341f31.slice/crio-09db26a986588fc5656c83450a61838b36c5a08804c69f01468b72a99ca51a6a WatchSource:0}: Error finding container 09db26a986588fc5656c83450a61838b36c5a08804c69f01468b72a99ca51a6a: Status 404 returned error can't find the container with id 09db26a986588fc5656c83450a61838b36c5a08804c69f01468b72a99ca51a6a Jul 14 22:58:33.191787 ip-10-0-136-11 kubenswrapper[2568]: W0714 22:58:33.191763 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236456e0_bf2f_4312_bf4d_97956e97c7ad.slice/crio-9d9e2aa8aa599a9e20d3277c5c384d4f38dd648909d77224e1c162adf70849e8 WatchSource:0}: Error finding container 9d9e2aa8aa599a9e20d3277c5c384d4f38dd648909d77224e1c162adf70849e8: Status 404 returned error can't find the container with id 9d9e2aa8aa599a9e20d3277c5c384d4f38dd648909d77224e1c162adf70849e8 Jul 14 22:58:33.194515 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.194383 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q5g45"] Jul 14 22:58:33.196085 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.196062 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8fj7"] Jul 14 22:58:33.618406 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.618283 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8fj7" event={"ID":"73558940-4ec3-47d2-a883-c0d5d6341f31","Type":"ContainerStarted","Data":"09db26a986588fc5656c83450a61838b36c5a08804c69f01468b72a99ca51a6a"} Jul 14 22:58:33.619759 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.619735 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q5g45" event={"ID":"236456e0-bf2f-4312-bf4d-97956e97c7ad","Type":"ContainerStarted","Data":"9d9e2aa8aa599a9e20d3277c5c384d4f38dd648909d77224e1c162adf70849e8"} Jul 14 22:58:33.621007 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.620985 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7tk8s" event={"ID":"917de4b2-08fe-4ab6-ba15-69da63fa81cc","Type":"ContainerStarted","Data":"f63bb6e0013a4178c483ee4e8b6310196980f54588c9a334f95ab288573b26c5"} Jul 14 22:58:33.624270 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.624245 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9160e848-b452-451c-a124-04966eda11ea","Type":"ContainerStarted","Data":"37e77689331138d386b7e5daa107c415cc09bcb890d6a3ed3963ec626de81ee0"} Jul 14 22:58:33.624385 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.624317 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9160e848-b452-451c-a124-04966eda11ea","Type":"ContainerStarted","Data":"560a567d4ff6b71ec69770c72ad1d5b5e8db61bbc11862b393de2cc7fe9425c3"} Jul 14 22:58:33.624385 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.624375 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9160e848-b452-451c-a124-04966eda11ea","Type":"ContainerStarted","Data":"7b927531401da6397d58d099bdfe78cc54189fab7b8f3bbe4dc4a9ea6590d818"} Jul 14 22:58:33.624492 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.624413 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9160e848-b452-451c-a124-04966eda11ea","Type":"ContainerStarted","Data":"6c83fc45d5452ba110b1feede2b5c161c1fca7564738feb3bdb5fc77fea1d784"} Jul 14 22:58:33.624492 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.624446 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9160e848-b452-451c-a124-04966eda11ea","Type":"ContainerStarted","Data":"1dd682210ae0726e8dce5cc37bcbe27db7c9598a2054e231581202103b417173"} Jul 14 22:58:33.624492 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.624474 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9160e848-b452-451c-a124-04966eda11ea","Type":"ContainerStarted","Data":"6c52c83d21c9ad8d1e4c76d329c1927489aab6f413004b6b4c27e133342ee583"} Jul 14 22:58:33.662028 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:33.661970 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.370421379 podStartE2EDuration="6.661950918s" totalImagesPullingTime="3.26828517s" totalInitContainerRuntime="23.244369ms" isStatefulPod=false podCreationTimestamp="2026-07-14 22:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:33.659351817 +0000 UTC m=+68.091596789" watchObservedRunningTime="2026-07-14 22:58:33.661950918 +0000 UTC m=+68.094195893" Jul 14 22:58:34.634208 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:34.633600 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8fj7" event={"ID":"73558940-4ec3-47d2-a883-c0d5d6341f31","Type":"ContainerStarted","Data":"2b8a67649108922d8e982d6569161885ffab6df7366753480c42c992c3d25a06"} Jul 14 22:58:34.634208 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:34.633657 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8fj7" event={"ID":"73558940-4ec3-47d2-a883-c0d5d6341f31","Type":"ContainerStarted","Data":"c98f00f44f0f1b557cc79db638e276e574c9bb6ce032c8c07b06dcc6e7bb8a04"} Jul 14 22:58:34.649905 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:34.649785 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p8fj7" podStartSLOduration=67.442621003 podStartE2EDuration="1m8.649764485s" totalImagesPullingTime="1.207143482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:34.649219417 +0000 UTC m=+69.081464428" watchObservedRunningTime="2026-07-14 22:58:34.649764485 +0000 UTC m=+69.082009460" Jul 14 22:58:35.609810 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:35.609778 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5dbf874d4c-8qhr8" Jul 14 22:58:37.693122 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:37.693082 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:58:38.655878 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:38.655837 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q5g45" event={"ID":"236456e0-bf2f-4312-bf4d-97956e97c7ad","Type":"ContainerStarted","Data":"38741f7682ca3b12627cef1c5ce5af7fd3ed9d9b08a6a54471fabfa422257610"} Jul 14 22:58:38.656060 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:38.655935 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:58:38.657327 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:38.657299 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7tk8s" event={"ID":"917de4b2-08fe-4ab6-ba15-69da63fa81cc","Type":"ContainerStarted","Data":"805870d17a818790c5173f1652fc645240657534489e851e43f1525103963c4c"} Jul 14 22:58:38.672914 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:38.672870 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q5g45" podStartSLOduration=67.922459253 podStartE2EDuration="1m12.672852657s" totalImagesPullingTime="4.750393404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:38.671841981 +0000 UTC m=+73.104086954" watchObservedRunningTime="2026-07-14 22:58:38.672852657 +0000 UTC m=+73.105097631" Jul 14 22:58:38.688031 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:38.687987 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7tk8s" podStartSLOduration=67.699723627 podStartE2EDuration="1m12.687973603s" totalImagesPullingTime="4.988249976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:38.6865372 +0000 UTC m=+73.118782185" watchObservedRunningTime="2026-07-14 22:58:38.687973603 +0000 UTC m=+73.120218623" Jul 14 22:58:45.750940 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:45.750900 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:45.751533 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:45.750979 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:58:51.743824 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:51.743683 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59cf5d8777-4pwzq" podUID="671a3b07-739e-4e17-91a3-b00aefcade4c" containerName="console" containerID="cri-o://0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af" gracePeriod=15 Jul 14 22:58:51.985296 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:51.985272 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:52.032504 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.032423 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-serving-cert\") pod \"671a3b07-739e-4e17-91a3-b00aefcade4c\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " Jul 14 22:58:52.032504 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.032465 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-console-config\") pod \"671a3b07-739e-4e17-91a3-b00aefcade4c\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " Jul 14 22:58:52.032504 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.032492 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdwmv\" (UniqueName: \"kubernetes.io/projected/671a3b07-739e-4e17-91a3-b00aefcade4c-kube-api-access-cdwmv\") pod \"671a3b07-739e-4e17-91a3-b00aefcade4c\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " Jul 14 22:58:52.032762 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.032521 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-service-ca\") pod \"671a3b07-739e-4e17-91a3-b00aefcade4c\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " Jul 14 22:58:52.032762 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.032572 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-oauth-config\") pod \"671a3b07-739e-4e17-91a3-b00aefcade4c\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " Jul 14 22:58:52.032762 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.032632 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-oauth-serving-cert\") pod \"671a3b07-739e-4e17-91a3-b00aefcade4c\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " Jul 14 22:58:52.032762 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.032656 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-trusted-ca-bundle\") pod \"671a3b07-739e-4e17-91a3-b00aefcade4c\" (UID: \"671a3b07-739e-4e17-91a3-b00aefcade4c\") " Jul 14 22:58:52.033214 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.033087 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "671a3b07-739e-4e17-91a3-b00aefcade4c" (UID: "671a3b07-739e-4e17-91a3-b00aefcade4c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 22:58:52.033324 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.033130 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-console-config" (OuterVolumeSpecName: "console-config") pod "671a3b07-739e-4e17-91a3-b00aefcade4c" (UID: "671a3b07-739e-4e17-91a3-b00aefcade4c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 22:58:52.033428 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.033376 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-service-ca" (OuterVolumeSpecName: "service-ca") pod "671a3b07-739e-4e17-91a3-b00aefcade4c" (UID: "671a3b07-739e-4e17-91a3-b00aefcade4c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 22:58:52.033486 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.033462 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "671a3b07-739e-4e17-91a3-b00aefcade4c" (UID: "671a3b07-739e-4e17-91a3-b00aefcade4c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 22:58:52.034939 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.034914 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/671a3b07-739e-4e17-91a3-b00aefcade4c-kube-api-access-cdwmv" (OuterVolumeSpecName: "kube-api-access-cdwmv") pod "671a3b07-739e-4e17-91a3-b00aefcade4c" (UID: "671a3b07-739e-4e17-91a3-b00aefcade4c"). InnerVolumeSpecName "kube-api-access-cdwmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:58:52.034939 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.034930 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "671a3b07-739e-4e17-91a3-b00aefcade4c" (UID: "671a3b07-739e-4e17-91a3-b00aefcade4c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 22:58:52.035097 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.035067 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "671a3b07-739e-4e17-91a3-b00aefcade4c" (UID: "671a3b07-739e-4e17-91a3-b00aefcade4c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 22:58:52.133614 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.133576 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-serving-cert\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 22:58:52.133614 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.133609 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-console-config\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 22:58:52.133614 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.133618 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdwmv\" (UniqueName: \"kubernetes.io/projected/671a3b07-739e-4e17-91a3-b00aefcade4c-kube-api-access-cdwmv\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 22:58:52.133835 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.133627 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-service-ca\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 22:58:52.133835 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.133636 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/671a3b07-739e-4e17-91a3-b00aefcade4c-console-oauth-config\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 22:58:52.133835 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.133644 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-oauth-serving-cert\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 22:58:52.133835 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.133653 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/671a3b07-739e-4e17-91a3-b00aefcade4c-trusted-ca-bundle\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 22:58:52.715208 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.715164 2568 generic.go:356] "Generic (PLEG): container finished" podID="671a3b07-739e-4e17-91a3-b00aefcade4c" containerID="0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af" exitCode=0 Jul 14 22:58:52.715428 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.715217 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5d8777-4pwzq" Jul 14 22:58:52.715428 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.715257 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5d8777-4pwzq" event={"ID":"671a3b07-739e-4e17-91a3-b00aefcade4c","Type":"ContainerDied","Data":"0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af"} Jul 14 22:58:52.715428 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.715317 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5d8777-4pwzq" event={"ID":"671a3b07-739e-4e17-91a3-b00aefcade4c","Type":"ContainerDied","Data":"2b22ad007f5c8dc3ffc1447f045a6eb10828c67cc3568944a008285a9966f58c"} Jul 14 22:58:52.715428 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.715367 2568 scope.go:117] "RemoveContainer" containerID="0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af" Jul 14 22:58:52.723877 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.723858 2568 scope.go:117] "RemoveContainer" containerID="0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af" Jul 14 22:58:52.724164 ip-10-0-136-11 kubenswrapper[2568]: E0714 22:58:52.724136 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af\": container with ID starting with 0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af not found: ID does not exist" containerID="0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af" Jul 14 22:58:52.724234 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.724177 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af"} err="failed to get container status \"0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af\": rpc error: code = NotFound desc = could not find container \"0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af\": container with ID starting with 0704254a2bcc6ba44bb4fe62d169f74c2ea5d0c60692289ed28e3696dfe466af not found: ID does not exist" Jul 14 22:58:52.731720 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.731699 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cf5d8777-4pwzq"] Jul 14 22:58:52.735444 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:52.735423 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59cf5d8777-4pwzq"] Jul 14 22:58:54.168397 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:58:54.168357 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="671a3b07-739e-4e17-91a3-b00aefcade4c" path="/var/lib/kubelet/pods/671a3b07-739e-4e17-91a3-b00aefcade4c/volumes" Jul 14 22:59:05.755838 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:59:05.755805 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:59:05.764710 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:59:05.759976 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-857b87c496-bqx4r" Jul 14 22:59:09.664905 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:59:09.664869 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q5g45" Jul 14 22:59:27.693656 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:59:27.693617 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:59:27.713269 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:59:27.713240 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 22:59:27.877978 ip-10-0-136-11 kubenswrapper[2568]: I0714 22:59:27.877952 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 23:01:13.859197 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:13.859162 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct"] Jul 14 23:01:13.859646 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:13.859499 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="671a3b07-739e-4e17-91a3-b00aefcade4c" containerName="console" Jul 14 23:01:13.859646 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:13.859510 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="671a3b07-739e-4e17-91a3-b00aefcade4c" containerName="console" Jul 14 23:01:13.859646 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:13.859566 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="671a3b07-739e-4e17-91a3-b00aefcade4c" containerName="console" Jul 14 23:01:13.862578 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:13.862557 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct" Jul 14 23:01:13.864878 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:13.864855 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 23:01:13.865386 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:13.865367 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-knw7l\"" Jul 14 23:01:13.865483 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:13.865372 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 23:01:13.871864 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:13.871840 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct"] Jul 14 23:01:13.943831 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:13.943789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fss8r\" (UniqueName: \"kubernetes.io/projected/c58d724c-afed-417c-8e9f-7916a2325071-kube-api-access-fss8r\") pod \"cert-manager-cainjector-559cdd8c87-2h9ct\" (UID: \"c58d724c-afed-417c-8e9f-7916a2325071\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct" Jul 14 23:01:13.944017 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:13.943925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c58d724c-afed-417c-8e9f-7916a2325071-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2h9ct\" (UID: \"c58d724c-afed-417c-8e9f-7916a2325071\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct" Jul 14 23:01:14.044316 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:14.044281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c58d724c-afed-417c-8e9f-7916a2325071-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2h9ct\" (UID: \"c58d724c-afed-417c-8e9f-7916a2325071\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct" Jul 14 23:01:14.044505 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:14.044331 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fss8r\" (UniqueName: \"kubernetes.io/projected/c58d724c-afed-417c-8e9f-7916a2325071-kube-api-access-fss8r\") pod \"cert-manager-cainjector-559cdd8c87-2h9ct\" (UID: \"c58d724c-afed-417c-8e9f-7916a2325071\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct" Jul 14 23:01:14.052462 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:14.052428 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c58d724c-afed-417c-8e9f-7916a2325071-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2h9ct\" (UID: \"c58d724c-afed-417c-8e9f-7916a2325071\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct" Jul 14 23:01:14.052582 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:14.052563 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fss8r\" (UniqueName: \"kubernetes.io/projected/c58d724c-afed-417c-8e9f-7916a2325071-kube-api-access-fss8r\") pod \"cert-manager-cainjector-559cdd8c87-2h9ct\" (UID: \"c58d724c-afed-417c-8e9f-7916a2325071\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct" Jul 14 23:01:14.190219 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:14.190181 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct" Jul 14 23:01:14.321831 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:14.321802 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct"] Jul 14 23:01:14.324282 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:01:14.324251 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc58d724c_afed_417c_8e9f_7916a2325071.slice/crio-853125db3b3a219cc7772965580e4470be38bf622b5a127f4ce38c31b6a6dc4e WatchSource:0}: Error finding container 853125db3b3a219cc7772965580e4470be38bf622b5a127f4ce38c31b6a6dc4e: Status 404 returned error can't find the container with id 853125db3b3a219cc7772965580e4470be38bf622b5a127f4ce38c31b6a6dc4e Jul 14 23:01:15.294750 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:15.294713 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct" event={"ID":"c58d724c-afed-417c-8e9f-7916a2325071","Type":"ContainerStarted","Data":"853125db3b3a219cc7772965580e4470be38bf622b5a127f4ce38c31b6a6dc4e"} Jul 14 23:01:19.315715 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:19.315671 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct" event={"ID":"c58d724c-afed-417c-8e9f-7916a2325071","Type":"ContainerStarted","Data":"26f24124526fccdcbc5a66498ea458bbb2130a48d6ce22ee60bdd35a9f9f204b"} Jul 14 23:01:19.344694 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:19.344636 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2h9ct" podStartSLOduration=2.262811393 podStartE2EDuration="6.34461682s" totalImagesPullingTime="4.081805427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:01:19.343644609 +0000 UTC m=+233.775889585" watchObservedRunningTime="2026-07-14 23:01:19.34461682 +0000 UTC m=+233.776861795" Jul 14 23:01:20.154671 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.154631 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt"] Jul 14 23:01:20.158150 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.158127 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt" Jul 14 23:01:20.161231 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.161212 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 23:01:20.161383 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.161364 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 23:01:20.163649 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.163625 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xrqqz\"" Jul 14 23:01:20.175348 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.175308 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt"] Jul 14 23:01:20.197557 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.197522 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxbjq\" (UniqueName: \"kubernetes.io/projected/32710897-bc42-424a-97ca-76d9801f867c-kube-api-access-rxbjq\") pod \"openshift-lws-operator-fd8ccff4c-n87xt\" (UID: \"32710897-bc42-424a-97ca-76d9801f867c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt" Jul 14 23:01:20.197744 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.197586 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32710897-bc42-424a-97ca-76d9801f867c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-n87xt\" (UID: \"32710897-bc42-424a-97ca-76d9801f867c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt" Jul 14 23:01:20.298899 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.298857 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxbjq\" (UniqueName: \"kubernetes.io/projected/32710897-bc42-424a-97ca-76d9801f867c-kube-api-access-rxbjq\") pod \"openshift-lws-operator-fd8ccff4c-n87xt\" (UID: \"32710897-bc42-424a-97ca-76d9801f867c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt" Jul 14 23:01:20.299113 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.298933 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32710897-bc42-424a-97ca-76d9801f867c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-n87xt\" (UID: \"32710897-bc42-424a-97ca-76d9801f867c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt" Jul 14 23:01:20.299297 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.299279 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32710897-bc42-424a-97ca-76d9801f867c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-n87xt\" (UID: \"32710897-bc42-424a-97ca-76d9801f867c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt" Jul 14 23:01:20.309251 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.309223 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxbjq\" (UniqueName: \"kubernetes.io/projected/32710897-bc42-424a-97ca-76d9801f867c-kube-api-access-rxbjq\") pod \"openshift-lws-operator-fd8ccff4c-n87xt\" (UID: \"32710897-bc42-424a-97ca-76d9801f867c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt" Jul 14 23:01:20.467325 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.467231 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt" Jul 14 23:01:20.602938 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:20.602905 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt"] Jul 14 23:01:20.608762 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:01:20.608732 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32710897_bc42_424a_97ca_76d9801f867c.slice/crio-ce344d7f16567587e1127c8b0a69f6e9af2003be00902e6a024966713c717564 WatchSource:0}: Error finding container ce344d7f16567587e1127c8b0a69f6e9af2003be00902e6a024966713c717564: Status 404 returned error can't find the container with id ce344d7f16567587e1127c8b0a69f6e9af2003be00902e6a024966713c717564 Jul 14 23:01:21.326496 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:21.326456 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt" event={"ID":"32710897-bc42-424a-97ca-76d9801f867c","Type":"ContainerStarted","Data":"ce344d7f16567587e1127c8b0a69f6e9af2003be00902e6a024966713c717564"} Jul 14 23:01:23.335994 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:23.335891 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt" event={"ID":"32710897-bc42-424a-97ca-76d9801f867c","Type":"ContainerStarted","Data":"4346d3802da8c44ca459a145face50135818820565591fe7925df7b435328c30"} Jul 14 23:01:23.358163 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:23.358108 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n87xt" podStartSLOduration=1.094519431 podStartE2EDuration="3.358089003s" totalImagesPullingTime="2.263569572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:01:23.356672061 +0000 UTC m=+237.788917037" watchObservedRunningTime="2026-07-14 23:01:23.358089003 +0000 UTC m=+237.790333977" Jul 14 23:01:44.291136 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.291102 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4"] Jul 14 23:01:44.294813 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.294791 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.299404 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.299383 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 23:01:44.299542 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.299424 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 23:01:44.299721 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.299706 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 23:01:44.299833 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.299720 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 23:01:44.299903 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.299855 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j4t6n\"" Jul 14 23:01:44.322409 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.322373 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4"] Jul 14 23:01:44.408442 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.408408 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78b1674a-115b-4215-b6e1-9e6a731df465-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.408644 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.408454 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zlt9\" (UniqueName: \"kubernetes.io/projected/78b1674a-115b-4215-b6e1-9e6a731df465-kube-api-access-9zlt9\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.408644 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.408491 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78b1674a-115b-4215-b6e1-9e6a731df465-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.408644 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.408530 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78b1674a-115b-4215-b6e1-9e6a731df465-manifests\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.408644 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.408559 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78b1674a-115b-4215-b6e1-9e6a731df465-tmp\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.509308 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.509272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78b1674a-115b-4215-b6e1-9e6a731df465-manifests\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.509308 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.509314 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78b1674a-115b-4215-b6e1-9e6a731df465-tmp\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.509534 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.509394 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78b1674a-115b-4215-b6e1-9e6a731df465-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.509534 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.509419 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zlt9\" (UniqueName: \"kubernetes.io/projected/78b1674a-115b-4215-b6e1-9e6a731df465-kube-api-access-9zlt9\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.509534 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.509447 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78b1674a-115b-4215-b6e1-9e6a731df465-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.509767 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.509745 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78b1674a-115b-4215-b6e1-9e6a731df465-manifests\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.511652 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.511620 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78b1674a-115b-4215-b6e1-9e6a731df465-tmp\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.511875 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.511858 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78b1674a-115b-4215-b6e1-9e6a731df465-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.511926 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.511890 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78b1674a-115b-4215-b6e1-9e6a731df465-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.517265 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.517238 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zlt9\" (UniqueName: \"kubernetes.io/projected/78b1674a-115b-4215-b6e1-9e6a731df465-kube-api-access-9zlt9\") pod \"opendatahub-operator-controller-manager-7d756c8cff-dxhl4\" (UID: \"78b1674a-115b-4215-b6e1-9e6a731df465\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.605109 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.605025 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:44.746763 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:44.746727 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4"] Jul 14 23:01:44.750821 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:01:44.750791 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b1674a_115b_4215_b6e1_9e6a731df465.slice/crio-d846690c02dca1060e3242cd20a29ea3537e5aef76db2d4530e2ba21066cc1d0 WatchSource:0}: Error finding container d846690c02dca1060e3242cd20a29ea3537e5aef76db2d4530e2ba21066cc1d0: Status 404 returned error can't find the container with id d846690c02dca1060e3242cd20a29ea3537e5aef76db2d4530e2ba21066cc1d0 Jul 14 23:01:45.429291 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:45.429242 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" event={"ID":"78b1674a-115b-4215-b6e1-9e6a731df465","Type":"ContainerStarted","Data":"d846690c02dca1060e3242cd20a29ea3537e5aef76db2d4530e2ba21066cc1d0"} Jul 14 23:01:48.445460 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:48.445418 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" event={"ID":"78b1674a-115b-4215-b6e1-9e6a731df465","Type":"ContainerStarted","Data":"d8498888c21df574f8c56559b8d9727669633e6d9762673b1e69baa736be81a1"} Jul 14 23:01:49.450854 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:49.450816 2568 generic.go:356] "Generic (PLEG): container finished" podID="78b1674a-115b-4215-b6e1-9e6a731df465" containerID="d8498888c21df574f8c56559b8d9727669633e6d9762673b1e69baa736be81a1" exitCode=0 Jul 14 23:01:49.451272 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:49.450908 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" event={"ID":"78b1674a-115b-4215-b6e1-9e6a731df465","Type":"ContainerDied","Data":"d8498888c21df574f8c56559b8d9727669633e6d9762673b1e69baa736be81a1"} Jul 14 23:01:50.457704 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:50.457664 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" event={"ID":"78b1674a-115b-4215-b6e1-9e6a731df465","Type":"ContainerStarted","Data":"1f914d9ef39a2f7f0ee05d3df92cd85ab2707c32c492600b0372eaed4e2aaa41"} Jul 14 23:01:50.458208 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:50.457760 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:01:50.488757 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:01:50.488703 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" podStartSLOduration=2.046030635 podStartE2EDuration="6.488683075s" totalImagesPullingTime="3.412701589s" totalInitContainerRuntime="1.029950851s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:01:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:01:50.487072899 +0000 UTC m=+264.919317875" watchObservedRunningTime="2026-07-14 23:01:50.488683075 +0000 UTC m=+264.920928049" Jul 14 23:02:01.464811 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:01.464772 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-dxhl4" Jul 14 23:02:12.928143 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.928101 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr"] Jul 14 23:02:12.939145 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.939115 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:12.943665 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.943622 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:12.943665 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.943665 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:12.943874 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.943690 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:12.943874 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.943761 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 23:02:12.943874 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.943766 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkwnl\" (UniqueName: \"kubernetes.io/projected/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-kube-api-access-kkwnl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:12.943874 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.943814 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:12.944098 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.943879 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:12.944098 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.943929 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:12.944098 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.943952 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:12.944098 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.943977 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:12.944284 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.944119 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 23:02:12.944370 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.944300 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gwbwz\"" Jul 14 23:02:12.944483 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.944464 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 23:02:12.952410 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:12.952378 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr"] Jul 14 23:02:13.045060 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.044540 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.045060 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.044610 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.045060 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.044649 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.045060 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.044677 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.045060 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.044708 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.045060 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.044786 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.045060 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.044814 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.045060 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.044839 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.045060 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.044869 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkwnl\" (UniqueName: \"kubernetes.io/projected/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-kube-api-access-kkwnl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.045701 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.045522 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.045701 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.045625 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.045869 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.045842 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.046055 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.045951 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.046176 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.046154 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.047863 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.047843 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.048464 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.048443 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.056605 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.056583 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.056802 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.056772 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkwnl\" (UniqueName: \"kubernetes.io/projected/7f1a043c-4f8c-4811-8ebe-79e34cd0721a-kube-api-access-kkwnl\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dhkfr\" (UID: \"7f1a043c-4f8c-4811-8ebe-79e34cd0721a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.253220 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.253124 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:13.429700 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.429140 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr"] Jul 14 23:02:13.432034 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:02:13.432003 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1a043c_4f8c_4811_8ebe_79e34cd0721a.slice/crio-a22b5af74c7ec123a944a609304612bd5641f1bbb63cc5b7324fa976ae10458e WatchSource:0}: Error finding container a22b5af74c7ec123a944a609304612bd5641f1bbb63cc5b7324fa976ae10458e: Status 404 returned error can't find the container with id a22b5af74c7ec123a944a609304612bd5641f1bbb63cc5b7324fa976ae10458e Jul 14 23:02:13.556853 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.556768 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" event={"ID":"7f1a043c-4f8c-4811-8ebe-79e34cd0721a","Type":"ContainerStarted","Data":"a22b5af74c7ec123a944a609304612bd5641f1bbb63cc5b7324fa976ae10458e"} Jul 14 23:02:13.842315 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.842235 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86f675f86-scz9n"] Jul 14 23:02:13.846895 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.846867 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.849019 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.848994 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 23:02:13.849266 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.849247 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 23:02:13.849384 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.849259 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fkkfj\"" Jul 14 23:02:13.849620 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.849603 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 23:02:13.851018 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.851001 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbp6r\" (UniqueName: \"kubernetes.io/projected/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-kube-api-access-dbp6r\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.851081 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.851026 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-metrics-cert\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.851117 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.851081 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-manager-config\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.851157 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.851146 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-cert\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.855011 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.854992 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86f675f86-scz9n"] Jul 14 23:02:13.951730 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.951691 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-manager-config\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.952198 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.951770 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-cert\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.952198 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.951825 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbp6r\" (UniqueName: \"kubernetes.io/projected/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-kube-api-access-dbp6r\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.952198 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.951858 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-metrics-cert\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.952322 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.952300 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-manager-config\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.954206 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.954182 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-cert\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.954302 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.954259 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-metrics-cert\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:13.961074 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:13.961052 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbp6r\" (UniqueName: \"kubernetes.io/projected/5fe690c4-ea19-43f5-8d36-6cf9c37aad2a-kube-api-access-dbp6r\") pod \"lws-controller-manager-86f675f86-scz9n\" (UID: \"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a\") " pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:14.157788 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:14.157751 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:14.300786 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:14.300749 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86f675f86-scz9n"] Jul 14 23:02:14.302578 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:02:14.302541 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe690c4_ea19_43f5_8d36_6cf9c37aad2a.slice/crio-0f2d5296d90a5e40be61933cf3595f437244f9073cb105edbce78012cb04d8e3 WatchSource:0}: Error finding container 0f2d5296d90a5e40be61933cf3595f437244f9073cb105edbce78012cb04d8e3: Status 404 returned error can't find the container with id 0f2d5296d90a5e40be61933cf3595f437244f9073cb105edbce78012cb04d8e3 Jul 14 23:02:14.563318 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:14.563232 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" event={"ID":"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a","Type":"ContainerStarted","Data":"0f2d5296d90a5e40be61933cf3595f437244f9073cb105edbce78012cb04d8e3"} Jul 14 23:02:15.326983 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.326801 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-shwnx"] Jul 14 23:02:15.330669 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.330641 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" Jul 14 23:02:15.339123 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.339096 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 14 23:02:15.339750 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.339720 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jbrvg\"" Jul 14 23:02:15.345957 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.345600 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4"] Jul 14 23:02:15.349492 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.349469 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" Jul 14 23:02:15.356630 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.356600 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 14 23:02:15.359099 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.358790 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fl6mx\"" Jul 14 23:02:15.359642 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.359590 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-shwnx"] Jul 14 23:02:15.363547 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.363484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlhsm\" (UniqueName: \"kubernetes.io/projected/a7f13493-226f-4448-8f80-7dba1f6cccfc-kube-api-access-nlhsm\") pod \"llmisvc-controller-manager-777c6bd7d5-f5gc4\" (UID: \"a7f13493-226f-4448-8f80-7dba1f6cccfc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" Jul 14 23:02:15.363656 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.363595 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99qwd\" (UniqueName: \"kubernetes.io/projected/3313f414-8d4a-45e0-94f6-918f58296f9e-kube-api-access-99qwd\") pod \"kserve-controller-manager-d6f4b65b8-shwnx\" (UID: \"3313f414-8d4a-45e0-94f6-918f58296f9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" Jul 14 23:02:15.363656 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.363628 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7f13493-226f-4448-8f80-7dba1f6cccfc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f5gc4\" (UID: \"a7f13493-226f-4448-8f80-7dba1f6cccfc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" Jul 14 23:02:15.363656 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.363653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3313f414-8d4a-45e0-94f6-918f58296f9e-cert\") pod \"kserve-controller-manager-d6f4b65b8-shwnx\" (UID: \"3313f414-8d4a-45e0-94f6-918f58296f9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" Jul 14 23:02:15.394677 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.394643 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4"] Jul 14 23:02:15.464216 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.464176 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7f13493-226f-4448-8f80-7dba1f6cccfc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f5gc4\" (UID: \"a7f13493-226f-4448-8f80-7dba1f6cccfc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" Jul 14 23:02:15.464416 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.464228 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3313f414-8d4a-45e0-94f6-918f58296f9e-cert\") pod \"kserve-controller-manager-d6f4b65b8-shwnx\" (UID: \"3313f414-8d4a-45e0-94f6-918f58296f9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" Jul 14 23:02:15.464416 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.464303 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlhsm\" (UniqueName: \"kubernetes.io/projected/a7f13493-226f-4448-8f80-7dba1f6cccfc-kube-api-access-nlhsm\") pod \"llmisvc-controller-manager-777c6bd7d5-f5gc4\" (UID: \"a7f13493-226f-4448-8f80-7dba1f6cccfc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" Jul 14 23:02:15.464539 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.464432 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99qwd\" (UniqueName: \"kubernetes.io/projected/3313f414-8d4a-45e0-94f6-918f58296f9e-kube-api-access-99qwd\") pod \"kserve-controller-manager-d6f4b65b8-shwnx\" (UID: \"3313f414-8d4a-45e0-94f6-918f58296f9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" Jul 14 23:02:15.464601 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:02:15.464547 2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 14 23:02:15.464652 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:02:15.464624 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3313f414-8d4a-45e0-94f6-918f58296f9e-cert podName:3313f414-8d4a-45e0-94f6-918f58296f9e nodeName:}" failed. No retries permitted until 2026-07-14 23:02:15.964602751 +0000 UTC m=+290.396847705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3313f414-8d4a-45e0-94f6-918f58296f9e-cert") pod "kserve-controller-manager-d6f4b65b8-shwnx" (UID: "3313f414-8d4a-45e0-94f6-918f58296f9e") : secret "kserve-webhook-server-cert" not found Jul 14 23:02:15.468723 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.468694 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7f13493-226f-4448-8f80-7dba1f6cccfc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f5gc4\" (UID: \"a7f13493-226f-4448-8f80-7dba1f6cccfc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" Jul 14 23:02:15.483105 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.483073 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlhsm\" (UniqueName: \"kubernetes.io/projected/a7f13493-226f-4448-8f80-7dba1f6cccfc-kube-api-access-nlhsm\") pod \"llmisvc-controller-manager-777c6bd7d5-f5gc4\" (UID: \"a7f13493-226f-4448-8f80-7dba1f6cccfc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" Jul 14 23:02:15.483796 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.483763 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99qwd\" (UniqueName: \"kubernetes.io/projected/3313f414-8d4a-45e0-94f6-918f58296f9e-kube-api-access-99qwd\") pod \"kserve-controller-manager-d6f4b65b8-shwnx\" (UID: \"3313f414-8d4a-45e0-94f6-918f58296f9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" Jul 14 23:02:15.663714 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.663673 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" Jul 14 23:02:15.968700 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.968605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3313f414-8d4a-45e0-94f6-918f58296f9e-cert\") pod \"kserve-controller-manager-d6f4b65b8-shwnx\" (UID: \"3313f414-8d4a-45e0-94f6-918f58296f9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" Jul 14 23:02:15.971538 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:15.971506 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3313f414-8d4a-45e0-94f6-918f58296f9e-cert\") pod \"kserve-controller-manager-d6f4b65b8-shwnx\" (UID: \"3313f414-8d4a-45e0-94f6-918f58296f9e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" Jul 14 23:02:16.245799 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:16.245714 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" Jul 14 23:02:16.990646 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:16.990606 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:02:16.991035 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:16.990696 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:02:16.991035 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:16.990742 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:02:17.144765 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:17.144719 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4"] Jul 14 23:02:17.147661 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:02:17.147627 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda7f13493_226f_4448_8f80_7dba1f6cccfc.slice/crio-218c4faaa547fe291fad1121f9f9b6dcc7abf85f35a0a7ad975d4988ab0dd39c WatchSource:0}: Error finding container 218c4faaa547fe291fad1121f9f9b6dcc7abf85f35a0a7ad975d4988ab0dd39c: Status 404 returned error can't find the container with id 218c4faaa547fe291fad1121f9f9b6dcc7abf85f35a0a7ad975d4988ab0dd39c Jul 14 23:02:17.164602 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:17.164565 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-shwnx"] Jul 14 23:02:17.167699 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:02:17.167652 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3313f414_8d4a_45e0_94f6_918f58296f9e.slice/crio-6879ba2d867de7abf50d5fa1d489867afb2202326db4544639053e23de6670ea WatchSource:0}: Error finding container 6879ba2d867de7abf50d5fa1d489867afb2202326db4544639053e23de6670ea: Status 404 returned error can't find the container with id 6879ba2d867de7abf50d5fa1d489867afb2202326db4544639053e23de6670ea Jul 14 23:02:17.579658 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:17.579623 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" event={"ID":"7f1a043c-4f8c-4811-8ebe-79e34cd0721a","Type":"ContainerStarted","Data":"ce63e508951a379d5c5cb57de27d21980fbe2f8e7b6c3efc7d877776768fa73d"} Jul 14 23:02:17.580802 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:17.580774 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" event={"ID":"3313f414-8d4a-45e0-94f6-918f58296f9e","Type":"ContainerStarted","Data":"6879ba2d867de7abf50d5fa1d489867afb2202326db4544639053e23de6670ea"} Jul 14 23:02:17.581903 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:17.581878 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" event={"ID":"a7f13493-226f-4448-8f80-7dba1f6cccfc","Type":"ContainerStarted","Data":"218c4faaa547fe291fad1121f9f9b6dcc7abf85f35a0a7ad975d4988ab0dd39c"} Jul 14 23:02:17.583311 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:17.583284 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" event={"ID":"5fe690c4-ea19-43f5-8d36-6cf9c37aad2a","Type":"ContainerStarted","Data":"46a81e47b50ae25e239d9425ed30584d59a746c81589f4995a6bb240460cec98"} Jul 14 23:02:17.583452 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:17.583438 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:17.612772 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:17.612703 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" podStartSLOduration=2.056397681 podStartE2EDuration="5.612681757s" totalImagesPullingTime="3.556284076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:02:17.61021838 +0000 UTC m=+292.042463365" watchObservedRunningTime="2026-07-14 23:02:17.612681757 +0000 UTC m=+292.044926767" Jul 14 23:02:17.635327 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:17.635245 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" podStartSLOduration=1.9580845199999999 podStartE2EDuration="4.635222102s" totalImagesPullingTime="2.677137582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:02:17.633704189 +0000 UTC m=+292.065949165" watchObservedRunningTime="2026-07-14 23:02:17.635222102 +0000 UTC m=+292.067467078" Jul 14 23:02:18.254331 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:18.254288 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:18.259748 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:18.259709 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:18.588858 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:18.588765 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:18.589730 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:18.589709 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dhkfr" Jul 14 23:02:20.604024 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:20.603996 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" event={"ID":"3313f414-8d4a-45e0-94f6-918f58296f9e","Type":"ContainerStarted","Data":"5f7d4b2adcec7d96a91d792a236427abd377f6f7ef40fd7a5da98b736d2310d4"} Jul 14 23:02:20.604442 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:20.604219 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" Jul 14 23:02:20.623420 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:20.623362 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" podStartSLOduration=2.266285009 podStartE2EDuration="5.62331632s" totalImagesPullingTime="3.357031311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:02:20.621069632 +0000 UTC m=+295.053314607" watchObservedRunningTime="2026-07-14 23:02:20.62331632 +0000 UTC m=+295.055561294" Jul 14 23:02:21.609833 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:21.609790 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" event={"ID":"a7f13493-226f-4448-8f80-7dba1f6cccfc","Type":"ContainerStarted","Data":"721c800574cddad2329912d63ad9f1230a53a66dabd14ccd77b51a41df737b65"} Jul 14 23:02:21.610275 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:21.609874 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" Jul 14 23:02:21.627315 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:21.627265 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" podStartSLOduration=3.246379768 podStartE2EDuration="6.62724855s" totalImagesPullingTime="3.380868782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:02:21.625965818 +0000 UTC m=+296.058210793" watchObservedRunningTime="2026-07-14 23:02:21.62724855 +0000 UTC m=+296.059493524" Jul 14 23:02:26.009378 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:26.009351 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 23:02:28.591713 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:28.591677 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86f675f86-scz9n" Jul 14 23:02:51.615468 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:51.615436 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-shwnx" Jul 14 23:02:52.616641 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:02:52.616607 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5gc4" Jul 14 23:03:40.400636 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.400554 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg"] Jul 14 23:03:40.403056 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.403034 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg" Jul 14 23:03:40.414255 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.414236 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 23:03:40.414512 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.414494 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lqmgp\"" Jul 14 23:03:40.415694 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.415676 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 23:03:40.416198 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.416186 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 23:03:40.427540 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.427509 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg"] Jul 14 23:03:40.552372 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.552301 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzxtp\" (UniqueName: \"kubernetes.io/projected/5fc4a10c-628e-4b86-9dc1-b03a4f1b0858-kube-api-access-xzxtp\") pod \"dns-operator-controller-manager-864dd78c4c-c9fpg\" (UID: \"5fc4a10c-628e-4b86-9dc1-b03a4f1b0858\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg" Jul 14 23:03:40.653770 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.653665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzxtp\" (UniqueName: \"kubernetes.io/projected/5fc4a10c-628e-4b86-9dc1-b03a4f1b0858-kube-api-access-xzxtp\") pod \"dns-operator-controller-manager-864dd78c4c-c9fpg\" (UID: \"5fc4a10c-628e-4b86-9dc1-b03a4f1b0858\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg" Jul 14 23:03:40.661885 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.661855 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzxtp\" (UniqueName: \"kubernetes.io/projected/5fc4a10c-628e-4b86-9dc1-b03a4f1b0858-kube-api-access-xzxtp\") pod \"dns-operator-controller-manager-864dd78c4c-c9fpg\" (UID: \"5fc4a10c-628e-4b86-9dc1-b03a4f1b0858\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg" Jul 14 23:03:40.713144 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.713112 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg" Jul 14 23:03:40.854854 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.854829 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg"] Jul 14 23:03:40.857499 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:03:40.857474 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc4a10c_628e_4b86_9dc1_b03a4f1b0858.slice/crio-0bc4ebeb52348b1296185fbd88adc16d8644b3fa6c0690423b57d44518afd319 WatchSource:0}: Error finding container 0bc4ebeb52348b1296185fbd88adc16d8644b3fa6c0690423b57d44518afd319: Status 404 returned error can't find the container with id 0bc4ebeb52348b1296185fbd88adc16d8644b3fa6c0690423b57d44518afd319 Jul 14 23:03:40.860165 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.860150 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 23:03:40.980431 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:40.980318 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg" event={"ID":"5fc4a10c-628e-4b86-9dc1-b03a4f1b0858","Type":"ContainerStarted","Data":"0bc4ebeb52348b1296185fbd88adc16d8644b3fa6c0690423b57d44518afd319"} Jul 14 23:03:43.052751 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:43.052712 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g"] Jul 14 23:03:43.056657 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:43.056618 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:03:43.064275 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:43.064218 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9xpvs\"" Jul 14 23:03:43.076069 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:43.076039 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g"] Jul 14 23:03:43.178820 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:43.178750 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkrwk\" (UniqueName: \"kubernetes.io/projected/1a8dfbf6-0218-4485-b97f-2075198d0360-kube-api-access-wkrwk\") pod \"limitador-operator-controller-manager-859d7b78bd-kpx5g\" (UID: \"1a8dfbf6-0218-4485-b97f-2075198d0360\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:03:43.279612 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:43.279573 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkrwk\" (UniqueName: \"kubernetes.io/projected/1a8dfbf6-0218-4485-b97f-2075198d0360-kube-api-access-wkrwk\") pod \"limitador-operator-controller-manager-859d7b78bd-kpx5g\" (UID: \"1a8dfbf6-0218-4485-b97f-2075198d0360\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:03:43.289575 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:43.289547 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkrwk\" (UniqueName: \"kubernetes.io/projected/1a8dfbf6-0218-4485-b97f-2075198d0360-kube-api-access-wkrwk\") pod \"limitador-operator-controller-manager-859d7b78bd-kpx5g\" (UID: \"1a8dfbf6-0218-4485-b97f-2075198d0360\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:03:43.372531 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:43.372489 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:03:43.528473 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:43.528435 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g"] Jul 14 23:03:43.531732 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:03:43.531698 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8dfbf6_0218_4485_b97f_2075198d0360.slice/crio-9da40c0e8d1916b17d0dd6a016e546c1708930fde5209e43401db371ae08e5ee WatchSource:0}: Error finding container 9da40c0e8d1916b17d0dd6a016e546c1708930fde5209e43401db371ae08e5ee: Status 404 returned error can't find the container with id 9da40c0e8d1916b17d0dd6a016e546c1708930fde5209e43401db371ae08e5ee Jul 14 23:03:44.000434 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:44.000394 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg" event={"ID":"5fc4a10c-628e-4b86-9dc1-b03a4f1b0858","Type":"ContainerStarted","Data":"cf948d2d6afca13faf1c818d25b5d14e3d5e37154f3e3409715172885ed904b7"} Jul 14 23:03:44.000635 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:44.000508 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg" Jul 14 23:03:44.001734 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:44.001708 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" event={"ID":"1a8dfbf6-0218-4485-b97f-2075198d0360","Type":"ContainerStarted","Data":"9da40c0e8d1916b17d0dd6a016e546c1708930fde5209e43401db371ae08e5ee"} Jul 14 23:03:44.024881 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:44.024818 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg" podStartSLOduration=1.752416105 podStartE2EDuration="4.024802983s" totalImagesPullingTime="2.272386878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:03:44.02340109 +0000 UTC m=+378.455646066" watchObservedRunningTime="2026-07-14 23:03:44.024802983 +0000 UTC m=+378.457047957" Jul 14 23:03:46.017580 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:46.017539 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" event={"ID":"1a8dfbf6-0218-4485-b97f-2075198d0360","Type":"ContainerStarted","Data":"1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd"} Jul 14 23:03:46.017999 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:46.017723 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:03:46.039043 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:46.038984 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" podStartSLOduration=0.722902764 podStartE2EDuration="3.03896285s" totalImagesPullingTime="2.316060086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:03:46.037105477 +0000 UTC m=+380.469350452" watchObservedRunningTime="2026-07-14 23:03:46.03896285 +0000 UTC m=+380.471207835" Jul 14 23:03:55.010449 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:55.010416 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c9fpg" Jul 14 23:03:57.026133 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:03:57.026096 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:04:05.874817 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:05.874775 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk"] Jul 14 23:04:05.878628 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:05.878602 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:05.881295 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:05.881272 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ckxkq\"" Jul 14 23:04:05.900387 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:05.900317 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk"] Jul 14 23:04:05.979541 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:05.979487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7cd1663e-b819-4e21-ba96-d539d1160020-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgxqk\" (UID: \"7cd1663e-b819-4e21-ba96-d539d1160020\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:05.979723 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:05.979555 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6mzk\" (UniqueName: \"kubernetes.io/projected/7cd1663e-b819-4e21-ba96-d539d1160020-kube-api-access-f6mzk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgxqk\" (UID: \"7cd1663e-b819-4e21-ba96-d539d1160020\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:06.080939 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.080883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7cd1663e-b819-4e21-ba96-d539d1160020-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgxqk\" (UID: \"7cd1663e-b819-4e21-ba96-d539d1160020\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:06.080939 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.080951 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6mzk\" (UniqueName: \"kubernetes.io/projected/7cd1663e-b819-4e21-ba96-d539d1160020-kube-api-access-f6mzk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgxqk\" (UID: \"7cd1663e-b819-4e21-ba96-d539d1160020\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:06.081292 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.081269 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7cd1663e-b819-4e21-ba96-d539d1160020-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgxqk\" (UID: \"7cd1663e-b819-4e21-ba96-d539d1160020\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:06.094286 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.094251 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6mzk\" (UniqueName: \"kubernetes.io/projected/7cd1663e-b819-4e21-ba96-d539d1160020-kube-api-access-f6mzk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jgxqk\" (UID: \"7cd1663e-b819-4e21-ba96-d539d1160020\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:06.188874 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.188778 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:06.330834 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.330806 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk"] Jul 14 23:04:06.333198 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:04:06.333163 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd1663e_b819_4e21_ba96_d539d1160020.slice/crio-439570e86ebee1a99a9a01745fcde585e6e6714f108bf0ddec0138dea994f1cf WatchSource:0}: Error finding container 439570e86ebee1a99a9a01745fcde585e6e6714f108bf0ddec0138dea994f1cf: Status 404 returned error can't find the container with id 439570e86ebee1a99a9a01745fcde585e6e6714f108bf0ddec0138dea994f1cf Jul 14 23:04:06.675845 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.675810 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk"] Jul 14 23:04:06.680622 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.680593 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk"] Jul 14 23:04:06.703741 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.703705 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld"] Jul 14 23:04:06.708393 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.708368 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:06.721031 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.721004 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g"] Jul 14 23:04:06.721198 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.721177 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" podUID="1a8dfbf6-0218-4485-b97f-2075198d0360" containerName="manager" containerID="cri-o://1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd" gracePeriod=2 Jul 14 23:04:06.723985 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.723956 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld"] Jul 14 23:04:06.730611 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.730580 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g"] Jul 14 23:04:06.762212 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:04:06.762164 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kpx5g\" is forbidden: User \"system:node:ip-10-0-136-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-11.ec2.internal' and this object" podUID="1a8dfbf6-0218-4485-b97f-2075198d0360" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:04:06.787591 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.787547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4jrld\" (UID: \"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:06.787765 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.787669 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf779\" (UniqueName: \"kubernetes.io/projected/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-kube-api-access-kf779\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4jrld\" (UID: \"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:06.789670 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.789642 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8"] Jul 14 23:04:06.790235 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.790216 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8dfbf6-0218-4485-b97f-2075198d0360" containerName="manager" Jul 14 23:04:06.790274 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.790242 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8dfbf6-0218-4485-b97f-2075198d0360" containerName="manager" Jul 14 23:04:06.790385 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.790373 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a8dfbf6-0218-4485-b97f-2075198d0360" containerName="manager" Jul 14 23:04:06.793849 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.793830 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8" Jul 14 23:04:06.796497 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:04:06.796470 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kpx5g\" is forbidden: User \"system:node:ip-10-0-136-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-11.ec2.internal' and this object" podUID="1a8dfbf6-0218-4485-b97f-2075198d0360" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:04:06.882876 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.882833 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8"] Jul 14 23:04:06.888299 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.888253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnx2k\" (UniqueName: \"kubernetes.io/projected/bea4a69f-e69d-487e-897c-c3a8ccd3d355-kube-api-access-bnx2k\") pod \"limitador-operator-controller-manager-859d7b78bd-g2fs8\" (UID: \"bea4a69f-e69d-487e-897c-c3a8ccd3d355\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8" Jul 14 23:04:06.888523 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.888329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4jrld\" (UID: \"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:06.888523 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.888397 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf779\" (UniqueName: \"kubernetes.io/projected/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-kube-api-access-kf779\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4jrld\" (UID: \"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:06.889327 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.889301 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4jrld\" (UID: \"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:06.900862 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.900836 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf779\" (UniqueName: \"kubernetes.io/projected/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-kube-api-access-kf779\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4jrld\" (UID: \"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:06.969305 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.969271 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:04:06.971325 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:04:06.971290 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kpx5g\" is forbidden: User \"system:node:ip-10-0-136-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-11.ec2.internal' and this object" podUID="1a8dfbf6-0218-4485-b97f-2075198d0360" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:04:06.989742 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.989703 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnx2k\" (UniqueName: \"kubernetes.io/projected/bea4a69f-e69d-487e-897c-c3a8ccd3d355-kube-api-access-bnx2k\") pod \"limitador-operator-controller-manager-859d7b78bd-g2fs8\" (UID: \"bea4a69f-e69d-487e-897c-c3a8ccd3d355\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8" Jul 14 23:04:06.997902 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:06.997875 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnx2k\" (UniqueName: \"kubernetes.io/projected/bea4a69f-e69d-487e-897c-c3a8ccd3d355-kube-api-access-bnx2k\") pod \"limitador-operator-controller-manager-859d7b78bd-g2fs8\" (UID: \"bea4a69f-e69d-487e-897c-c3a8ccd3d355\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8" Jul 14 23:04:07.018622 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.018582 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:07.090604 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.090572 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkrwk\" (UniqueName: \"kubernetes.io/projected/1a8dfbf6-0218-4485-b97f-2075198d0360-kube-api-access-wkrwk\") pod \"1a8dfbf6-0218-4485-b97f-2075198d0360\" (UID: \"1a8dfbf6-0218-4485-b97f-2075198d0360\") " Jul 14 23:04:07.092773 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.092741 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a8dfbf6-0218-4485-b97f-2075198d0360-kube-api-access-wkrwk" (OuterVolumeSpecName: "kube-api-access-wkrwk") pod "1a8dfbf6-0218-4485-b97f-2075198d0360" (UID: "1a8dfbf6-0218-4485-b97f-2075198d0360"). InnerVolumeSpecName "kube-api-access-wkrwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:04:07.104646 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.104583 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8" Jul 14 23:04:07.132922 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.132875 2568 generic.go:356] "Generic (PLEG): container finished" podID="1a8dfbf6-0218-4485-b97f-2075198d0360" containerID="1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd" exitCode=0 Jul 14 23:04:07.133102 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.132937 2568 scope.go:117] "RemoveContainer" containerID="1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd" Jul 14 23:04:07.133169 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.133111 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:04:07.136376 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:04:07.135915 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kpx5g\" is forbidden: User \"system:node:ip-10-0-136-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-11.ec2.internal' and this object" podUID="1a8dfbf6-0218-4485-b97f-2075198d0360" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:04:07.149474 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.149376 2568 scope.go:117] "RemoveContainer" containerID="1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd" Jul 14 23:04:07.149698 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:04:07.149659 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kpx5g\" is forbidden: User \"system:node:ip-10-0-136-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-11.ec2.internal' and this object" podUID="1a8dfbf6-0218-4485-b97f-2075198d0360" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:04:07.149939 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:04:07.149871 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd\": container with ID starting with 1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd not found: ID does not exist" containerID="1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd" Jul 14 23:04:07.149939 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.149908 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd"} err="failed to get container status \"1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd\": rpc error: code = NotFound desc = could not find container \"1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd\": container with ID starting with 1ba9306c10f240abcee18dd215a36048bf736bff5464557d28acb3e870f103cd not found: ID does not exist" Jul 14 23:04:07.177125 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.175652 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld"] Jul 14 23:04:07.179961 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:04:07.178879 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6705c0_4ee4_4ff5_a1e1_138c55c61a26.slice/crio-3abf9c737be69a70e6c9886b2840b4cd9f4fba1c0bd067e2b33fd6ce46207b39 WatchSource:0}: Error finding container 3abf9c737be69a70e6c9886b2840b4cd9f4fba1c0bd067e2b33fd6ce46207b39: Status 404 returned error can't find the container with id 3abf9c737be69a70e6c9886b2840b4cd9f4fba1c0bd067e2b33fd6ce46207b39 Jul 14 23:04:07.192054 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.192022 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkrwk\" (UniqueName: \"kubernetes.io/projected/1a8dfbf6-0218-4485-b97f-2075198d0360-kube-api-access-wkrwk\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:04:07.276931 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:07.276751 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8"] Jul 14 23:04:07.279688 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:04:07.279653 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea4a69f_e69d_487e_897c_c3a8ccd3d355.slice/crio-07fe2b47943cdfcc46cb0f0d6fecd444981c16f35474c0c052171b3c69fab328 WatchSource:0}: Error finding container 07fe2b47943cdfcc46cb0f0d6fecd444981c16f35474c0c052171b3c69fab328: Status 404 returned error can't find the container with id 07fe2b47943cdfcc46cb0f0d6fecd444981c16f35474c0c052171b3c69fab328 Jul 14 23:04:08.143436 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:08.143400 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8" event={"ID":"bea4a69f-e69d-487e-897c-c3a8ccd3d355","Type":"ContainerStarted","Data":"06c8a28e83dcd29841deebf5d9a9e1acca8cedc3015bbbeb92c32db8242204d0"} Jul 14 23:04:08.143910 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:08.143463 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8" event={"ID":"bea4a69f-e69d-487e-897c-c3a8ccd3d355","Type":"ContainerStarted","Data":"07fe2b47943cdfcc46cb0f0d6fecd444981c16f35474c0c052171b3c69fab328"} Jul 14 23:04:08.143910 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:08.143493 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8" Jul 14 23:04:08.145156 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:08.145112 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" event={"ID":"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26","Type":"ContainerStarted","Data":"3abf9c737be69a70e6c9886b2840b4cd9f4fba1c0bd067e2b33fd6ce46207b39"} Jul 14 23:04:08.162972 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:04:08.162920 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kpx5g\" is forbidden: User \"system:node:ip-10-0-136-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-11.ec2.internal' and this object" podUID="1a8dfbf6-0218-4485-b97f-2075198d0360" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kpx5g" Jul 14 23:04:08.163416 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:08.163163 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8" podStartSLOduration=2.163136258 podStartE2EDuration="2.163136258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:04:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:04:08.160920177 +0000 UTC m=+402.593165151" watchObservedRunningTime="2026-07-14 23:04:08.163136258 +0000 UTC m=+402.595381234" Jul 14 23:04:08.172241 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:08.172206 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a8dfbf6-0218-4485-b97f-2075198d0360" path="/var/lib/kubelet/pods/1a8dfbf6-0218-4485-b97f-2075198d0360/volumes" Jul 14 23:04:12.170622 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:12.170583 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" podUID="7cd1663e-b819-4e21-ba96-d539d1160020" containerName="manager" containerID="cri-o://3312eee15a637b643f8bfd95f6e646eb0bdafd0fec4852f563a931e06040ac4b" gracePeriod=2 Jul 14 23:04:12.172235 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:12.172206 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" event={"ID":"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26","Type":"ContainerStarted","Data":"7d6556c9995291ce9717fb9e79fa9cb00f049cc5f9a5f0068986f436f977291c"} Jul 14 23:04:12.172354 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:12.172282 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:12.193087 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:12.193039 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" podStartSLOduration=2.250188674 podStartE2EDuration="6.193023755s" totalImagesPullingTime="3.942835081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:04:12.191098513 +0000 UTC m=+406.623343488" watchObservedRunningTime="2026-07-14 23:04:12.193023755 +0000 UTC m=+406.625268802" Jul 14 23:04:12.411756 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:12.411725 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:12.413779 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:04:12.413749 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jgxqk\" is forbidden: User \"system:node:ip-10-0-136-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-11.ec2.internal' and this object" podUID="7cd1663e-b819-4e21-ba96-d539d1160020" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:12.544641 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:12.544541 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6mzk\" (UniqueName: \"kubernetes.io/projected/7cd1663e-b819-4e21-ba96-d539d1160020-kube-api-access-f6mzk\") pod \"7cd1663e-b819-4e21-ba96-d539d1160020\" (UID: \"7cd1663e-b819-4e21-ba96-d539d1160020\") " Jul 14 23:04:12.544641 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:12.544627 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7cd1663e-b819-4e21-ba96-d539d1160020-extensions-socket-volume\") pod \"7cd1663e-b819-4e21-ba96-d539d1160020\" (UID: \"7cd1663e-b819-4e21-ba96-d539d1160020\") " Jul 14 23:04:12.544932 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:12.544906 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd1663e-b819-4e21-ba96-d539d1160020-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7cd1663e-b819-4e21-ba96-d539d1160020" (UID: "7cd1663e-b819-4e21-ba96-d539d1160020"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:04:12.546600 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:12.546575 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cd1663e-b819-4e21-ba96-d539d1160020-kube-api-access-f6mzk" (OuterVolumeSpecName: "kube-api-access-f6mzk") pod "7cd1663e-b819-4e21-ba96-d539d1160020" (UID: "7cd1663e-b819-4e21-ba96-d539d1160020"). InnerVolumeSpecName "kube-api-access-f6mzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:04:12.645983 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:12.645947 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7cd1663e-b819-4e21-ba96-d539d1160020-extensions-socket-volume\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:04:12.645983 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:12.645976 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6mzk\" (UniqueName: \"kubernetes.io/projected/7cd1663e-b819-4e21-ba96-d539d1160020-kube-api-access-f6mzk\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:04:13.177887 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:13.177851 2568 generic.go:356] "Generic (PLEG): container finished" podID="7cd1663e-b819-4e21-ba96-d539d1160020" containerID="3312eee15a637b643f8bfd95f6e646eb0bdafd0fec4852f563a931e06040ac4b" exitCode=2 Jul 14 23:04:13.178380 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:13.177898 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:13.178380 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:13.177954 2568 scope.go:117] "RemoveContainer" containerID="3312eee15a637b643f8bfd95f6e646eb0bdafd0fec4852f563a931e06040ac4b" Jul 14 23:04:13.180150 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:04:13.180117 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jgxqk\" is forbidden: User \"system:node:ip-10-0-136-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-11.ec2.internal' and this object" podUID="7cd1663e-b819-4e21-ba96-d539d1160020" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:13.186807 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:13.186786 2568 scope.go:117] "RemoveContainer" containerID="3312eee15a637b643f8bfd95f6e646eb0bdafd0fec4852f563a931e06040ac4b" Jul 14 23:04:13.187070 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:04:13.187046 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3312eee15a637b643f8bfd95f6e646eb0bdafd0fec4852f563a931e06040ac4b\": container with ID starting with 3312eee15a637b643f8bfd95f6e646eb0bdafd0fec4852f563a931e06040ac4b not found: ID does not exist" containerID="3312eee15a637b643f8bfd95f6e646eb0bdafd0fec4852f563a931e06040ac4b" Jul 14 23:04:13.187130 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:13.187079 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3312eee15a637b643f8bfd95f6e646eb0bdafd0fec4852f563a931e06040ac4b"} err="failed to get container status \"3312eee15a637b643f8bfd95f6e646eb0bdafd0fec4852f563a931e06040ac4b\": rpc error: code = NotFound desc = could not find container \"3312eee15a637b643f8bfd95f6e646eb0bdafd0fec4852f563a931e06040ac4b\": container with ID starting with 3312eee15a637b643f8bfd95f6e646eb0bdafd0fec4852f563a931e06040ac4b not found: ID does not exist" Jul 14 23:04:13.187914 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:04:13.187895 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jgxqk\" is forbidden: User \"system:node:ip-10-0-136-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-11.ec2.internal' and this object" podUID="7cd1663e-b819-4e21-ba96-d539d1160020" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jgxqk" Jul 14 23:04:14.169430 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:14.169399 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cd1663e-b819-4e21-ba96-d539d1160020" path="/var/lib/kubelet/pods/7cd1663e-b819-4e21-ba96-d539d1160020/volumes" Jul 14 23:04:19.155941 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:19.155911 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g2fs8" Jul 14 23:04:23.180421 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:23.180390 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:36.097993 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:36.097951 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld"] Jul 14 23:04:36.098569 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:36.098522 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" podUID="7b6705c0-4ee4-4ff5-a1e1-138c55c61a26" containerName="manager" containerID="cri-o://7d6556c9995291ce9717fb9e79fa9cb00f049cc5f9a5f0068986f436f977291c" gracePeriod=10 Jul 14 23:04:36.292038 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:36.291998 2568 generic.go:356] "Generic (PLEG): container finished" podID="7b6705c0-4ee4-4ff5-a1e1-138c55c61a26" containerID="7d6556c9995291ce9717fb9e79fa9cb00f049cc5f9a5f0068986f436f977291c" exitCode=0 Jul 14 23:04:36.292204 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:36.292071 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" event={"ID":"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26","Type":"ContainerDied","Data":"7d6556c9995291ce9717fb9e79fa9cb00f049cc5f9a5f0068986f436f977291c"} Jul 14 23:04:36.354956 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:36.354892 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:36.365958 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:36.365934 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf779\" (UniqueName: \"kubernetes.io/projected/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-kube-api-access-kf779\") pod \"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26\" (UID: \"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26\") " Jul 14 23:04:36.366073 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:36.366015 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-extensions-socket-volume\") pod \"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26\" (UID: \"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26\") " Jul 14 23:04:36.366319 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:36.366294 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7b6705c0-4ee4-4ff5-a1e1-138c55c61a26" (UID: "7b6705c0-4ee4-4ff5-a1e1-138c55c61a26"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:04:36.367963 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:36.367943 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-kube-api-access-kf779" (OuterVolumeSpecName: "kube-api-access-kf779") pod "7b6705c0-4ee4-4ff5-a1e1-138c55c61a26" (UID: "7b6705c0-4ee4-4ff5-a1e1-138c55c61a26"). InnerVolumeSpecName "kube-api-access-kf779". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:04:36.466634 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:36.466595 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-extensions-socket-volume\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:04:36.466634 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:36.466627 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf779\" (UniqueName: \"kubernetes.io/projected/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26-kube-api-access-kf779\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:04:37.297840 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:37.297795 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" event={"ID":"7b6705c0-4ee4-4ff5-a1e1-138c55c61a26","Type":"ContainerDied","Data":"3abf9c737be69a70e6c9886b2840b4cd9f4fba1c0bd067e2b33fd6ce46207b39"} Jul 14 23:04:37.297840 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:37.297819 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld" Jul 14 23:04:37.298376 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:37.297869 2568 scope.go:117] "RemoveContainer" containerID="7d6556c9995291ce9717fb9e79fa9cb00f049cc5f9a5f0068986f436f977291c" Jul 14 23:04:37.322583 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:37.322552 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld"] Jul 14 23:04:37.326190 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:37.326160 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4jrld"] Jul 14 23:04:38.170251 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:38.170213 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b6705c0-4ee4-4ff5-a1e1-138c55c61a26" path="/var/lib/kubelet/pods/7b6705c0-4ee4-4ff5-a1e1-138c55c61a26/volumes" Jul 14 23:04:39.681252 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.681220 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm"] Jul 14 23:04:39.681640 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.681627 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd1663e-b819-4e21-ba96-d539d1160020" containerName="manager" Jul 14 23:04:39.681640 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.681641 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd1663e-b819-4e21-ba96-d539d1160020" containerName="manager" Jul 14 23:04:39.681712 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.681661 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b6705c0-4ee4-4ff5-a1e1-138c55c61a26" containerName="manager" Jul 14 23:04:39.681712 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.681667 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b6705c0-4ee4-4ff5-a1e1-138c55c61a26" containerName="manager" Jul 14 23:04:39.681773 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.681730 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b6705c0-4ee4-4ff5-a1e1-138c55c61a26" containerName="manager" Jul 14 23:04:39.681773 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.681739 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cd1663e-b819-4e21-ba96-d539d1160020" containerName="manager" Jul 14 23:04:39.686721 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.686702 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.688807 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.688790 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pgzdr\"" Jul 14 23:04:39.695314 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.695285 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm"] Jul 14 23:04:39.798570 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.798530 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.798570 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.798576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.798826 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.798654 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23a66917-15a7-4bd4-afb9-08c96f879cea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.798826 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.798706 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.798826 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.798737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.798826 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.798798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.798987 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.798828 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnqd4\" (UniqueName: \"kubernetes.io/projected/23a66917-15a7-4bd4-afb9-08c96f879cea-kube-api-access-mnqd4\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.798987 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.798884 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.798987 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.798915 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.899883 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.899840 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23a66917-15a7-4bd4-afb9-08c96f879cea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.899883 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.899886 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.900128 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.899908 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.900128 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.899941 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.900128 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.899965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnqd4\" (UniqueName: \"kubernetes.io/projected/23a66917-15a7-4bd4-afb9-08c96f879cea-kube-api-access-mnqd4\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.900128 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.900023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.900128 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.900057 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.900128 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.900103 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.900448 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.900140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.900448 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.900321 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.900560 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.900475 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.900639 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.900614 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.900695 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.900655 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.901138 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.901115 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23a66917-15a7-4bd4-afb9-08c96f879cea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.902266 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.902248 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.902662 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.902644 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.908739 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.908711 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23a66917-15a7-4bd4-afb9-08c96f879cea-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.909089 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.909069 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnqd4\" (UniqueName: \"kubernetes.io/projected/23a66917-15a7-4bd4-afb9-08c96f879cea-kube-api-access-mnqd4\") pod \"maas-default-gateway-openshift-default-56654dcf7-hj2hm\" (UID: \"23a66917-15a7-4bd4-afb9-08c96f879cea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:39.998151 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:39.998065 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:40.134882 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:40.134813 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm"] Jul 14 23:04:40.137241 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:04:40.137214 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a66917_15a7_4bd4_afb9_08c96f879cea.slice/crio-3ae3fef089a126d63a95979486c10f42a42990bea72c7f42d3d55509e949f03a WatchSource:0}: Error finding container 3ae3fef089a126d63a95979486c10f42a42990bea72c7f42d3d55509e949f03a: Status 404 returned error can't find the container with id 3ae3fef089a126d63a95979486c10f42a42990bea72c7f42d3d55509e949f03a Jul 14 23:04:40.139377 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:40.139347 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:04:40.139470 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:40.139411 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:04:40.139470 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:40.139440 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:04:40.316190 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:40.316088 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" event={"ID":"23a66917-15a7-4bd4-afb9-08c96f879cea","Type":"ContainerStarted","Data":"eabb8a10858fa33bf85c41e915791b08b74511f80c062f4b09227d7673c95cc3"} Jul 14 23:04:40.316190 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:40.316149 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" event={"ID":"23a66917-15a7-4bd4-afb9-08c96f879cea","Type":"ContainerStarted","Data":"3ae3fef089a126d63a95979486c10f42a42990bea72c7f42d3d55509e949f03a"} Jul 14 23:04:40.335758 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:40.335690 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" podStartSLOduration=1.335668692 podStartE2EDuration="1.335668692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:04:40.334938361 +0000 UTC m=+434.767183338" watchObservedRunningTime="2026-07-14 23:04:40.335668692 +0000 UTC m=+434.767913667" Jul 14 23:04:40.998232 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:40.998193 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:42.003760 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:42.003719 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:42.329765 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:42.329676 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:42.332259 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:42.332232 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:04:53.592229 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.592145 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:04:53.595867 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.595846 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" Jul 14 23:04:53.597988 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.597967 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c524q\"" Jul 14 23:04:53.598090 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.597981 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 23:04:53.604769 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.604745 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:04:53.642600 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.642562 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:04:53.739162 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.739117 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zgvl\" (UniqueName: \"kubernetes.io/projected/f2e5a12c-056f-4919-b92a-34b66ad1c520-kube-api-access-8zgvl\") pod \"limitador-limitador-54d6d988d5-n785w\" (UID: \"f2e5a12c-056f-4919-b92a-34b66ad1c520\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" Jul 14 23:04:53.739384 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.739169 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f2e5a12c-056f-4919-b92a-34b66ad1c520-config-file\") pod \"limitador-limitador-54d6d988d5-n785w\" (UID: \"f2e5a12c-056f-4919-b92a-34b66ad1c520\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" Jul 14 23:04:53.840505 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.840459 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zgvl\" (UniqueName: \"kubernetes.io/projected/f2e5a12c-056f-4919-b92a-34b66ad1c520-kube-api-access-8zgvl\") pod \"limitador-limitador-54d6d988d5-n785w\" (UID: \"f2e5a12c-056f-4919-b92a-34b66ad1c520\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" Jul 14 23:04:53.840708 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.840514 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f2e5a12c-056f-4919-b92a-34b66ad1c520-config-file\") pod \"limitador-limitador-54d6d988d5-n785w\" (UID: \"f2e5a12c-056f-4919-b92a-34b66ad1c520\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" Jul 14 23:04:53.841107 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.841086 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f2e5a12c-056f-4919-b92a-34b66ad1c520-config-file\") pod \"limitador-limitador-54d6d988d5-n785w\" (UID: \"f2e5a12c-056f-4919-b92a-34b66ad1c520\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" Jul 14 23:04:53.849526 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.849464 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zgvl\" (UniqueName: \"kubernetes.io/projected/f2e5a12c-056f-4919-b92a-34b66ad1c520-kube-api-access-8zgvl\") pod \"limitador-limitador-54d6d988d5-n785w\" (UID: \"f2e5a12c-056f-4919-b92a-34b66ad1c520\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" Jul 14 23:04:53.908040 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:53.907999 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" Jul 14 23:04:54.044633 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:54.044606 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:04:54.047208 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:04:54.047159 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e5a12c_056f_4919_b92a_34b66ad1c520.slice/crio-95128663a8165027140e450caecc99160bc479944f8d968410c61b39bdec8f90 WatchSource:0}: Error finding container 95128663a8165027140e450caecc99160bc479944f8d968410c61b39bdec8f90: Status 404 returned error can't find the container with id 95128663a8165027140e450caecc99160bc479944f8d968410c61b39bdec8f90 Jul 14 23:04:54.395921 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:54.395885 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" event={"ID":"f2e5a12c-056f-4919-b92a-34b66ad1c520","Type":"ContainerStarted","Data":"95128663a8165027140e450caecc99160bc479944f8d968410c61b39bdec8f90"} Jul 14 23:04:57.418282 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:57.418245 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" event={"ID":"f2e5a12c-056f-4919-b92a-34b66ad1c520","Type":"ContainerStarted","Data":"02b69fcc824142fdec8e9314c4ff03e65a43637ae30b28ce8a56bb8c5cfab185"} Jul 14 23:04:57.418661 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:57.418385 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" Jul 14 23:04:57.435356 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:04:57.435295 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" podStartSLOduration=1.714379326 podStartE2EDuration="4.435279123s" totalImagesPullingTime="2.720899797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:04:57.434042542 +0000 UTC m=+451.866287516" watchObservedRunningTime="2026-07-14 23:04:57.435279123 +0000 UTC m=+451.867524147" Jul 14 23:05:08.424745 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:05:08.424712 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n785w" Jul 14 23:06:04.283921 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.283882 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv"] Jul 14 23:06:04.287422 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.287403 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:04.289905 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.289878 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7jvtc\"" Jul 14 23:06:04.290293 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.290276 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 14 23:06:04.290417 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.290315 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 23:06:04.290417 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.290317 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 23:06:04.297839 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.297815 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv"] Jul 14 23:06:04.375747 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.375712 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61176b07-0550-4e5d-88d2-abb598b18258-openshift-service-ca\") pod \"maas-api-5b595b8c88-qr4hv\" (UID: \"61176b07-0550-4e5d-88d2-abb598b18258\") " pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:04.375919 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.375816 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmwz4\" (UniqueName: \"kubernetes.io/projected/61176b07-0550-4e5d-88d2-abb598b18258-kube-api-access-fmwz4\") pod \"maas-api-5b595b8c88-qr4hv\" (UID: \"61176b07-0550-4e5d-88d2-abb598b18258\") " pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:04.375919 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.375879 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61176b07-0550-4e5d-88d2-abb598b18258-maas-api-tls\") pod \"maas-api-5b595b8c88-qr4hv\" (UID: \"61176b07-0550-4e5d-88d2-abb598b18258\") " pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:04.476385 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.476354 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmwz4\" (UniqueName: \"kubernetes.io/projected/61176b07-0550-4e5d-88d2-abb598b18258-kube-api-access-fmwz4\") pod \"maas-api-5b595b8c88-qr4hv\" (UID: \"61176b07-0550-4e5d-88d2-abb598b18258\") " pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:04.476536 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.476412 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61176b07-0550-4e5d-88d2-abb598b18258-maas-api-tls\") pod \"maas-api-5b595b8c88-qr4hv\" (UID: \"61176b07-0550-4e5d-88d2-abb598b18258\") " pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:04.476536 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.476444 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61176b07-0550-4e5d-88d2-abb598b18258-openshift-service-ca\") pod \"maas-api-5b595b8c88-qr4hv\" (UID: \"61176b07-0550-4e5d-88d2-abb598b18258\") " pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:04.477052 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.477034 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61176b07-0550-4e5d-88d2-abb598b18258-openshift-service-ca\") pod \"maas-api-5b595b8c88-qr4hv\" (UID: \"61176b07-0550-4e5d-88d2-abb598b18258\") " pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:04.479043 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.479019 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61176b07-0550-4e5d-88d2-abb598b18258-maas-api-tls\") pod \"maas-api-5b595b8c88-qr4hv\" (UID: \"61176b07-0550-4e5d-88d2-abb598b18258\") " pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:04.485236 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.485208 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmwz4\" (UniqueName: \"kubernetes.io/projected/61176b07-0550-4e5d-88d2-abb598b18258-kube-api-access-fmwz4\") pod \"maas-api-5b595b8c88-qr4hv\" (UID: \"61176b07-0550-4e5d-88d2-abb598b18258\") " pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:04.598598 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.598500 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:04.756019 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.755979 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv"] Jul 14 23:06:04.758800 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:06:04.758771 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61176b07_0550_4e5d_88d2_abb598b18258.slice/crio-bbcb935ed4a783d27bca89eee772db929509fc72c44c78496143a0cca85a5999 WatchSource:0}: Error finding container bbcb935ed4a783d27bca89eee772db929509fc72c44c78496143a0cca85a5999: Status 404 returned error can't find the container with id bbcb935ed4a783d27bca89eee772db929509fc72c44c78496143a0cca85a5999 Jul 14 23:06:04.802450 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:04.802409 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:06:05.757613 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:05.757573 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" event={"ID":"61176b07-0550-4e5d-88d2-abb598b18258","Type":"ContainerStarted","Data":"bbcb935ed4a783d27bca89eee772db929509fc72c44c78496143a0cca85a5999"} Jul 14 23:06:07.771380 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:07.771314 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" event={"ID":"61176b07-0550-4e5d-88d2-abb598b18258","Type":"ContainerStarted","Data":"e7c1cd4b731a81164f8d3d040c4f4b3ca723f310076212576880675fd18c22eb"} Jul 14 23:06:07.771762 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:07.771464 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:07.788310 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:07.788258 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" podStartSLOduration=1.593058168 podStartE2EDuration="3.788242021s" totalImagesPullingTime="2.195183853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:06:07.787200733 +0000 UTC m=+522.219445689" watchObservedRunningTime="2026-07-14 23:06:07.788242021 +0000 UTC m=+522.220486995" Jul 14 23:06:12.407157 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:12.406077 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hj2hm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:42950->10.134.0.31:15021: read: connection reset by peer" start-of-body= Jul 14 23:06:12.407157 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:12.406156 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" podUID="23a66917-15a7-4bd4-afb9-08c96f879cea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:42950->10.134.0.31:15021: read: connection reset by peer" Jul 14 23:06:12.799668 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:12.799572 2568 generic.go:356] "Generic (PLEG): container finished" podID="23a66917-15a7-4bd4-afb9-08c96f879cea" containerID="eabb8a10858fa33bf85c41e915791b08b74511f80c062f4b09227d7673c95cc3" exitCode=0 Jul 14 23:06:12.799668 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:12.799614 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" event={"ID":"23a66917-15a7-4bd4-afb9-08c96f879cea","Type":"ContainerDied","Data":"eabb8a10858fa33bf85c41e915791b08b74511f80c062f4b09227d7673c95cc3"} Jul 14 23:06:12.800061 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:12.800043 2568 scope.go:117] "RemoveContainer" containerID="eabb8a10858fa33bf85c41e915791b08b74511f80c062f4b09227d7673c95cc3" Jul 14 23:06:12.801130 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:12.801098 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:06:12.801231 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:12.801168 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:06:12.801231 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:12.801201 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:06:13.781929 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:13.781900 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5b595b8c88-qr4hv" Jul 14 23:06:13.806933 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:13.806901 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" event={"ID":"23a66917-15a7-4bd4-afb9-08c96f879cea","Type":"ContainerStarted","Data":"8bbeea78fb88db068292f437ce53e43c42ce7e2d9f2954cfbf4fe2a5f325923b"} Jul 14 23:06:13.999256 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:13.999215 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:06:13.999511 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:13.999486 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hj2hm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 14 23:06:13.999567 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:13.999548 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" podUID="23a66917-15a7-4bd4-afb9-08c96f879cea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 14 23:06:14.998683 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:14.998643 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hj2hm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 14 23:06:14.999077 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:14.998701 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" podUID="23a66917-15a7-4bd4-afb9-08c96f879cea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 14 23:06:15.998791 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:15.998754 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hj2hm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 14 23:06:15.999167 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:15.998828 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" podUID="23a66917-15a7-4bd4-afb9-08c96f879cea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 14 23:06:16.999066 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:16.999029 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hj2hm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 14 23:06:16.999486 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:16.999085 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" podUID="23a66917-15a7-4bd4-afb9-08c96f879cea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 14 23:06:18.002706 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:18.002617 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:06:18.003131 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:18.003019 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:06:18.003756 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:18.003736 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hj2hm" Jul 14 23:06:23.795844 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:23.795808 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:06:50.080885 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:50.080844 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:06:58.093114 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:06:58.093070 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:07:05.495623 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.495588 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p"] Jul 14 23:07:05.499272 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.499250 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.501763 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.501744 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 14 23:07:05.502174 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.502155 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 23:07:05.502263 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.502176 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9bm26\"" Jul 14 23:07:05.502263 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.502184 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 23:07:05.509626 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.509597 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p"] Jul 14 23:07:05.549870 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.549834 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.549870 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.549873 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.550080 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.549915 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.550080 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.549970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m4c7\" (UniqueName: \"kubernetes.io/projected/b5e9ce48-90d4-4162-a47c-501b153cce0d-kube-api-access-7m4c7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.550080 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.550069 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.550198 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.550100 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5e9ce48-90d4-4162-a47c-501b153cce0d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.651214 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.651162 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.651214 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.651212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5e9ce48-90d4-4162-a47c-501b153cce0d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.651518 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.651253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.651518 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.651272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.651518 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.651301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.651518 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.651325 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m4c7\" (UniqueName: \"kubernetes.io/projected/b5e9ce48-90d4-4162-a47c-501b153cce0d-kube-api-access-7m4c7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.651732 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.651700 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.651794 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.651742 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.651898 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.651857 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.653690 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.653667 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5e9ce48-90d4-4162-a47c-501b153cce0d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.653935 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.653919 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5e9ce48-90d4-4162-a47c-501b153cce0d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.659788 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.659762 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m4c7\" (UniqueName: \"kubernetes.io/projected/b5e9ce48-90d4-4162-a47c-501b153cce0d-kube-api-access-7m4c7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p\" (UID: \"b5e9ce48-90d4-4162-a47c-501b153cce0d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.810887 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.810793 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:05.948653 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:05.948625 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p"] Jul 14 23:07:05.951377 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:07:05.951346 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e9ce48_90d4_4162_a47c_501b153cce0d.slice/crio-8f3e72d1bc7c6fce0e0cc45c998ce1407cbd3d7a974086cb2536ac989875336b WatchSource:0}: Error finding container 8f3e72d1bc7c6fce0e0cc45c998ce1407cbd3d7a974086cb2536ac989875336b: Status 404 returned error can't find the container with id 8f3e72d1bc7c6fce0e0cc45c998ce1407cbd3d7a974086cb2536ac989875336b Jul 14 23:07:06.061077 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:06.060985 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" event={"ID":"b5e9ce48-90d4-4162-a47c-501b153cce0d","Type":"ContainerStarted","Data":"8f3e72d1bc7c6fce0e0cc45c998ce1407cbd3d7a974086cb2536ac989875336b"} Jul 14 23:07:07.068437 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:07.068401 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" event={"ID":"b5e9ce48-90d4-4162-a47c-501b153cce0d","Type":"ContainerStarted","Data":"2e97a930cdb18e34696f2938e449d3107c29fcab130e4ad0be97e41db4c4337d"} Jul 14 23:07:07.085742 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:07.085703 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:07:07.086683 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:07.086600 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" podStartSLOduration=1.088987991 podStartE2EDuration="2.086580957s" totalImagesPullingTime="997.592966ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:07:07.086531217 +0000 UTC m=+581.518776189" watchObservedRunningTime="2026-07-14 23:07:07.086580957 +0000 UTC m=+581.518825932" Jul 14 23:07:15.811835 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:15.811793 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:15.811835 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:15.811857 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:15.824892 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:15.824861 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:16.125196 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:16.125168 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p" Jul 14 23:07:30.891836 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:30.891793 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m"] Jul 14 23:07:30.898510 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:30.898481 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:30.900863 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:30.900833 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 14 23:07:30.903682 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:30.903660 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m"] Jul 14 23:07:31.089503 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.089464 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.089503 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.089506 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.089759 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.089595 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.089759 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.089637 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a557a171-de00-4c4c-b78d-b4d0427362aa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.089759 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.089698 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55bm8\" (UniqueName: \"kubernetes.io/projected/a557a171-de00-4c4c-b78d-b4d0427362aa-kube-api-access-55bm8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.089759 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.089728 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.190744 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.190643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55bm8\" (UniqueName: \"kubernetes.io/projected/a557a171-de00-4c4c-b78d-b4d0427362aa-kube-api-access-55bm8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.190744 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.190688 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.190995 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.190764 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.190995 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.190789 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.190995 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.190836 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.190995 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.190863 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a557a171-de00-4c4c-b78d-b4d0427362aa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.191197 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.191162 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.191267 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.191192 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.191267 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.191257 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.193174 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.193149 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a557a171-de00-4c4c-b78d-b4d0427362aa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.193311 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.193293 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a557a171-de00-4c4c-b78d-b4d0427362aa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.197887 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.197864 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55bm8\" (UniqueName: \"kubernetes.io/projected/a557a171-de00-4c4c-b78d-b4d0427362aa-kube-api-access-55bm8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cx58m\" (UID: \"a557a171-de00-4c4c-b78d-b4d0427362aa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.210649 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.210620 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:31.350692 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:31.350668 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m"] Jul 14 23:07:31.352230 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:07:31.352193 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda557a171_de00_4c4c_b78d_b4d0427362aa.slice/crio-e81e444b873c75a86d0ad9d0885238c86b42f633e1264978d165ea18ffc456ab WatchSource:0}: Error finding container e81e444b873c75a86d0ad9d0885238c86b42f633e1264978d165ea18ffc456ab: Status 404 returned error can't find the container with id e81e444b873c75a86d0ad9d0885238c86b42f633e1264978d165ea18ffc456ab Jul 14 23:07:32.194012 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:32.193974 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" event={"ID":"a557a171-de00-4c4c-b78d-b4d0427362aa","Type":"ContainerStarted","Data":"c1081abf79ab71149a16f1082f2645c6f0e9030b2698fcb9f2b58fca12fc3b6e"} Jul 14 23:07:32.194424 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:32.194038 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" event={"ID":"a557a171-de00-4c4c-b78d-b4d0427362aa","Type":"ContainerStarted","Data":"e81e444b873c75a86d0ad9d0885238c86b42f633e1264978d165ea18ffc456ab"} Jul 14 23:07:32.252570 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:32.252511 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" podStartSLOduration=2.082267399 podStartE2EDuration="2.252489345s" totalImagesPullingTime="170.221946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:07:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:07:32.250243502 +0000 UTC m=+606.682488497" watchObservedRunningTime="2026-07-14 23:07:32.252489345 +0000 UTC m=+606.684734297" Jul 14 23:07:32.786519 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:32.786480 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:07:41.211731 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:41.211692 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:41.212174 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:41.211758 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:41.224252 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:41.224221 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:07:41.251693 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:07:41.251662 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cx58m" Jul 14 23:08:06.189160 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.189078 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9"] Jul 14 23:08:06.193553 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.193531 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.195549 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.195520 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 14 23:08:06.202571 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.202553 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9"] Jul 14 23:08:06.325784 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.325748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.325784 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.325791 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.325999 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.325813 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b0592ab-849f-42ec-86a6-aa312572d610-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.325999 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.325866 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkdvg\" (UniqueName: \"kubernetes.io/projected/4b0592ab-849f-42ec-86a6-aa312572d610-kube-api-access-vkdvg\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.325999 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.325939 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.326097 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.326001 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.427447 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.427402 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.427648 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.427474 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.427648 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.427493 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.427648 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.427512 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b0592ab-849f-42ec-86a6-aa312572d610-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.427648 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.427540 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkdvg\" (UniqueName: \"kubernetes.io/projected/4b0592ab-849f-42ec-86a6-aa312572d610-kube-api-access-vkdvg\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.427648 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.427563 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.427918 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.427864 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.427918 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.427876 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.428009 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.427933 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.430219 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.430190 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b0592ab-849f-42ec-86a6-aa312572d610-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.430365 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.430239 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b0592ab-849f-42ec-86a6-aa312572d610-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.434747 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.434726 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkdvg\" (UniqueName: \"kubernetes.io/projected/4b0592ab-849f-42ec-86a6-aa312572d610-kube-api-access-vkdvg\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9\" (UID: \"4b0592ab-849f-42ec-86a6-aa312572d610\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.504732 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.504643 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:06.642957 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:06.642931 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9"] Jul 14 23:08:06.644802 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:08:06.644775 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b0592ab_849f_42ec_86a6_aa312572d610.slice/crio-475f7c80c0ef4b656d3e2109fb87a1ba001ae23db27a7e1bd6d7597009ad9de3 WatchSource:0}: Error finding container 475f7c80c0ef4b656d3e2109fb87a1ba001ae23db27a7e1bd6d7597009ad9de3: Status 404 returned error can't find the container with id 475f7c80c0ef4b656d3e2109fb87a1ba001ae23db27a7e1bd6d7597009ad9de3 Jul 14 23:08:07.377013 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:07.376975 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" event={"ID":"4b0592ab-849f-42ec-86a6-aa312572d610","Type":"ContainerStarted","Data":"13957b7e09e5f10f146d2f38cd5e0fe7e32a47a0f84eeefcb809f09d19181606"} Jul 14 23:08:07.377013 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:07.377018 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" event={"ID":"4b0592ab-849f-42ec-86a6-aa312572d610","Type":"ContainerStarted","Data":"475f7c80c0ef4b656d3e2109fb87a1ba001ae23db27a7e1bd6d7597009ad9de3"} Jul 14 23:08:07.394906 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:07.394847 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" podStartSLOduration=1.227907855 podStartE2EDuration="1.394826373s" totalImagesPullingTime="166.918518ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:08:07.392946728 +0000 UTC m=+641.825191705" watchObservedRunningTime="2026-07-14 23:08:07.394826373 +0000 UTC m=+641.827071347" Jul 14 23:08:08.586481 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:08.586444 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:08:16.504869 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:16.504831 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:16.505378 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:16.504890 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:16.517914 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:16.517882 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:08:17.446815 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:08:17.446781 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9" Jul 14 23:09:35.595660 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:09:35.595626 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:09:44.885262 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:09:44.885230 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:09:55.582141 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:09:55.582103 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:10:05.689351 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:10:05.689298 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:10:16.283051 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:10:16.283013 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:10:43.386798 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:10:43.386760 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:10:54.882050 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:10:54.881968 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:11:29.888750 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:11:29.888705 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:11:39.285135 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:11:39.285095 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:11:49.596624 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:11:49.596587 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:11:57.584034 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:11:57.583997 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:12:07.079683 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:12:07.079637 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:12:18.693752 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:12:18.693673 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:12:29.781408 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:12:29.781368 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:12:39.682817 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:12:39.682777 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:13:05.087619 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:13:05.087583 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:13:16.382649 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:13:16.382612 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:13:38.178814 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:13:38.178781 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:13:48.290793 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:13:48.290710 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:14:03.894613 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:14:03.894572 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:14:13.211173 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:14:13.211136 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:14:24.894043 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:14:24.894007 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:14:34.792655 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:14:34.792614 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:14:44.184492 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:14:44.184459 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:16:32.189050 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:16:32.189008 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:16:46.481608 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:16:46.481563 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:17:04.687029 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:17:04.686944 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:17:14.185595 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:17:14.185562 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:17:23.389007 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:17:23.388966 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:17:33.288000 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:17:33.287959 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:17:43.194552 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:17:43.194507 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:17:53.992410 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:17:53.992367 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:18:03.988677 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:18:03.988638 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:18:14.502155 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:18:14.502116 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:18:36.088036 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:18:36.087954 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:18:44.994123 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:18:44.994085 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:18:54.686227 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:18:54.686185 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:19:05.483582 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:19:05.483541 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:19:21.591228 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:19:21.591190 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:19:30.778430 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:19:30.778390 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:19:40.192436 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:19:40.192401 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:19:48.785281 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:19:48.785196 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:19:59.182113 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:19:59.182075 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:20:09.182158 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:20:09.182120 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:20:22.579771 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:20:22.579735 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:20:31.494081 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:20:31.494039 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:20:41.683618 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:20:41.683578 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:20:54.090761 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:20:54.090724 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:21:04.285821 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:21:04.285784 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:21:14.796516 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:21:14.796472 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:21:27.591281 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:21:27.591247 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:21:40.182566 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:21:40.182530 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:21:49.391098 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:21:49.391057 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:21:59.882791 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:21:59.882751 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:22:08.792552 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:08.792517 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:22:17.285477 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:17.285434 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:22:22.147797 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.147761 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k"] Jul 14 23:22:22.152007 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.151983 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.154282 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.154260 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-37a8657d-openshift-default-dockercfg-hl8rr\"" Jul 14 23:22:22.174973 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.174943 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k"] Jul 14 23:22:22.278399 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.278313 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-envoy\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.278575 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.278424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73146612-346c-44a2-8470-d214ee0d9e33-istio-podinfo\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.278575 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.278445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-istio-token\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.278647 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.278621 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-data\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.278689 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.278662 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-socket\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.278722 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.278685 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-credential-socket\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.278770 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.278752 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-certs\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.278842 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.278830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nrlp\" (UniqueName: \"kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-kube-api-access-9nrlp\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.278878 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.278853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73146612-346c-44a2-8470-d214ee0d9e33-istiod-ca-cert\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.379624 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.379568 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-data\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.379821 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.379638 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-socket\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.379821 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.379675 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-credential-socket\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.379821 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.379721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-certs\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.379821 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.379775 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nrlp\" (UniqueName: \"kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-kube-api-access-9nrlp\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.379821 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.379801 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73146612-346c-44a2-8470-d214ee0d9e33-istiod-ca-cert\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.380155 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.380015 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-envoy\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.380155 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.380078 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73146612-346c-44a2-8470-d214ee0d9e33-istio-podinfo\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.380155 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.380105 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-istio-token\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.380314 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.380165 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-credential-socket\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.380314 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.380181 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-socket\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.380314 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.380164 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-certs\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.380314 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.380294 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-data\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.380512 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.380495 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73146612-346c-44a2-8470-d214ee0d9e33-istiod-ca-cert\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.382307 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.382287 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-envoy\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.382544 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.382526 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73146612-346c-44a2-8470-d214ee0d9e33-istio-podinfo\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.388833 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.388800 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-istio-token\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.388956 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.388878 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nrlp\" (UniqueName: \"kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-kube-api-access-9nrlp\") pod \"e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.462892 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.462806 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:22.605290 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.605231 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k"] Jul 14 23:22:22.607752 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:22:22.607714 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73146612_346c_44a2_8470_d214ee0d9e33.slice/crio-98be176279097b44c04fc2c6f23eb1d46a62017f5f87a9c3e7b74152dfc2727b WatchSource:0}: Error finding container 98be176279097b44c04fc2c6f23eb1d46a62017f5f87a9c3e7b74152dfc2727b: Status 404 returned error can't find the container with id 98be176279097b44c04fc2c6f23eb1d46a62017f5f87a9c3e7b74152dfc2727b Jul 14 23:22:22.609840 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.609808 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:22:22.609910 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.609882 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:22:22.609946 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.609915 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:22:22.705012 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.704974 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" event={"ID":"73146612-346c-44a2-8470-d214ee0d9e33","Type":"ContainerStarted","Data":"e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52"} Jul 14 23:22:22.705198 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.705038 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" event={"ID":"73146612-346c-44a2-8470-d214ee0d9e33","Type":"ContainerStarted","Data":"98be176279097b44c04fc2c6f23eb1d46a62017f5f87a9c3e7b74152dfc2727b"} Jul 14 23:22:22.726519 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:22.726401 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" podStartSLOduration=0.726384173 podStartE2EDuration="726.384173ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:22:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:22:22.724839065 +0000 UTC m=+1497.157084053" watchObservedRunningTime="2026-07-14 23:22:22.726384173 +0000 UTC m=+1497.158629146" Jul 14 23:22:23.463390 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:23.463326 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:23.468647 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:23.468616 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:23.710634 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:23.710599 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:23.711705 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:23.711683 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:26.890093 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:26.890050 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:22:35.786107 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:35.786070 2568 generic.go:356] "Generic (PLEG): container finished" podID="73146612-346c-44a2-8470-d214ee0d9e33" containerID="e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52" exitCode=0 Jul 14 23:22:35.786544 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:35.786146 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" event={"ID":"73146612-346c-44a2-8470-d214ee0d9e33","Type":"ContainerDied","Data":"e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52"} Jul 14 23:22:35.786626 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:35.786611 2568 scope.go:117] "RemoveContainer" containerID="e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52" Jul 14 23:22:35.787669 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:35.787641 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:22:35.787739 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:35.787725 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:22:35.788037 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:35.787768 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 23:22:36.796782 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:36.796743 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" event={"ID":"73146612-346c-44a2-8470-d214ee0d9e33","Type":"ContainerStarted","Data":"db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2"} Jul 14 23:22:37.463848 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:37.463809 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:37.464937 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:37.464901 2568 patch_prober.go:28] interesting pod/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 14 23:22:37.465066 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:37.464951 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" podUID="73146612-346c-44a2-8470-d214ee0d9e33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 14 23:22:38.463623 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:38.463584 2568 patch_prober.go:28] interesting pod/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 14 23:22:38.464012 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:38.463649 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" podUID="73146612-346c-44a2-8470-d214ee0d9e33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 14 23:22:38.711249 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:38.711204 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:39.464110 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:39.464065 2568 patch_prober.go:28] interesting pod/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 14 23:22:39.464511 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:39.464125 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" podUID="73146612-346c-44a2-8470-d214ee0d9e33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 14 23:22:40.463423 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:40.463383 2568 patch_prober.go:28] interesting pod/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 14 23:22:40.463602 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:40.463453 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" podUID="73146612-346c-44a2-8470-d214ee0d9e33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 14 23:22:41.466760 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:41.466729 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:22:41.467850 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:22:41.467819 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:23:32.186266 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:32.186230 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:23:43.708987 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:43.708949 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k"] Jul 14 23:23:43.709405 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:43.709180 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" podUID="73146612-346c-44a2-8470-d214ee0d9e33" containerName="istio-proxy" containerID="cri-o://db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2" gracePeriod=30 Jul 14 23:23:48.958998 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:48.958971 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:23:49.056434 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.056390 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73146612-346c-44a2-8470-d214ee0d9e33-istiod-ca-cert\") pod \"73146612-346c-44a2-8470-d214ee0d9e33\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " Jul 14 23:23:49.056580 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.056510 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73146612-346c-44a2-8470-d214ee0d9e33-istio-podinfo\") pod \"73146612-346c-44a2-8470-d214ee0d9e33\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " Jul 14 23:23:49.056580 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.056555 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-istio-token\") pod \"73146612-346c-44a2-8470-d214ee0d9e33\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " Jul 14 23:23:49.056661 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.056582 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-credential-socket\") pod \"73146612-346c-44a2-8470-d214ee0d9e33\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " Jul 14 23:23:49.056661 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.056611 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-data\") pod \"73146612-346c-44a2-8470-d214ee0d9e33\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " Jul 14 23:23:49.056753 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.056672 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-envoy\") pod \"73146612-346c-44a2-8470-d214ee0d9e33\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " Jul 14 23:23:49.056753 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.056716 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-certs\") pod \"73146612-346c-44a2-8470-d214ee0d9e33\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " Jul 14 23:23:49.056753 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.056747 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nrlp\" (UniqueName: \"kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-kube-api-access-9nrlp\") pod \"73146612-346c-44a2-8470-d214ee0d9e33\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " Jul 14 23:23:49.056904 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.056758 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73146612-346c-44a2-8470-d214ee0d9e33-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73146612-346c-44a2-8470-d214ee0d9e33" (UID: "73146612-346c-44a2-8470-d214ee0d9e33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:23:49.056904 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.056801 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-socket\") pod \"73146612-346c-44a2-8470-d214ee0d9e33\" (UID: \"73146612-346c-44a2-8470-d214ee0d9e33\") " Jul 14 23:23:49.057007 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.056927 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73146612-346c-44a2-8470-d214ee0d9e33" (UID: "73146612-346c-44a2-8470-d214ee0d9e33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:23:49.057400 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.057100 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73146612-346c-44a2-8470-d214ee0d9e33" (UID: "73146612-346c-44a2-8470-d214ee0d9e33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:23:49.057400 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.057149 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73146612-346c-44a2-8470-d214ee0d9e33" (UID: "73146612-346c-44a2-8470-d214ee0d9e33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:23:49.057400 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.057232 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-certs\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:23:49.057400 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.057252 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73146612-346c-44a2-8470-d214ee0d9e33-istiod-ca-cert\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:23:49.057400 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.057279 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-credential-socket\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:23:49.057675 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.057470 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-data" (OuterVolumeSpecName: "istio-data") pod "73146612-346c-44a2-8470-d214ee0d9e33" (UID: "73146612-346c-44a2-8470-d214ee0d9e33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:23:49.059018 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.058987 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-istio-token" (OuterVolumeSpecName: "istio-token") pod "73146612-346c-44a2-8470-d214ee0d9e33" (UID: "73146612-346c-44a2-8470-d214ee0d9e33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:23:49.059122 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.059037 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-kube-api-access-9nrlp" (OuterVolumeSpecName: "kube-api-access-9nrlp") pod "73146612-346c-44a2-8470-d214ee0d9e33" (UID: "73146612-346c-44a2-8470-d214ee0d9e33"). InnerVolumeSpecName "kube-api-access-9nrlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:23:49.059122 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.059100 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73146612-346c-44a2-8470-d214ee0d9e33" (UID: "73146612-346c-44a2-8470-d214ee0d9e33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:23:49.059122 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.059102 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73146612-346c-44a2-8470-d214ee0d9e33-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73146612-346c-44a2-8470-d214ee0d9e33" (UID: "73146612-346c-44a2-8470-d214ee0d9e33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 23:23:49.158016 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.157980 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nrlp\" (UniqueName: \"kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-kube-api-access-9nrlp\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:23:49.158016 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.158008 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-workload-socket\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:23:49.158016 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.158018 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73146612-346c-44a2-8470-d214ee0d9e33-istio-podinfo\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:23:49.158016 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.158027 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73146612-346c-44a2-8470-d214ee0d9e33-istio-token\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:23:49.158270 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.158035 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-data\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:23:49.158270 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.158043 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73146612-346c-44a2-8470-d214ee0d9e33-istio-envoy\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:23:49.171873 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.171840 2568 generic.go:356] "Generic (PLEG): container finished" podID="73146612-346c-44a2-8470-d214ee0d9e33" containerID="db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2" exitCode=0 Jul 14 23:23:49.172033 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.171880 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" event={"ID":"73146612-346c-44a2-8470-d214ee0d9e33","Type":"ContainerDied","Data":"db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2"} Jul 14 23:23:49.172033 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.171891 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" Jul 14 23:23:49.172033 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.171920 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k" event={"ID":"73146612-346c-44a2-8470-d214ee0d9e33","Type":"ContainerDied","Data":"98be176279097b44c04fc2c6f23eb1d46a62017f5f87a9c3e7b74152dfc2727b"} Jul 14 23:23:49.172033 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.171943 2568 scope.go:117] "RemoveContainer" containerID="db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2" Jul 14 23:23:49.181649 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.181631 2568 scope.go:117] "RemoveContainer" containerID="e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52" Jul 14 23:23:49.189945 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.189927 2568 scope.go:117] "RemoveContainer" containerID="db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2" Jul 14 23:23:49.190238 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:23:49.190220 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2\": container with ID starting with db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2 not found: ID does not exist" containerID="db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2" Jul 14 23:23:49.190287 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.190247 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2"} err="failed to get container status \"db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2\": rpc error: code = NotFound desc = could not find container \"db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2\": container with ID starting with db3ed8967b69acae167e5c0e1b4975cc35f3592bf0d5b27abe4947994f0c2fd2 not found: ID does not exist" Jul 14 23:23:49.190287 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.190270 2568 scope.go:117] "RemoveContainer" containerID="e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52" Jul 14 23:23:49.190661 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:23:49.190573 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52\": container with ID starting with e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52 not found: ID does not exist" containerID="e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52" Jul 14 23:23:49.190661 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.190623 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52"} err="failed to get container status \"e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52\": rpc error: code = NotFound desc = could not find container \"e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52\": container with ID starting with e8bd3d45e8bfa194a09203cb9a1d2525819aa1dfafb2ea0a149cf3278206ed52 not found: ID does not exist" Jul 14 23:23:49.193158 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.193138 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k"] Jul 14 23:23:49.197624 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:49.197605 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-37a8657d-openshift-default-59984f458f-g5t9k"] Jul 14 23:23:50.179711 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:50.179670 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73146612-346c-44a2-8470-d214ee0d9e33" path="/var/lib/kubelet/pods/73146612-346c-44a2-8470-d214ee0d9e33/volumes" Jul 14 23:23:53.686397 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:23:53.686361 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:24:02.784560 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:24:02.784520 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:24:19.583144 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:24:19.583059 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:25:25.597601 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:25:25.597548 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:25:42.280268 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:25:42.280231 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:26:47.092300 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:26:47.092263 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:28:21.689716 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:28:21.689679 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:28:30.981536 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:28:30.981498 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:28:42.787800 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:28:42.787761 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:29:03.379882 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:29:03.379801 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:29:43.285480 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:29:43.285439 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:29:56.493526 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:29:56.493491 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:30:12.088241 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:30:12.088202 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:30:29.679630 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:30:29.679550 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:31:26.993407 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:31:26.993368 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:31:40.880972 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:31:40.880934 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:32:29.382523 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:32:29.382487 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:32:40.188969 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:32:40.188932 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:32:51.565712 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:32:51.565675 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:33:02.387868 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:33:02.387828 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:33:17.187167 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:33:17.187127 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:33:32.490659 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:33:32.490618 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:33:42.381291 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:33:42.381246 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:34:08.082811 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:08.082770 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:34:28.890039 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:28.890000 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:34:32.322721 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.322686 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq"] Jul 14 23:34:32.323113 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.323094 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73146612-346c-44a2-8470-d214ee0d9e33" containerName="istio-proxy" Jul 14 23:34:32.323113 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.323105 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="73146612-346c-44a2-8470-d214ee0d9e33" containerName="istio-proxy" Jul 14 23:34:32.323216 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.323206 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="73146612-346c-44a2-8470-d214ee0d9e33" containerName="istio-proxy" Jul 14 23:34:32.323255 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.323218 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="73146612-346c-44a2-8470-d214ee0d9e33" containerName="istio-proxy" Jul 14 23:34:32.326792 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.326767 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:32.329036 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.329009 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a8299a-serving-cert\"" Jul 14 23:34:32.336402 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.336036 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq"] Jul 14 23:34:32.443969 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.443921 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-openshift-service-ca\") pod \"maas-api-e2e-api-b-a8299a-644d55474-5l9qq\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:32.444144 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.443980 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7tz9\" (UniqueName: \"kubernetes.io/projected/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-kube-api-access-b7tz9\") pod \"maas-api-e2e-api-b-a8299a-644d55474-5l9qq\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:32.444205 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.444157 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-maas-api-tls\") pod \"maas-api-e2e-api-b-a8299a-644d55474-5l9qq\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:32.545205 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.545166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-maas-api-tls\") pod \"maas-api-e2e-api-b-a8299a-644d55474-5l9qq\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:32.545430 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.545246 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-openshift-service-ca\") pod \"maas-api-e2e-api-b-a8299a-644d55474-5l9qq\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:32.545430 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.545281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7tz9\" (UniqueName: \"kubernetes.io/projected/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-kube-api-access-b7tz9\") pod \"maas-api-e2e-api-b-a8299a-644d55474-5l9qq\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:32.545430 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:34:32.545360 2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-serving-cert: secret "maas-api-e2e-api-b-a8299a-serving-cert" not found Jul 14 23:34:32.545583 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:34:32.545455 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-maas-api-tls podName:ebf8de98-eac9-4b1d-b18c-89d0a3c443cf nodeName:}" failed. No retries permitted until 2026-07-14 23:34:33.045433418 +0000 UTC m=+2227.477678377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-maas-api-tls") pod "maas-api-e2e-api-b-a8299a-644d55474-5l9qq" (UID: "ebf8de98-eac9-4b1d-b18c-89d0a3c443cf") : secret "maas-api-e2e-api-b-a8299a-serving-cert" not found Jul 14 23:34:32.545952 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.545932 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-openshift-service-ca\") pod \"maas-api-e2e-api-b-a8299a-644d55474-5l9qq\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:32.555289 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:32.555268 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7tz9\" (UniqueName: \"kubernetes.io/projected/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-kube-api-access-b7tz9\") pod \"maas-api-e2e-api-b-a8299a-644d55474-5l9qq\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:33.050381 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:33.050319 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-maas-api-tls\") pod \"maas-api-e2e-api-b-a8299a-644d55474-5l9qq\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:33.052684 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:33.052653 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-maas-api-tls\") pod \"maas-api-e2e-api-b-a8299a-644d55474-5l9qq\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:33.241723 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:33.241687 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:33.588516 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:33.588484 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq"] Jul 14 23:34:33.590912 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:34:33.590859 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf8de98_eac9_4b1d_b18c_89d0a3c443cf.slice/crio-e663c85c77667f5d735726ffe3563289cdc44d32b9eb3aa4fe9cdadaff834ffb WatchSource:0}: Error finding container e663c85c77667f5d735726ffe3563289cdc44d32b9eb3aa4fe9cdadaff834ffb: Status 404 returned error can't find the container with id e663c85c77667f5d735726ffe3563289cdc44d32b9eb3aa4fe9cdadaff834ffb Jul 14 23:34:33.592486 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:33.592465 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 23:34:34.460013 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:34.459976 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" event={"ID":"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf","Type":"ContainerStarted","Data":"189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61"} Jul 14 23:34:34.460225 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:34.460032 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" event={"ID":"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf","Type":"ContainerStarted","Data":"e663c85c77667f5d735726ffe3563289cdc44d32b9eb3aa4fe9cdadaff834ffb"} Jul 14 23:34:34.460225 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:34.460078 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:34.477021 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:34.476967 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" podStartSLOduration=2.113305742 podStartE2EDuration="2.476951846s" totalImagesPullingTime="363.646104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:34:34.474883717 +0000 UTC m=+2228.907128692" watchObservedRunningTime="2026-07-14 23:34:34.476951846 +0000 UTC m=+2228.909196869" Jul 14 23:34:39.781169 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:39.781131 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:34:40.471169 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:40.471140 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:34:59.082852 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:34:59.082773 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:35:21.418938 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.418899 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq"] Jul 14 23:35:21.419571 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.419172 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" podUID="ebf8de98-eac9-4b1d-b18c-89d0a3c443cf" containerName="maas-api" containerID="cri-o://189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61" gracePeriod=30 Jul 14 23:35:21.682961 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.682893 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:35:21.702989 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.702950 2568 generic.go:356] "Generic (PLEG): container finished" podID="ebf8de98-eac9-4b1d-b18c-89d0a3c443cf" containerID="189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61" exitCode=0 Jul 14 23:35:21.703155 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.703005 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" Jul 14 23:35:21.703155 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.703050 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" event={"ID":"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf","Type":"ContainerDied","Data":"189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61"} Jul 14 23:35:21.703155 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.703118 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq" event={"ID":"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf","Type":"ContainerDied","Data":"e663c85c77667f5d735726ffe3563289cdc44d32b9eb3aa4fe9cdadaff834ffb"} Jul 14 23:35:21.703155 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.703153 2568 scope.go:117] "RemoveContainer" containerID="189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61" Jul 14 23:35:21.712443 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.712418 2568 scope.go:117] "RemoveContainer" containerID="189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61" Jul 14 23:35:21.712759 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:35:21.712737 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61\": container with ID starting with 189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61 not found: ID does not exist" containerID="189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61" Jul 14 23:35:21.712827 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.712774 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61"} err="failed to get container status \"189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61\": rpc error: code = NotFound desc = could not find container \"189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61\": container with ID starting with 189a7ba96ce6edb0bb61893bf1aeac6837e51ad03ff1f744c76dc4430fc94e61 not found: ID does not exist" Jul 14 23:35:21.833234 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.833198 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7tz9\" (UniqueName: \"kubernetes.io/projected/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-kube-api-access-b7tz9\") pod \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " Jul 14 23:35:21.833444 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.833306 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-openshift-service-ca\") pod \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " Jul 14 23:35:21.833444 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.833373 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-maas-api-tls\") pod \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\" (UID: \"ebf8de98-eac9-4b1d-b18c-89d0a3c443cf\") " Jul 14 23:35:21.833689 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.833664 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ebf8de98-eac9-4b1d-b18c-89d0a3c443cf" (UID: "ebf8de98-eac9-4b1d-b18c-89d0a3c443cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:35:21.835539 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.835515 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-kube-api-access-b7tz9" (OuterVolumeSpecName: "kube-api-access-b7tz9") pod "ebf8de98-eac9-4b1d-b18c-89d0a3c443cf" (UID: "ebf8de98-eac9-4b1d-b18c-89d0a3c443cf"). InnerVolumeSpecName "kube-api-access-b7tz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:35:21.835633 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.835521 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ebf8de98-eac9-4b1d-b18c-89d0a3c443cf" (UID: "ebf8de98-eac9-4b1d-b18c-89d0a3c443cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 23:35:21.935091 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.934989 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7tz9\" (UniqueName: \"kubernetes.io/projected/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-kube-api-access-b7tz9\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:35:21.935091 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.935035 2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-openshift-service-ca\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:35:21.935091 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:21.935046 2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf-maas-api-tls\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:35:22.024425 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:22.024389 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq"] Jul 14 23:35:22.030361 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:22.030313 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8299a-644d55474-5l9qq"] Jul 14 23:35:22.170182 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:22.170146 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebf8de98-eac9-4b1d-b18c-89d0a3c443cf" path="/var/lib/kubelet/pods/ebf8de98-eac9-4b1d-b18c-89d0a3c443cf/volumes" Jul 14 23:35:24.783685 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:24.783646 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:35:46.085147 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:46.085105 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:35:54.698653 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:35:54.698613 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:36:07.189441 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:36:07.189400 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:36:23.883589 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:36:23.883504 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:36:39.984476 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:36:39.984438 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:36:58.780014 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:36:58.779977 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:37:12.889656 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:37:12.889614 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:37:32.195983 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:37:32.195944 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:37:47.189821 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:37:47.189781 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:38:03.783165 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:03.783123 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:38:21.987701 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:21.987658 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:38:28.792267 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.792225 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg"] Jul 14 23:38:28.792697 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.792644 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73146612-346c-44a2-8470-d214ee0d9e33" containerName="istio-proxy" Jul 14 23:38:28.792697 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.792658 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="73146612-346c-44a2-8470-d214ee0d9e33" containerName="istio-proxy" Jul 14 23:38:28.792697 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.792671 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebf8de98-eac9-4b1d-b18c-89d0a3c443cf" containerName="maas-api" Jul 14 23:38:28.792697 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.792677 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf8de98-eac9-4b1d-b18c-89d0a3c443cf" containerName="maas-api" Jul 14 23:38:28.792829 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.792755 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebf8de98-eac9-4b1d-b18c-89d0a3c443cf" containerName="maas-api" Jul 14 23:38:28.795979 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.795962 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.799541 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.799506 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d62786\"/\"default-dockercfg-mvxpj\"" Jul 14 23:38:28.799675 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.799507 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d62786\"/\"kube-root-ca.crt\"" Jul 14 23:38:28.799675 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.799595 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d62786\"/\"openshift-service-ca.crt\"" Jul 14 23:38:28.799675 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.799508 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d62786\"/\"sub-test-model-d62786-kserve-self-signed-certs\"" Jul 14 23:38:28.805784 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.805759 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg"] Jul 14 23:38:28.873612 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.873578 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-home\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.873794 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.873693 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-tmp-dir\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.873794 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.873738 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-dshm\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.873794 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.873758 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r6s4\" (UniqueName: \"kubernetes.io/projected/f45defad-ae25-40ec-9495-cc7d43aa2d20-kube-api-access-5r6s4\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.873794 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.873789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f45defad-ae25-40ec-9495-cc7d43aa2d20-tls-certs\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.873933 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.873843 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-model-cache\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.974764 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.974729 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-tmp-dir\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.974764 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.974772 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-dshm\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.975022 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.974790 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r6s4\" (UniqueName: \"kubernetes.io/projected/f45defad-ae25-40ec-9495-cc7d43aa2d20-kube-api-access-5r6s4\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.975022 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.974815 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f45defad-ae25-40ec-9495-cc7d43aa2d20-tls-certs\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.975022 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.974842 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-model-cache\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.975022 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.974906 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-home\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.975203 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.975124 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-tmp-dir\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.975298 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.975274 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-model-cache\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.975348 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.975297 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-home\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.977124 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.977096 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-dshm\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.977387 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.977367 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f45defad-ae25-40ec-9495-cc7d43aa2d20-tls-certs\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:28.982576 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:28.982555 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r6s4\" (UniqueName: \"kubernetes.io/projected/f45defad-ae25-40ec-9495-cc7d43aa2d20-kube-api-access-5r6s4\") pod \"sub-test-model-d62786-kserve-8467f97f9c-drhcg\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:29.106051 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:29.105956 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:29.244003 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:29.243970 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg"] Jul 14 23:38:29.245591 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:38:29.245568 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf45defad_ae25_40ec_9495_cc7d43aa2d20.slice/crio-54f6159a8fb4bef23261e138ee7f1183d3f5ad0041893d1acbb6585d18cd9792 WatchSource:0}: Error finding container 54f6159a8fb4bef23261e138ee7f1183d3f5ad0041893d1acbb6585d18cd9792: Status 404 returned error can't find the container with id 54f6159a8fb4bef23261e138ee7f1183d3f5ad0041893d1acbb6585d18cd9792 Jul 14 23:38:29.685394 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:29.685355 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" event={"ID":"f45defad-ae25-40ec-9495-cc7d43aa2d20","Type":"ContainerStarted","Data":"c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee"} Jul 14 23:38:29.685394 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:29.685399 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" event={"ID":"f45defad-ae25-40ec-9495-cc7d43aa2d20","Type":"ContainerStarted","Data":"54f6159a8fb4bef23261e138ee7f1183d3f5ad0041893d1acbb6585d18cd9792"} Jul 14 23:38:29.700663 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:29.700603 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" podStartSLOduration=1.700587422 podStartE2EDuration="1.700587422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:38:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:38:29.699932635 +0000 UTC m=+2464.132177608" watchObservedRunningTime="2026-07-14 23:38:29.700587422 +0000 UTC m=+2464.132832395" Jul 14 23:38:39.106864 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:39.106831 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:39.106864 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:39.106874 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:39.119469 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:39.119442 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:39.749221 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:39.749184 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:38:41.624627 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:38:41.624591 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:39:00.282849 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:00.282807 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:39:16.689416 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:16.689376 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:39:32.674822 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:32.674780 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg"] Jul 14 23:39:34.886588 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:34.886553 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:39:47.695737 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:47.695681 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" podUID="f45defad-ae25-40ec-9495-cc7d43aa2d20" containerName="main" containerID="cri-o://c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee" gracePeriod=45 Jul 14 23:39:47.958741 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:47.958674 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:39:48.081430 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.081397 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f45defad-ae25-40ec-9495-cc7d43aa2d20-tls-certs\") pod \"f45defad-ae25-40ec-9495-cc7d43aa2d20\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " Jul 14 23:39:48.081627 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.081470 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-home\") pod \"f45defad-ae25-40ec-9495-cc7d43aa2d20\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " Jul 14 23:39:48.081627 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.081551 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-tmp-dir\") pod \"f45defad-ae25-40ec-9495-cc7d43aa2d20\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " Jul 14 23:39:48.081627 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.081588 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r6s4\" (UniqueName: \"kubernetes.io/projected/f45defad-ae25-40ec-9495-cc7d43aa2d20-kube-api-access-5r6s4\") pod \"f45defad-ae25-40ec-9495-cc7d43aa2d20\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " Jul 14 23:39:48.081627 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.081617 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-model-cache\") pod \"f45defad-ae25-40ec-9495-cc7d43aa2d20\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " Jul 14 23:39:48.081846 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.081653 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-dshm\") pod \"f45defad-ae25-40ec-9495-cc7d43aa2d20\" (UID: \"f45defad-ae25-40ec-9495-cc7d43aa2d20\") " Jul 14 23:39:48.081846 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.081790 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f45defad-ae25-40ec-9495-cc7d43aa2d20" (UID: "f45defad-ae25-40ec-9495-cc7d43aa2d20"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:39:48.081967 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.081875 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-model-cache" (OuterVolumeSpecName: "model-cache") pod "f45defad-ae25-40ec-9495-cc7d43aa2d20" (UID: "f45defad-ae25-40ec-9495-cc7d43aa2d20"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:39:48.082079 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.081775 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-home" (OuterVolumeSpecName: "home") pod "f45defad-ae25-40ec-9495-cc7d43aa2d20" (UID: "f45defad-ae25-40ec-9495-cc7d43aa2d20"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:39:48.082159 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.082059 2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-tmp-dir\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:39:48.082159 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.082110 2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-model-cache\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:39:48.084141 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.084117 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f45defad-ae25-40ec-9495-cc7d43aa2d20-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f45defad-ae25-40ec-9495-cc7d43aa2d20" (UID: "f45defad-ae25-40ec-9495-cc7d43aa2d20"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 23:39:48.084141 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.084115 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-dshm" (OuterVolumeSpecName: "dshm") pod "f45defad-ae25-40ec-9495-cc7d43aa2d20" (UID: "f45defad-ae25-40ec-9495-cc7d43aa2d20"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:39:48.084279 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.084192 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f45defad-ae25-40ec-9495-cc7d43aa2d20-kube-api-access-5r6s4" (OuterVolumeSpecName: "kube-api-access-5r6s4") pod "f45defad-ae25-40ec-9495-cc7d43aa2d20" (UID: "f45defad-ae25-40ec-9495-cc7d43aa2d20"). InnerVolumeSpecName "kube-api-access-5r6s4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:39:48.088953 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.088929 2568 generic.go:356] "Generic (PLEG): container finished" podID="f45defad-ae25-40ec-9495-cc7d43aa2d20" containerID="c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee" exitCode=0 Jul 14 23:39:48.089060 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.088969 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" Jul 14 23:39:48.089060 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.089021 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" event={"ID":"f45defad-ae25-40ec-9495-cc7d43aa2d20","Type":"ContainerDied","Data":"c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee"} Jul 14 23:39:48.089144 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.089062 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg" event={"ID":"f45defad-ae25-40ec-9495-cc7d43aa2d20","Type":"ContainerDied","Data":"54f6159a8fb4bef23261e138ee7f1183d3f5ad0041893d1acbb6585d18cd9792"} Jul 14 23:39:48.090193 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.089085 2568 scope.go:117] "RemoveContainer" containerID="c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee" Jul 14 23:39:48.107268 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.107242 2568 scope.go:117] "RemoveContainer" containerID="c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee" Jul 14 23:39:48.107617 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:39:48.107599 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee\": container with ID starting with c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee not found: ID does not exist" containerID="c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee" Jul 14 23:39:48.107675 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.107631 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee"} err="failed to get container status \"c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee\": rpc error: code = NotFound desc = could not find container \"c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee\": container with ID starting with c94b166e66f07f49c51c28db20a25d0e5c54f6820b78154f1b458fe924c69eee not found: ID does not exist" Jul 14 23:39:48.115179 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.115150 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg"] Jul 14 23:39:48.119118 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.119095 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d62786/sub-test-model-d62786-kserve-8467f97f9c-drhcg"] Jul 14 23:39:48.170994 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.170960 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f45defad-ae25-40ec-9495-cc7d43aa2d20" path="/var/lib/kubelet/pods/f45defad-ae25-40ec-9495-cc7d43aa2d20/volumes" Jul 14 23:39:48.182688 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.182660 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f45defad-ae25-40ec-9495-cc7d43aa2d20-tls-certs\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:39:48.182688 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.182683 2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-home\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:39:48.182838 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.182693 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r6s4\" (UniqueName: \"kubernetes.io/projected/f45defad-ae25-40ec-9495-cc7d43aa2d20-kube-api-access-5r6s4\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:39:48.182838 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:48.182703 2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f45defad-ae25-40ec-9495-cc7d43aa2d20-dshm\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:39:54.890679 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:39:54.890638 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:40:26.789552 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.789511 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj"] Jul 14 23:40:26.789997 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.789977 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f45defad-ae25-40ec-9495-cc7d43aa2d20" containerName="main" Jul 14 23:40:26.790065 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.790000 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f45defad-ae25-40ec-9495-cc7d43aa2d20" containerName="main" Jul 14 23:40:26.790178 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.790162 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f45defad-ae25-40ec-9495-cc7d43aa2d20" containerName="main" Jul 14 23:40:26.794426 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.794406 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:26.797303 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.797268 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-638b58\"/\"openshift-service-ca.crt\"" Jul 14 23:40:26.797492 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.797268 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-638b58\"/\"rate-test-model-638b58-kserve-self-signed-certs\"" Jul 14 23:40:26.797613 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.797479 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-638b58\"/\"default-dockercfg-xvhb8\"" Jul 14 23:40:26.797946 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.797926 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-638b58\"/\"kube-root-ca.crt\"" Jul 14 23:40:26.804438 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.804412 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj"] Jul 14 23:40:26.964717 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.964678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-dshm\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:26.964904 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.964807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-home\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:26.964904 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.964855 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-model-cache\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:26.964990 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.964908 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf959c00-b610-47b8-af3a-2f6559999abe-tls-certs\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:26.964990 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.964940 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2qdh\" (UniqueName: \"kubernetes.io/projected/bf959c00-b610-47b8-af3a-2f6559999abe-kube-api-access-n2qdh\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:26.964990 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:26.964983 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-tmp-dir\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.066671 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.066571 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-tmp-dir\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.066671 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.066628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-dshm\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.066886 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.066680 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-home\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.066886 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.066700 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-model-cache\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.066886 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.066748 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf959c00-b610-47b8-af3a-2f6559999abe-tls-certs\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.066886 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.066777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2qdh\" (UniqueName: \"kubernetes.io/projected/bf959c00-b610-47b8-af3a-2f6559999abe-kube-api-access-n2qdh\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.067137 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.067089 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-tmp-dir\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.067256 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.067220 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-home\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.067256 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.067238 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-model-cache\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.069001 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.068979 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-dshm\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.069243 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.069223 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf959c00-b610-47b8-af3a-2f6559999abe-tls-certs\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.075453 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.075425 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2qdh\" (UniqueName: \"kubernetes.io/projected/bf959c00-b610-47b8-af3a-2f6559999abe-kube-api-access-n2qdh\") pod \"rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.107695 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.107656 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:27.248299 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.248229 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj"] Jul 14 23:40:27.250882 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:40:27.250850 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf959c00_b610_47b8_af3a_2f6559999abe.slice/crio-3010afbecdd2b7f6428700976fd497e0bb024755a21dc49e40b831458267af11 WatchSource:0}: Error finding container 3010afbecdd2b7f6428700976fd497e0bb024755a21dc49e40b831458267af11: Status 404 returned error can't find the container with id 3010afbecdd2b7f6428700976fd497e0bb024755a21dc49e40b831458267af11 Jul 14 23:40:27.292606 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:27.292575 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" event={"ID":"bf959c00-b610-47b8-af3a-2f6559999abe","Type":"ContainerStarted","Data":"3010afbecdd2b7f6428700976fd497e0bb024755a21dc49e40b831458267af11"} Jul 14 23:40:28.299351 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:28.299291 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" event={"ID":"bf959c00-b610-47b8-af3a-2f6559999abe","Type":"ContainerStarted","Data":"c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1"} Jul 14 23:40:28.318256 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:28.318183 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" podStartSLOduration=2.318166323 podStartE2EDuration="2.318166323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:40:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:40:28.316943782 +0000 UTC m=+2582.749188759" watchObservedRunningTime="2026-07-14 23:40:28.318166323 +0000 UTC m=+2582.750411297" Jul 14 23:40:32.193553 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:32.193511 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:40:37.108142 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:37.108097 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:37.108566 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:37.108184 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:37.122327 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:37.122295 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:37.356817 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:37.356781 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:40:47.387847 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:40:47.387802 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:41:03.095003 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:03.094961 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:41:11.282284 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:11.282248 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj"] Jul 14 23:41:17.286909 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:17.286869 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:41:26.303362 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.303284 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" podUID="bf959c00-b610-47b8-af3a-2f6559999abe" containerName="main" containerID="cri-o://c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1" gracePeriod=45 Jul 14 23:41:26.569082 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.569011 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:41:26.596518 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.596486 2568 generic.go:356] "Generic (PLEG): container finished" podID="bf959c00-b610-47b8-af3a-2f6559999abe" containerID="c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1" exitCode=0 Jul 14 23:41:26.596676 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.596540 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" Jul 14 23:41:26.596676 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.596541 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" event={"ID":"bf959c00-b610-47b8-af3a-2f6559999abe","Type":"ContainerDied","Data":"c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1"} Jul 14 23:41:26.596676 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.596650 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj" event={"ID":"bf959c00-b610-47b8-af3a-2f6559999abe","Type":"ContainerDied","Data":"3010afbecdd2b7f6428700976fd497e0bb024755a21dc49e40b831458267af11"} Jul 14 23:41:26.596676 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.596670 2568 scope.go:117] "RemoveContainer" containerID="c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1" Jul 14 23:41:26.606495 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.606473 2568 scope.go:117] "RemoveContainer" containerID="c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1" Jul 14 23:41:26.606811 ip-10-0-136-11 kubenswrapper[2568]: E0714 23:41:26.606778 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1\": container with ID starting with c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1 not found: ID does not exist" containerID="c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1" Jul 14 23:41:26.606883 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.606824 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1"} err="failed to get container status \"c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1\": rpc error: code = NotFound desc = could not find container \"c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1\": container with ID starting with c226a09a4aec489d46dc68ce336685218bf1a156ba3b4e250716cc302057cbe1 not found: ID does not exist" Jul 14 23:41:26.663325 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663274 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-model-cache\") pod \"bf959c00-b610-47b8-af3a-2f6559999abe\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " Jul 14 23:41:26.663325 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663359 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-home\") pod \"bf959c00-b610-47b8-af3a-2f6559999abe\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " Jul 14 23:41:26.663569 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663418 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-tmp-dir\") pod \"bf959c00-b610-47b8-af3a-2f6559999abe\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " Jul 14 23:41:26.663569 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663444 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf959c00-b610-47b8-af3a-2f6559999abe-tls-certs\") pod \"bf959c00-b610-47b8-af3a-2f6559999abe\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " Jul 14 23:41:26.663569 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663474 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2qdh\" (UniqueName: \"kubernetes.io/projected/bf959c00-b610-47b8-af3a-2f6559999abe-kube-api-access-n2qdh\") pod \"bf959c00-b610-47b8-af3a-2f6559999abe\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " Jul 14 23:41:26.663569 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663532 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-dshm\") pod \"bf959c00-b610-47b8-af3a-2f6559999abe\" (UID: \"bf959c00-b610-47b8-af3a-2f6559999abe\") " Jul 14 23:41:26.663771 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663630 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-model-cache" (OuterVolumeSpecName: "model-cache") pod "bf959c00-b610-47b8-af3a-2f6559999abe" (UID: "bf959c00-b610-47b8-af3a-2f6559999abe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:41:26.663771 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663655 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-home" (OuterVolumeSpecName: "home") pod "bf959c00-b610-47b8-af3a-2f6559999abe" (UID: "bf959c00-b610-47b8-af3a-2f6559999abe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:41:26.663771 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663692 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bf959c00-b610-47b8-af3a-2f6559999abe" (UID: "bf959c00-b610-47b8-af3a-2f6559999abe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:41:26.663917 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663838 2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-tmp-dir\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:41:26.663917 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663852 2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-model-cache\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:41:26.663917 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.663862 2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-home\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:41:26.665808 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.665774 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf959c00-b610-47b8-af3a-2f6559999abe-kube-api-access-n2qdh" (OuterVolumeSpecName: "kube-api-access-n2qdh") pod "bf959c00-b610-47b8-af3a-2f6559999abe" (UID: "bf959c00-b610-47b8-af3a-2f6559999abe"). InnerVolumeSpecName "kube-api-access-n2qdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:41:26.665808 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.665797 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-dshm" (OuterVolumeSpecName: "dshm") pod "bf959c00-b610-47b8-af3a-2f6559999abe" (UID: "bf959c00-b610-47b8-af3a-2f6559999abe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:41:26.665808 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.665802 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf959c00-b610-47b8-af3a-2f6559999abe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bf959c00-b610-47b8-af3a-2f6559999abe" (UID: "bf959c00-b610-47b8-af3a-2f6559999abe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 23:41:26.764923 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.764877 2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf959c00-b610-47b8-af3a-2f6559999abe-dshm\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:41:26.764923 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.764914 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf959c00-b610-47b8-af3a-2f6559999abe-tls-certs\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:41:26.764923 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.764925 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2qdh\" (UniqueName: \"kubernetes.io/projected/bf959c00-b610-47b8-af3a-2f6559999abe-kube-api-access-n2qdh\") on node \"ip-10-0-136-11.ec2.internal\" DevicePath \"\"" Jul 14 23:41:26.917738 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.917704 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj"] Jul 14 23:41:26.924225 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:26.924191 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-638b58/rate-test-model-638b58-kserve-65bb5fd9c9-5l5sj"] Jul 14 23:41:28.169607 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:28.169572 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf959c00-b610-47b8-af3a-2f6559999abe" path="/var/lib/kubelet/pods/bf959c00-b610-47b8-af3a-2f6559999abe/volumes" Jul 14 23:41:44.680675 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:41:44.680636 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:42:10.489720 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:10.489684 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n785w"] Jul 14 23:42:28.818828 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:28.818782 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-shwnx_3313f414-8d4a-45e0-94f6-918f58296f9e/manager/0.log" Jul 14 23:42:28.940820 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:28.940784 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f5gc4_a7f13493-226f-4448-8f80-7dba1f6cccfc/manager/0.log" Jul 14 23:42:29.417860 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:29.417830 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756c8cff-dxhl4_78b1674a-115b-4215-b6e1-9e6a731df465/copy-manifests/0.log" Jul 14 23:42:29.425322 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:29.425292 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756c8cff-dxhl4_78b1674a-115b-4215-b6e1-9e6a731df465/manager/0.log" Jul 14 23:42:30.049160 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:30.049126 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5b595b8c88-qr4hv_61176b07-0550-4e5d-88d2-abb598b18258/maas-api/0.log" Jul 14 23:42:33.361215 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:33.361179 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c9fpg_5fc4a10c-628e-4b86-9dc1-b03a4f1b0858/manager/0.log" Jul 14 23:42:33.823514 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:33.823481 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n785w_f2e5a12c-056f-4919-b92a-34b66ad1c520/limitador/0.log" Jul 14 23:42:33.945225 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:33.945184 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g2fs8_bea4a69f-e69d-487e-897c-c3a8ccd3d355/manager/0.log" Jul 14 23:42:34.312463 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:34.312410 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dhkfr_7f1a043c-4f8c-4811-8ebe-79e34cd0721a/istio-proxy/0.log" Jul 14 23:42:34.783620 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:34.783581 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hj2hm_23a66917-15a7-4bd4-afb9-08c96f879cea/istio-proxy/1.log" Jul 14 23:42:35.810545 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:35.810504 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrn89p_b5e9ce48-90d4-4162-a47c-501b153cce0d/main/0.log" Jul 14 23:42:35.929016 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:35.928988 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cx58m_a557a171-de00-4c4c-b78d-b4d0427362aa/main/0.log" Jul 14 23:42:36.041620 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:36.041580 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-99nj9_4b0592ab-849f-42ec-86a6-aa312572d610/main/0.log" Jul 14 23:42:45.474816 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:45.474776 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7tk8s_917de4b2-08fe-4ab6-ba15-69da63fa81cc/global-pull-secret-syncer/0.log" Jul 14 23:42:45.640013 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:45.639981 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7ggdn_d50c911c-c8a1-49e8-9636-a62f3a2c9ff1/konnectivity-agent/0.log" Jul 14 23:42:45.753711 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:45.753623 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-11.ec2.internal_0a51735bdb7a0293d22b75abc2bc9c15/haproxy/0.log" Jul 14 23:42:51.366395 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:51.366363 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c9fpg_5fc4a10c-628e-4b86-9dc1-b03a4f1b0858/manager/0.log" Jul 14 23:42:51.601555 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:51.601456 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n785w_f2e5a12c-056f-4919-b92a-34b66ad1c520/limitador/0.log" Jul 14 23:42:51.718048 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:51.718005 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g2fs8_bea4a69f-e69d-487e-897c-c3a8ccd3d355/manager/0.log" Jul 14 23:42:53.371687 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.371654 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_912f2140-cde4-4348-8bce-cdb97e4d9830/alertmanager/0.log" Jul 14 23:42:53.400781 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.400741 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_912f2140-cde4-4348-8bce-cdb97e4d9830/config-reloader/0.log" Jul 14 23:42:53.428090 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.428055 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_912f2140-cde4-4348-8bce-cdb97e4d9830/kube-rbac-proxy-web/0.log" Jul 14 23:42:53.450744 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.450715 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_912f2140-cde4-4348-8bce-cdb97e4d9830/kube-rbac-proxy/0.log" Jul 14 23:42:53.473899 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.473872 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_912f2140-cde4-4348-8bce-cdb97e4d9830/kube-rbac-proxy-metric/0.log" Jul 14 23:42:53.496913 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.496879 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_912f2140-cde4-4348-8bce-cdb97e4d9830/prom-label-proxy/0.log" Jul 14 23:42:53.520043 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.519964 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_912f2140-cde4-4348-8bce-cdb97e4d9830/init-config-reloader/0.log" Jul 14 23:42:53.591560 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.591527 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9g6bm_f9e4cadc-0df3-46e3-86d1-b44a37d2a358/kube-state-metrics/0.log" Jul 14 23:42:53.608634 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.608596 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9g6bm_f9e4cadc-0df3-46e3-86d1-b44a37d2a358/kube-rbac-proxy-main/0.log" Jul 14 23:42:53.631733 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.631702 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9g6bm_f9e4cadc-0df3-46e3-86d1-b44a37d2a358/kube-rbac-proxy-self/0.log" Jul 14 23:42:53.659184 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.659157 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-857b87c496-bqx4r_0868b932-2703-4b76-b5cb-871b5a278ddd/metrics-server/0.log" Jul 14 23:42:53.687420 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.687388 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-ghfvt_c5198eff-383d-4529-ac68-128b6449de91/monitoring-plugin/0.log" Jul 14 23:42:53.796003 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.795926 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d92mj_2cd554f0-2f94-4fa3-b9b5-b6084ab5b882/node-exporter/0.log" Jul 14 23:42:53.822587 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.822549 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d92mj_2cd554f0-2f94-4fa3-b9b5-b6084ab5b882/kube-rbac-proxy/0.log" Jul 14 23:42:53.844836 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.844808 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d92mj_2cd554f0-2f94-4fa3-b9b5-b6084ab5b882/init-textfile/0.log" Jul 14 23:42:53.949148 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.949119 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-6h4j9_94d2ff34-d6d3-42c9-a4da-07739b4b044b/kube-rbac-proxy-main/0.log" Jul 14 23:42:53.973466 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.973436 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-6h4j9_94d2ff34-d6d3-42c9-a4da-07739b4b044b/kube-rbac-proxy-self/0.log" Jul 14 23:42:53.998938 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:53.998912 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-6h4j9_94d2ff34-d6d3-42c9-a4da-07739b4b044b/openshift-state-metrics/0.log" Jul 14 23:42:54.041706 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.041675 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9160e848-b452-451c-a124-04966eda11ea/prometheus/0.log" Jul 14 23:42:54.063550 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.063464 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9160e848-b452-451c-a124-04966eda11ea/config-reloader/0.log" Jul 14 23:42:54.085824 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.085795 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9160e848-b452-451c-a124-04966eda11ea/thanos-sidecar/0.log" Jul 14 23:42:54.106609 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.106577 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9160e848-b452-451c-a124-04966eda11ea/kube-rbac-proxy-web/0.log" Jul 14 23:42:54.127557 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.127528 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9160e848-b452-451c-a124-04966eda11ea/kube-rbac-proxy/0.log" Jul 14 23:42:54.147719 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.147689 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9160e848-b452-451c-a124-04966eda11ea/kube-rbac-proxy-thanos/0.log" Jul 14 23:42:54.170873 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.170844 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9160e848-b452-451c-a124-04966eda11ea/init-config-reloader/0.log" Jul 14 23:42:54.202113 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.202079 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-sxwsk_d3444b25-996f-415b-a17c-3abaf6faa1d3/prometheus-operator/0.log" Jul 14 23:42:54.221927 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.221899 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-sxwsk_d3444b25-996f-415b-a17c-3abaf6faa1d3/kube-rbac-proxy/0.log" Jul 14 23:42:54.248320 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.248290 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-7zw92_5359541d-20fb-4248-905f-b2cd92f46f2a/prometheus-operator-admission-webhook/0.log" Jul 14 23:42:54.369410 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.369303 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbf874d4c-8qhr8_e9e51057-3e09-4eb6-ad40-42ac49270d99/thanos-query/0.log" Jul 14 23:42:54.390533 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.390487 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbf874d4c-8qhr8_e9e51057-3e09-4eb6-ad40-42ac49270d99/kube-rbac-proxy-web/0.log" Jul 14 23:42:54.416054 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.416019 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbf874d4c-8qhr8_e9e51057-3e09-4eb6-ad40-42ac49270d99/kube-rbac-proxy/0.log" Jul 14 23:42:54.439185 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.439158 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbf874d4c-8qhr8_e9e51057-3e09-4eb6-ad40-42ac49270d99/prom-label-proxy/0.log" Jul 14 23:42:54.464588 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.464548 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbf874d4c-8qhr8_e9e51057-3e09-4eb6-ad40-42ac49270d99/kube-rbac-proxy-rules/0.log" Jul 14 23:42:54.488498 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:54.488463 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbf874d4c-8qhr8_e9e51057-3e09-4eb6-ad40-42ac49270d99/kube-rbac-proxy-metrics/0.log" Jul 14 23:42:55.349023 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.348986 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65"] Jul 14 23:42:55.349427 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.349413 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf959c00-b610-47b8-af3a-2f6559999abe" containerName="main" Jul 14 23:42:55.349427 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.349428 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf959c00-b610-47b8-af3a-2f6559999abe" containerName="main" Jul 14 23:42:55.349520 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.349502 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf959c00-b610-47b8-af3a-2f6559999abe" containerName="main" Jul 14 23:42:55.352977 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.352954 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.355114 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.355087 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hkhmk\"/\"openshift-service-ca.crt\"" Jul 14 23:42:55.355608 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.355588 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hkhmk\"/\"kube-root-ca.crt\"" Jul 14 23:42:55.355669 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.355588 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hkhmk\"/\"default-dockercfg-jtt7v\"" Jul 14 23:42:55.360770 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.360745 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65"] Jul 14 23:42:55.460197 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.460150 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-podres\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.460639 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.460236 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-sys\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.460639 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.460261 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-lib-modules\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.460639 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.460316 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhwns\" (UniqueName: \"kubernetes.io/projected/0ed7b341-644d-4901-8cc5-a9ab2aecc458-kube-api-access-qhwns\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.460639 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.460402 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-proc\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.561602 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.561559 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhwns\" (UniqueName: \"kubernetes.io/projected/0ed7b341-644d-4901-8cc5-a9ab2aecc458-kube-api-access-qhwns\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.561602 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.561609 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-proc\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.561817 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.561657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-podres\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.561817 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.561717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-sys\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.561817 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.561759 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-lib-modules\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.561817 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.561773 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-proc\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.561949 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.561824 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-podres\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.561949 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.561857 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-sys\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.561949 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.561888 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ed7b341-644d-4901-8cc5-a9ab2aecc458-lib-modules\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.570592 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.570557 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhwns\" (UniqueName: \"kubernetes.io/projected/0ed7b341-644d-4901-8cc5-a9ab2aecc458-kube-api-access-qhwns\") pod \"perf-node-gather-daemonset-87f65\" (UID: \"0ed7b341-644d-4901-8cc5-a9ab2aecc458\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.664404 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.664361 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:55.803422 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:55.803397 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65"] Jul 14 23:42:55.805839 ip-10-0-136-11 kubenswrapper[2568]: W0714 23:42:55.805818 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0ed7b341_644d_4901_8cc5_a9ab2aecc458.slice/crio-4f9ce36cfd67703957aa64b0ed7f68c7d02db7b130a0d4112651d93fc3c93ea9 WatchSource:0}: Error finding container 4f9ce36cfd67703957aa64b0ed7f68c7d02db7b130a0d4112651d93fc3c93ea9: Status 404 returned error can't find the container with id 4f9ce36cfd67703957aa64b0ed7f68c7d02db7b130a0d4112651d93fc3c93ea9 Jul 14 23:42:56.061974 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:56.061929 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" event={"ID":"0ed7b341-644d-4901-8cc5-a9ab2aecc458","Type":"ContainerStarted","Data":"67399428b27b35923931233e30d784832fd2e7c310acd153bd3b0c35eaaacae7"} Jul 14 23:42:56.062180 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:56.061988 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" event={"ID":"0ed7b341-644d-4901-8cc5-a9ab2aecc458","Type":"ContainerStarted","Data":"4f9ce36cfd67703957aa64b0ed7f68c7d02db7b130a0d4112651d93fc3c93ea9"} Jul 14 23:42:56.062180 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:56.062012 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:42:56.076957 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:56.076904 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" podStartSLOduration=1.076888473 podStartE2EDuration="1.076888473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 23:42:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:42:56.075771687 +0000 UTC m=+2730.508016672" watchObservedRunningTime="2026-07-14 23:42:56.076888473 +0000 UTC m=+2730.509133447" Jul 14 23:42:58.452055 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:58.452022 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kc5rv_0ebfe428-93a5-4958-91d4-5c8d6110a4a8/dns/0.log" Jul 14 23:42:58.473346 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:58.473304 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kc5rv_0ebfe428-93a5-4958-91d4-5c8d6110a4a8/kube-rbac-proxy/0.log" Jul 14 23:42:58.600184 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:58.600156 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7dpvq_fc0ef685-669f-4c4e-a941-a9fd9e20765f/dns-node-resolver/0.log" Jul 14 23:42:59.209457 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:42:59.209409 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bzgjx_116ae59c-ca9a-4cb0-ae05-384d0d6ba864/node-ca/0.log" Jul 14 23:43:00.151102 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:00.151073 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dhkfr_7f1a043c-4f8c-4811-8ebe-79e34cd0721a/istio-proxy/0.log" Jul 14 23:43:00.338281 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:00.338235 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hj2hm_23a66917-15a7-4bd4-afb9-08c96f879cea/istio-proxy/0.log" Jul 14 23:43:00.396042 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:00.396005 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hj2hm_23a66917-15a7-4bd4-afb9-08c96f879cea/istio-proxy/1.log" Jul 14 23:43:01.182757 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:01.182724 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w979j_cabc20f3-751e-4433-9dd3-a1a5b248cefe/serve-healthcheck-canary/0.log" Jul 14 23:43:01.719124 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:01.719091 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9kd6n_7e6bda43-eac3-4a28-8eae-73cb9f3a6bca/kube-rbac-proxy/0.log" Jul 14 23:43:01.741072 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:01.741034 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9kd6n_7e6bda43-eac3-4a28-8eae-73cb9f3a6bca/exporter/0.log" Jul 14 23:43:01.762732 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:01.762703 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9kd6n_7e6bda43-eac3-4a28-8eae-73cb9f3a6bca/extractor/0.log" Jul 14 23:43:02.079165 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:02.079088 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-87f65" Jul 14 23:43:04.046119 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:04.046092 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-shwnx_3313f414-8d4a-45e0-94f6-918f58296f9e/manager/0.log" Jul 14 23:43:04.295687 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:04.295579 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f5gc4_a7f13493-226f-4448-8f80-7dba1f6cccfc/manager/0.log" Jul 14 23:43:04.544207 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:04.544162 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756c8cff-dxhl4_78b1674a-115b-4215-b6e1-9e6a731df465/manager/0.log" Jul 14 23:43:04.565881 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:04.565799 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756c8cff-dxhl4_78b1674a-115b-4215-b6e1-9e6a731df465/copy-manifests/0.log" Jul 14 23:43:06.030294 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:06.030258 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dhkfr_7f1a043c-4f8c-4811-8ebe-79e34cd0721a/istio-proxy/0.log" Jul 14 23:43:06.095723 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:06.095688 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86f675f86-scz9n_5fe690c4-ea19-43f5-8d36-6cf9c37aad2a/manager/0.log" Jul 14 23:43:06.123385 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:06.123306 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-n87xt_32710897-bc42-424a-97ca-76d9801f867c/openshift-lws-operator/0.log" Jul 14 23:43:06.190557 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:06.190511 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hj2hm_23a66917-15a7-4bd4-afb9-08c96f879cea/istio-proxy/0.log" Jul 14 23:43:06.247869 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:06.247825 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hj2hm_23a66917-15a7-4bd4-afb9-08c96f879cea/istio-proxy/1.log" Jul 14 23:43:07.556873 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:07.556828 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dhkfr_7f1a043c-4f8c-4811-8ebe-79e34cd0721a/istio-proxy/0.log" Jul 14 23:43:07.712765 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:07.712678 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hj2hm_23a66917-15a7-4bd4-afb9-08c96f879cea/istio-proxy/0.log" Jul 14 23:43:07.777840 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:07.777807 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hj2hm_23a66917-15a7-4bd4-afb9-08c96f879cea/istio-proxy/1.log" Jul 14 23:43:12.436314 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:12.436277 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4zvr_75e2573c-b255-4b0f-8879-cc5825e6d7c6/kube-multus-additional-cni-plugins/0.log" Jul 14 23:43:12.460461 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:12.460424 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4zvr_75e2573c-b255-4b0f-8879-cc5825e6d7c6/egress-router-binary-copy/0.log" Jul 14 23:43:12.483349 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:12.483305 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4zvr_75e2573c-b255-4b0f-8879-cc5825e6d7c6/cni-plugins/0.log" Jul 14 23:43:12.503840 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:12.503804 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4zvr_75e2573c-b255-4b0f-8879-cc5825e6d7c6/bond-cni-plugin/0.log" Jul 14 23:43:12.525404 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:12.525374 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4zvr_75e2573c-b255-4b0f-8879-cc5825e6d7c6/routeoverride-cni/0.log" Jul 14 23:43:12.548851 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:12.548824 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4zvr_75e2573c-b255-4b0f-8879-cc5825e6d7c6/whereabouts-cni-bincopy/0.log" Jul 14 23:43:12.570390 ip-10-0-136-11 kubenswrapper[2568]: I0714 23:43:12.570362 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4zvr_75e2573c-b255-4b0f-8879-cc5825e6d7c6/whereabouts-cni/0.log"