Jul 09 14:53:09.271010 ip-10-0-128-136 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 14:53:09.271027 ip-10-0-128-136 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 14:53:09.271036 ip-10-0-128-136 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 14:53:09.271364 ip-10-0-128-136 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 14:53:19.519947 ip-10-0-128-136 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 14:53:19.519962 ip-10-0-128-136 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b05f33c995b84f2aa72745773b989a18 -- Jul 09 14:55:17.544773 ip-10-0-128-136 systemd[1]: Starting Kubernetes Kubelet... Jul 09 14:55:17.992958 ip-10-0-128-136 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:55:17.992958 ip-10-0-128-136 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 14:55:17.992958 ip-10-0-128-136 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:55:17.992958 ip-10-0-128-136 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 14:55:17.992958 ip-10-0-128-136 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:55:17.993714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:17.992974 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 14:55:18.002760 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002742 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:18.002760 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002761 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002766 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002770 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002773 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002777 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002780 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002783 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002785 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002788 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002791 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002802 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002804 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002807 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002811 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002815 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002818 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002821 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002823 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002827 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:18.002868 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002830 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002833 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002835 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002838 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002840 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002843 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002846 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002849 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002851 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002854 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002856 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002859 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002861 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002864 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002866 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002870 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002873 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002875 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002878 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002881 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:18.003369 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002883 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002886 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002888 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002894 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002897 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002900 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002902 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002905 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002907 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002910 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002912 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002915 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002919 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002921 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002924 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002926 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002929 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002931 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002933 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:18.004114 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002936 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002938 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002941 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002943 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002945 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002947 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002950 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002953 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002955 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002958 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002960 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002963 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002966 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002969 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002971 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002973 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002976 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002979 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002981 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:18.004592 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002985 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002988 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002991 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002994 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002996 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.002999 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003001 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003004 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003006 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003008 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003011 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003013 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003016 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003019 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003023 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003026 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003028 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003031 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003033 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003037 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:18.005055 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.003039 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:18.005874 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005857 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:18.005874 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005873 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005877 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005880 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005884 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005886 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005889 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005892 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005895 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005897 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005900 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005902 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005905 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005907 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005910 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005912 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005915 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005918 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005920 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005923 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:18.005925 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005925 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005928 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005931 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005934 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005937 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005939 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005942 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005944 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005947 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005949 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005951 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005954 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005956 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005959 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005962 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005964 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005967 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005969 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005971 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005974 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:18.006419 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005976 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005978 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005981 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005985 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005990 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005992 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005995 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.005998 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006001 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006004 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006007 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006009 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006012 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006014 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006019 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006022 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006025 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006028 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006031 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:18.006907 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006033 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006036 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006038 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006041 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006044 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006046 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006049 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006051 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006054 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006056 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006059 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006061 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006063 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006066 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006068 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006070 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006073 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006075 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006078 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006080 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006083 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:18.007379 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006085 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006088 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006090 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006094 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006097 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006099 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006102 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006104 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006107 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006110 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006112 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006115 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006119 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006123 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006126 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006128 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006131 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006133 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006136 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:18.007904 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006509 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006514 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006517 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006519 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006522 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006525 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006528 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006530 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006533 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006536 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006538 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006541 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006543 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006546 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006549 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006551 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006554 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006557 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006559 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006563 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:18.008363 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006565 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006567 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006570 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006572 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006574 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006577 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006579 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006581 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006584 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006586 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006589 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006591 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006593 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006596 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006598 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006600 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006603 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006605 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006608 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006612 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:18.008863 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006615 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006618 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006620 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006623 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006626 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006628 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006632 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006635 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006638 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006642 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006645 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006648 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006651 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006654 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006656 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006659 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006661 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006664 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006666 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006668 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:18.009342 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006671 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006673 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006675 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006678 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006680 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006682 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006685 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006687 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006689 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006692 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006694 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006697 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006699 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006702 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006704 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006708 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006710 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006713 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006715 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006719 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:18.009828 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006722 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006725 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006728 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006731 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006733 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006736 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006738 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006741 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006743 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006745 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006748 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006750 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006752 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006755 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006757 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006760 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006762 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006764 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.006767 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006835 2584 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 14:55:18.010310 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006842 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006847 2584 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006852 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006855 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006858 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006862 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006866 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006869 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006872 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006876 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006879 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006881 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006884 2584 flags.go:64] FLAG: --cgroup-root="" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006887 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006889 2584 flags.go:64] FLAG: --client-ca-file="" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006893 2584 flags.go:64] FLAG: --cloud-provider="external" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006896 2584 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006900 2584 flags.go:64] FLAG: --cluster-domain="" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006903 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006906 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006909 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006913 2584 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006920 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 14:55:18.010800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006923 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006926 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006929 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006932 2584 flags.go:64] FLAG: --contention-profiling="false" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006935 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006938 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006941 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006943 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006947 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006950 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006953 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006955 2584 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006958 2584 flags.go:64] FLAG: --enable-server="true" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006961 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006965 2584 flags.go:64] FLAG: --event-burst="100" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006968 2584 flags.go:64] FLAG: --event-qps="50" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006970 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006973 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006976 2584 flags.go:64] FLAG: --eviction-hard="" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006979 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006982 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006985 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006988 2584 flags.go:64] FLAG: --eviction-soft="" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006990 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006995 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 14:55:18.011369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.006999 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007002 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007005 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007007 2584 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007010 2584 flags.go:64] FLAG: --feature-gates="" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007013 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007016 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007019 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007022 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007025 2584 flags.go:64] FLAG: --healthz-port="10248" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007028 2584 flags.go:64] FLAG: --help="false" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007031 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007034 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007036 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007039 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007042 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007046 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007049 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007051 2584 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007054 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007057 2584 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007061 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007064 2584 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007067 2584 flags.go:64] FLAG: --kube-reserved="" Jul 09 14:55:18.012083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007070 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007072 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007075 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007078 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007081 2584 flags.go:64] FLAG: --lock-file="" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007083 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007086 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007090 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007095 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007098 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007101 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007104 2584 flags.go:64] FLAG: --logging-format="text" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007107 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007110 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007113 2584 flags.go:64] FLAG: --manifest-url="" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007116 2584 flags.go:64] FLAG: --manifest-url-header="" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007120 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007123 2584 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007126 2584 flags.go:64] FLAG: --max-pods="110" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007129 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007132 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007135 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007137 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007140 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007144 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 14:55:18.012690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007146 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007153 2584 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007156 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007159 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007167 2584 flags.go:64] FLAG: --pod-cidr="" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007170 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007175 2584 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007178 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007181 2584 flags.go:64] FLAG: --pods-per-core="0" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007184 2584 flags.go:64] FLAG: --port="10250" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007187 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007189 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07068c2b002f50f49" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007193 2584 flags.go:64] FLAG: --qos-reserved="" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007196 2584 flags.go:64] FLAG: --read-only-port="10255" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007199 2584 flags.go:64] FLAG: --register-node="true" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007204 2584 flags.go:64] FLAG: --register-with-taints="" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007207 2584 flags.go:64] FLAG: --registry-burst="10" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007211 2584 flags.go:64] FLAG: --registry-qps="5" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007214 2584 flags.go:64] FLAG: --reserved-cpus="" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007217 2584 flags.go:64] FLAG: --reserved-memory="" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007220 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007223 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007226 2584 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007229 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007231 2584 flags.go:64] FLAG: --runonce="false" Jul 09 14:55:18.013307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007234 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007237 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007240 2584 flags.go:64] FLAG: --seccomp-default="false" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007243 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007245 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007248 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007251 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007254 2584 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007256 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007259 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007262 2584 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007266 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007269 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007272 2584 flags.go:64] FLAG: --system-cgroups="" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007275 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007280 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007283 2584 flags.go:64] FLAG: --tls-cert-file="" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007285 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007289 2584 flags.go:64] FLAG: --tls-min-version="" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007291 2584 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007294 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007297 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007301 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007304 2584 flags.go:64] FLAG: --v="2" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007307 2584 flags.go:64] FLAG: --version="false" Jul 09 14:55:18.013943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007311 2584 flags.go:64] FLAG: --vmodule="" Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007315 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.007318 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007425 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007430 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007434 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007437 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007440 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007442 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007445 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007447 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007450 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007452 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007454 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007457 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007459 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007462 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007465 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007469 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007471 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:18.014645 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007474 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007477 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007480 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007484 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007487 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007490 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007506 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007509 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007511 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007515 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007517 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007520 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007523 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007526 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007528 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007531 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007533 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007536 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007538 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:18.015167 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007541 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007543 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007546 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007548 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007551 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007553 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007555 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007558 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007560 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007563 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007565 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007569 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007572 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007574 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007577 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007579 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007582 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007584 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007586 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:18.015631 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007589 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007591 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007594 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007598 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007600 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007603 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007606 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007608 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007611 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007614 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007616 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007618 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007621 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007623 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007625 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007628 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007630 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007633 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007636 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007638 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:18.016078 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007640 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007643 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007645 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007647 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007653 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007655 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007658 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007661 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007663 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007666 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007668 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007671 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007674 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007677 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007680 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007684 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007687 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007690 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007693 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007695 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:18.016581 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007698 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007701 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007703 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.007706 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.008312 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.015014 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.015028 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.015969 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.015977 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016032 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016036 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016040 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016043 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016046 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:18.017074 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016050 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016054 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016058 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016061 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016064 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016067 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016070 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016072 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016075 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016078 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016081 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016084 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016086 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016089 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016092 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016096 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016099 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016102 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016105 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016107 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:18.017409 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016110 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016112 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016114 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016117 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016121 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016123 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016125 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016128 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016130 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016132 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016135 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016137 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016140 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016142 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016145 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016147 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016150 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016153 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016155 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:18.017897 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016157 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016160 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016162 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016165 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016167 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016170 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016172 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016175 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016177 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016179 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016182 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016184 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016187 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016189 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016191 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016194 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016196 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016199 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016202 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016204 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:18.018345 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016207 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016209 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016212 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016214 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016216 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016219 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016221 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016224 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016226 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016229 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016231 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016233 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016236 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016238 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016240 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016243 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016245 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016249 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016252 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:18.018840 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016255 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016258 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016261 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016263 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016266 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016269 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016272 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016274 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016277 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016280 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016282 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016284 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016287 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016290 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016292 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:18.019296 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016294 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.016299 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016406 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016410 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016413 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016417 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016421 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016423 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016426 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016429 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016432 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016434 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016436 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016439 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:55:18.019700 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016442 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016444 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016446 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016449 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016451 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016454 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016456 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016458 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016461 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016463 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016466 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016468 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016471 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016473 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016475 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016478 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016481 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016483 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016486 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016488 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:55:18.020037 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016491 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016510 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016513 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016516 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016518 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016521 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016523 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016525 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016529 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016531 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016533 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016536 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016538 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016541 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016543 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016545 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016548 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016550 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016553 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016555 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:55:18.020528 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016558 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016560 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016563 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016565 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016567 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016570 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016572 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016575 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016577 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016584 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016586 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016589 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016592 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016594 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016597 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016599 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016601 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016604 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016606 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016608 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:55:18.021013 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016611 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016613 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016616 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016619 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016621 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016623 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016626 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016628 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016635 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016639 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016643 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016645 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016648 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016651 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016654 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016656 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016659 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016663 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016666 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:55:18.021482 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016669 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:55:18.021944 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016672 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:55:18.021944 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016674 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:55:18.021944 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016677 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:55:18.021944 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016680 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:55:18.021944 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016683 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:55:18.021944 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016685 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:55:18.021944 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:18.016688 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:55:18.021944 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.016692 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:55:18.021944 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.016790 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 14:55:18.021944 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.021095 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 14:55:18.022837 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.022825 2584 server.go:1019] "Starting client certificate rotation" Jul 09 14:55:18.022939 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.022923 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:55:18.022968 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.022963 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:55:18.025397 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.025383 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:55:18.026543 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.026478 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:55:18.038289 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.038271 2584 log.go:25] "Validated CRI v1 runtime API" Jul 09 14:55:18.040354 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.040338 2584 log.go:25] "Validated CRI v1 image API" Jul 09 14:55:18.041696 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.041679 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 14:55:18.044286 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.044268 2584 fs.go:135] Filesystem UUIDs: map[790fd31b-56cc-4cc5-a0d8-f02bd8186fdc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 912fb7fe-b14e-4ce2-8353-6f60fd8d38b6:/dev/nvme0n1p3] Jul 09 14:55:18.044356 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.044286 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 14:55:18.048960 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.048856 2584 manager.go:216] Machine: {Timestamp:2026-07-09 14:55:18.047381635 +0000 UTC m=+0.369831192 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108578 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec224b818d599460823eb9fc0acd8dd4 SystemUUID:ec224b81-8d59-9460-823e-b9fc0acd8dd4 BootID:b05f33c9-95b8-4f2a-a727-45773b989a18 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4a:46:64:08:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4a:46:64:08:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:17:8f:ec:6b:60 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 14:55:18.048960 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.048953 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 14:55:18.049068 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.049025 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 14:55:18.052344 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.052321 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 14:55:18.052474 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.052347 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-136.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 14:55:18.053151 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.053141 2584 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 14:55:18.053193 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.053154 2584 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 14:55:18.053193 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.053163 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:55:18.054162 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.054151 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:55:18.054992 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.054983 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 14:55:18.058209 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.058197 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:55:18.058325 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.058314 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 14:55:18.058444 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.058436 2584 kubelet.go:486] "Attempting to sync node with API server" Jul 09 14:55:18.058474 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.058449 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 14:55:18.058474 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.058463 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 14:55:18.058474 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.058472 2584 kubelet.go:398] "Adding apiserver pod source" Jul 09 14:55:18.058585 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.058481 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 14:55:18.058954 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.058942 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:55:18.058994 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.058964 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:55:18.061013 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.060995 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:55:18.061336 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.061319 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 14:55:18.063378 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.063362 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 14:55:18.063470 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.063405 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 14:55:18.064075 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064062 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 14:55:18.064143 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064082 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 14:55:18.064143 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064092 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 14:55:18.064143 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064101 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 14:55:18.064143 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064113 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 14:55:18.064143 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064123 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 14:55:18.064334 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064274 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 14:55:18.064334 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064285 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 14:55:18.064334 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064297 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 14:55:18.064334 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064307 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 14:55:18.064334 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064332 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 14:55:18.064516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.064345 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 14:55:18.065343 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.065331 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 14:55:18.065392 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.065348 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 14:55:18.068126 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.068107 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 14:55:18.068299 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.068270 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-136.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 14:55:18.068349 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.068326 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 14:55:18.068864 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.068852 2584 server.go:1268] "Started kubelet" Jul 09 14:55:18.068986 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.068931 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 14:55:18.069074 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.068989 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 14:55:18.069074 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.069011 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 14:55:18.069680 ip-10-0-128-136 systemd[1]: Started Kubernetes Kubelet. Jul 09 14:55:18.070883 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.070865 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 14:55:18.074247 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.074223 2584 server.go:310] "Adding debug handlers to kubelet server" Jul 09 14:55:18.075046 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.075022 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 14:55:18.077812 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.076866 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-136.ec2.internal.18c0a6dc6bb60ef2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-136.ec2.internal,UID:ip-10-0-128-136.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-136.ec2.internal,},FirstTimestamp:2026-07-09 14:55:18.068825842 +0000 UTC m=+0.391275386,LastTimestamp:2026-07-09 14:55:18.068825842 +0000 UTC m=+0.391275386,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-136.ec2.internal,}" Jul 09 14:55:18.080846 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.080241 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 14:55:18.080846 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.080259 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 14:55:18.080846 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.080286 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8xsfp" Jul 09 14:55:18.080846 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.080337 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jul 09 14:55:18.081088 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.080890 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 14:55:18.081088 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.080887 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 14:55:18.081088 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.080917 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 14:55:18.081088 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.081064 2584 reconstruct.go:97] "Volume reconstruction finished" Jul 09 14:55:18.081282 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.081102 2584 reconciler.go:29] "Reconciler: start to sync state" Jul 09 14:55:18.081392 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.081377 2584 factory.go:55] Registering systemd factory Jul 09 14:55:18.081392 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.081394 2584 factory.go:223] Registration of the systemd container factory successfully Jul 09 14:55:18.081619 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.081608 2584 factory.go:153] Registering CRI-O factory Jul 09 14:55:18.081619 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.081620 2584 factory.go:223] Registration of the crio container factory successfully Jul 09 14:55:18.081708 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.081662 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 14:55:18.081708 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.081693 2584 factory.go:103] Registering Raw factory Jul 09 14:55:18.081797 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.081709 2584 manager.go:1196] Started watching for new ooms in manager Jul 09 14:55:18.082216 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.082198 2584 manager.go:349] Starting recovery of all containers Jul 09 14:55:18.089297 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.089270 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8xsfp" Jul 09 14:55:18.090771 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.090633 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 14:55:18.090771 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.090682 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 14:55:18.091211 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.091194 2584 manager.go:354] Recovery completed Jul 09 14:55:18.095961 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.095949 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:18.097561 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.097546 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:18.097620 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.097572 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:18.097620 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.097581 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:18.098060 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.098047 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 14:55:18.098060 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.098055 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:18.098060 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.098058 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 14:55:18.098211 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.098072 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:55:18.098741 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.098727 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:18.098820 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.098757 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:18.098820 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.098778 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:18.099402 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.099389 2584 policy_none.go:49] "None policy: Start" Jul 09 14:55:18.099439 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.099405 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 14:55:18.099439 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.099415 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 14:55:18.099959 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.099891 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-136.ec2.internal.18c0a6dc6d6c816c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-136.ec2.internal,UID:ip-10-0-128-136.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-136.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-136.ec2.internal,},FirstTimestamp:2026-07-09 14:55:18.097559916 +0000 UTC m=+0.420009460,LastTimestamp:2026-07-09 14:55:18.097559916 +0000 UTC m=+0.420009460,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-136.ec2.internal,}" Jul 09 14:55:18.100665 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.100653 2584 policy_none.go:47] "Start" Jul 09 14:55:18.136017 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.135998 2584 manager.go:337] "Starting Device Plugin manager" Jul 09 14:55:18.136111 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.136033 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 14:55:18.136111 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.136042 2584 server.go:87] "Starting device plugin registration server" Jul 09 14:55:18.136271 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.136254 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 14:55:18.136377 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.136271 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 14:55:18.136466 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.136444 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 14:55:18.136595 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.136546 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 14:55:18.136595 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.136557 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 14:55:18.136944 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.136922 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 14:55:18.137018 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.136969 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-136.ec2.internal\" not found" Jul 09 14:55:18.227510 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.227470 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 14:55:18.228902 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.228744 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 14:55:18.228902 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.228779 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 14:55:18.228902 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.228799 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 14:55:18.228902 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.228837 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 14:55:18.231798 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.231782 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:55:18.237203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.237187 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:18.237991 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.237976 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:18.238061 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.238007 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:18.238061 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.238019 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:18.238061 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.238042 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.247178 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.247140 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.247178 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.247161 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-136.ec2.internal\": node \"ip-10-0-128-136.ec2.internal\" not found" Jul 09 14:55:18.264474 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.264454 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jul 09 14:55:18.329138 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.329117 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal"] Jul 09 14:55:18.329193 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.329186 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:18.329886 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.329873 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:18.329932 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.329899 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:18.329932 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.329909 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:18.331472 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.331460 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:18.331602 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.331588 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.331645 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.331618 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:18.332159 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.332131 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:18.332159 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.332161 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:18.332303 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.332171 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:18.332303 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.332140 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:18.332303 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.332232 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:18.332303 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.332245 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:18.333568 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.333545 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.333623 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.333572 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:55:18.334194 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.334180 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:55:18.334252 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.334217 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:55:18.334252 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.334236 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:55:18.362027 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.362003 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-136.ec2.internal\" not found" node="ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.364524 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.364507 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jul 09 14:55:18.366521 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.366489 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-136.ec2.internal\" not found" node="ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.383520 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.383486 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e6349be74bf44ff9b94e695d15114e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"3e6349be74bf44ff9b94e695d15114e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.383568 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.383531 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e6349be74bf44ff9b94e695d15114e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"3e6349be74bf44ff9b94e695d15114e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.383568 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.383548 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78350d0908fbb8795cb0dc5d10a96325-config\") pod \"kube-apiserver-proxy-ip-10-0-128-136.ec2.internal\" (UID: \"78350d0908fbb8795cb0dc5d10a96325\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.465112 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.465091 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jul 09 14:55:18.484511 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.484476 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e6349be74bf44ff9b94e695d15114e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"3e6349be74bf44ff9b94e695d15114e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.484596 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.484516 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e6349be74bf44ff9b94e695d15114e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"3e6349be74bf44ff9b94e695d15114e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.484596 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.484533 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78350d0908fbb8795cb0dc5d10a96325-config\") pod \"kube-apiserver-proxy-ip-10-0-128-136.ec2.internal\" (UID: \"78350d0908fbb8795cb0dc5d10a96325\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.484596 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.484573 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e6349be74bf44ff9b94e695d15114e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"3e6349be74bf44ff9b94e695d15114e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.484684 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.484615 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e6349be74bf44ff9b94e695d15114e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal\" (UID: \"3e6349be74bf44ff9b94e695d15114e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.484684 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.484640 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78350d0908fbb8795cb0dc5d10a96325-config\") pod \"kube-apiserver-proxy-ip-10-0-128-136.ec2.internal\" (UID: \"78350d0908fbb8795cb0dc5d10a96325\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.565910 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.565865 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jul 09 14:55:18.664400 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.664370 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.666001 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.665987 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jul 09 14:55:18.669702 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.669680 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.766807 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.766777 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jul 09 14:55:18.867275 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:18.867216 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-136.ec2.internal\" not found" Jul 09 14:55:18.892520 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.892486 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:55:18.980931 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.980903 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" Jul 09 14:55:18.995824 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.995807 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:55:18.997914 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:18.997900 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" Jul 09 14:55:19.008526 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.008494 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:55:19.022205 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.022178 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 14:55:19.022307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.022290 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 14:55:19.022350 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.022336 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 14:55:19.061375 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.061347 2584 apiserver.go:52] "Watching apiserver" Jul 09 14:55:19.080786 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.080769 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 14:55:19.081689 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.081674 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 14:55:19.082049 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.082030 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-mqcjt","openshift-multus/multus-additional-cni-plugins-sncmz","openshift-multus/network-metrics-daemon-zt9qm","openshift-network-diagnostics/network-check-target-k82zv","openshift-network-operator/iptables-alerter-n5q2b","kube-system/global-pull-secret-syncer-hxwrn","kube-system/konnectivity-agent-pvxdf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr","openshift-dns/node-resolver-9694d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal","openshift-multus/multus-7pnw5","openshift-ovn-kubernetes/ovnkube-node-v5lwz","kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bgn4v"] Jul 09 14:55:19.083464 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.083451 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:19.084851 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.084827 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.086475 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.086458 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:19.086559 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.086529 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:19.086924 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.086906 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 14:55:19.087341 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.087328 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lzfpr\"" Jul 09 14:55:19.087712 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.087699 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 14:55:19.087974 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.087956 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:19.088084 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.088048 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:19.088160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.088144 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vbpgf\"" Jul 09 14:55:19.089407 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.089383 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n5q2b" Jul 09 14:55:19.090605 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.090578 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 14:55:19.090705 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.090594 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 14:55:19.090705 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.090694 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 14:55:19.091547 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.091525 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:19.091688 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.091662 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:19.091777 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.091761 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 14:55:19.091957 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.091940 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 14:55:19.092297 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.092282 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 14:55:19.092642 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.092625 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qhkfp\"" Jul 09 14:55:19.092705 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.092638 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:55:19.095505 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.093243 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9694d" Jul 09 14:55:19.095505 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.093690 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 14:50:18 +0000 UTC" deadline="2028-02-28 23:07:15.758200744 +0000 UTC" Jul 09 14:55:19.095505 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.093747 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14384h11m56.664459061s" Jul 09 14:55:19.096207 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.096179 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 14:55:19.097175 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.097149 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bvxmp\"" Jul 09 14:55:19.097425 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.097403 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.097810 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.097793 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 14:55:19.098858 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.098836 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.099824 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.099802 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:55:19.100467 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.100442 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.100728 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.100705 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-995vz\"" Jul 09 14:55:19.102844 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.101921 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:55:19.102844 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.101945 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 14:55:19.102844 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.102187 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 14:55:19.102844 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.102204 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 14:55:19.102844 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.102275 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g5sdv\"" Jul 09 14:55:19.102844 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.102446 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mqcjt" Jul 09 14:55:19.103765 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.103745 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.105952 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.105935 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 14:55:19.106068 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.105951 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 14:55:19.106068 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.105995 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-thncm\"" Jul 09 14:55:19.106068 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.105937 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 14:55:19.108493 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.108475 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 14:55:19.108493 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.108486 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 14:55:19.108617 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.108484 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 14:55:19.109058 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.109042 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 14:55:19.109157 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.109043 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 14:55:19.109157 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.109108 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 14:55:19.109997 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.109980 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 14:55:19.110082 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.110019 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 14:55:19.110082 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.110072 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dptzf\"" Jul 09 14:55:19.110183 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.110097 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 14:55:19.110183 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.110125 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f4bdd\"" Jul 09 14:55:19.121973 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.121918 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n5sqj" Jul 09 14:55:19.122224 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.122208 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:55:19.130752 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.130734 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n5sqj" Jul 09 14:55:19.182802 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.182783 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 14:55:19.187794 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.187773 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d26f442c-10c0-4635-9574-bbf3d35efde9-serviceca\") pod \"node-ca-mqcjt\" (UID: \"d26f442c-10c0-4635-9574-bbf3d35efde9\") " pod="openshift-image-registry/node-ca-mqcjt" Jul 09 14:55:19.187886 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.187804 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.187886 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.187822 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-cni-bin\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.187886 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.187839 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5b3ed60-a90f-4170-b435-e2d2911c301f-iptables-alerter-script\") pod \"iptables-alerter-n5q2b\" (UID: \"e5b3ed60-a90f-4170-b435-e2d2911c301f\") " pod="openshift-network-operator/iptables-alerter-n5q2b" Jul 09 14:55:19.187886 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.187873 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a828edc6-373d-46d7-a9f7-c0d2d0dc431d-tmp-dir\") pod \"node-resolver-9694d\" (UID: \"a828edc6-373d-46d7-a9f7-c0d2d0dc431d\") " pod="openshift-dns/node-resolver-9694d" Jul 09 14:55:19.188100 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.187891 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.188100 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.187908 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-tuned\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.188100 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.187924 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:19.188100 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.187942 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-os-release\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.188100 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.187979 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-run-ovn\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.188100 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188013 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e37c595a-6449-4b2a-b398-6a3f7883bc26-agent-certs\") pod \"konnectivity-agent-pvxdf\" (UID: \"e37c595a-6449-4b2a-b398-6a3f7883bc26\") " pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:19.188100 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188042 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-systemd\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.188100 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188065 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-run\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.188100 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188091 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d26f442c-10c0-4635-9574-bbf3d35efde9-host\") pod \"node-ca-mqcjt\" (UID: \"d26f442c-10c0-4635-9574-bbf3d35efde9\") " pod="openshift-image-registry/node-ca-mqcjt" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188122 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e37c595a-6449-4b2a-b398-6a3f7883bc26-konnectivity-ca\") pod \"konnectivity-agent-pvxdf\" (UID: \"e37c595a-6449-4b2a-b398-6a3f7883bc26\") " pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188174 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-var-lib-cni-multus\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188200 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff55c829-f9de-4be8-a09c-0317c6feccc4-tmp\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188224 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75737144-b8b7-4ba4-9e47-3af102c57948-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188252 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75737144-b8b7-4ba4-9e47-3af102c57948-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188280 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-run-systemd\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188304 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-var-lib-openvswitch\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188341 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-run-openvswitch\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188365 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjgrr\" (UniqueName: \"kubernetes.io/projected/ba3827a1-9707-4837-9ded-67c674974b94-kube-api-access-mjgrr\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188421 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wl28\" (UniqueName: \"kubernetes.io/projected/e5b3ed60-a90f-4170-b435-e2d2911c301f-kube-api-access-4wl28\") pod \"iptables-alerter-n5q2b\" (UID: \"e5b3ed60-a90f-4170-b435-e2d2911c301f\") " pod="openshift-network-operator/iptables-alerter-n5q2b" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188458 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrxbq\" (UniqueName: \"kubernetes.io/projected/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-kube-api-access-vrxbq\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188483 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94nr6\" (UniqueName: \"kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6\") pod \"network-check-target-k82zv\" (UID: \"5dec1137-cf87-4728-a768-ebff59195ca4\") " pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:19.188516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188519 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188537 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-kubelet-config\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188552 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-run-netns\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188567 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-cni-netd\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188581 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/15b270e9-b495-4155-94bf-e52af210f574-ovnkube-config\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188599 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/15b270e9-b495-4155-94bf-e52af210f574-ovn-node-metrics-cert\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188621 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-multus-cni-dir\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188641 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-multus-conf-dir\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188660 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-sysctl-d\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188675 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-node-log\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188696 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-run-k8s-cni-cncf-io\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188713 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-var-lib-kubelet\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188731 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpm7d\" (UniqueName: \"kubernetes.io/projected/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-kube-api-access-dpm7d\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188747 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-sys\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188772 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-var-lib-kubelet\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188808 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-host\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188832 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q5tc\" (UniqueName: \"kubernetes.io/projected/d26f442c-10c0-4635-9574-bbf3d35efde9-kube-api-access-7q5tc\") pod \"node-ca-mqcjt\" (UID: \"d26f442c-10c0-4635-9574-bbf3d35efde9\") " pod="openshift-image-registry/node-ca-mqcjt" Jul 09 14:55:19.188984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188849 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-slash\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188868 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-socket-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188889 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-kubernetes\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188903 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-lib-modules\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188927 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/15b270e9-b495-4155-94bf-e52af210f574-ovnkube-script-lib\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188943 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-hostroot\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188972 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr8dp\" (UniqueName: \"kubernetes.io/projected/a828edc6-373d-46d7-a9f7-c0d2d0dc431d-kube-api-access-jr8dp\") pod \"node-resolver-9694d\" (UID: \"a828edc6-373d-46d7-a9f7-c0d2d0dc431d\") " pod="openshift-dns/node-resolver-9694d" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.188989 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-system-cni-dir\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189027 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-sys-fs\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189050 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6qpz\" (UniqueName: \"kubernetes.io/projected/ff55c829-f9de-4be8-a09c-0317c6feccc4-kube-api-access-r6qpz\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189066 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-kubelet\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189089 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrwlc\" (UniqueName: \"kubernetes.io/projected/15b270e9-b495-4155-94bf-e52af210f574-kube-api-access-zrwlc\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189106 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-var-lib-cni-bin\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189120 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5b3ed60-a90f-4170-b435-e2d2911c301f-host-slash\") pod \"iptables-alerter-n5q2b\" (UID: \"e5b3ed60-a90f-4170-b435-e2d2911c301f\") " pod="openshift-network-operator/iptables-alerter-n5q2b" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189139 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-cnibin\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189166 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-registration-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.189514 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189185 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-device-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189206 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-system-cni-dir\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189244 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-cnibin\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189261 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-os-release\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189276 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-multus-socket-dir-parent\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189292 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-run-netns\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189313 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-run-multus-certs\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189334 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-dbus\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189349 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-systemd-units\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189371 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-etc-openvswitch\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189407 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-log-socket\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189428 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189445 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/15b270e9-b495-4155-94bf-e52af210f574-env-overrides\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189466 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba3827a1-9707-4837-9ded-67c674974b94-cni-binary-copy\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189482 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ba3827a1-9707-4837-9ded-67c674974b94-multus-daemon-config\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189524 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189546 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:19.190078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189561 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-sysconfig\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.190859 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189577 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-etc-kubernetes\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.190859 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189597 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a828edc6-373d-46d7-a9f7-c0d2d0dc431d-hosts-file\") pod \"node-resolver-9694d\" (UID: \"a828edc6-373d-46d7-a9f7-c0d2d0dc431d\") " pod="openshift-dns/node-resolver-9694d" Jul 09 14:55:19.190859 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189622 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75737144-b8b7-4ba4-9e47-3af102c57948-cni-binary-copy\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.190859 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189639 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjl77\" (UniqueName: \"kubernetes.io/projected/75737144-b8b7-4ba4-9e47-3af102c57948-kube-api-access-pjl77\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.190859 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189655 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-modprobe-d\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.190859 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.189669 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-sysctl-conf\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.191942 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:19.191898 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6349be74bf44ff9b94e695d15114e3.slice/crio-78458bff4edf5b5dd196a9e650f85ea3701518010f3feb222ebfed1343f82734 WatchSource:0}: Error finding container 78458bff4edf5b5dd196a9e650f85ea3701518010f3feb222ebfed1343f82734: Status 404 returned error can't find the container with id 78458bff4edf5b5dd196a9e650f85ea3701518010f3feb222ebfed1343f82734 Jul 09 14:55:19.197857 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.197840 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:55:19.231910 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.231865 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" event={"ID":"3e6349be74bf44ff9b94e695d15114e3","Type":"ContainerStarted","Data":"78458bff4edf5b5dd196a9e650f85ea3701518010f3feb222ebfed1343f82734"} Jul 09 14:55:19.290263 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290238 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d26f442c-10c0-4635-9574-bbf3d35efde9-host\") pod \"node-ca-mqcjt\" (UID: \"d26f442c-10c0-4635-9574-bbf3d35efde9\") " pod="openshift-image-registry/node-ca-mqcjt" Jul 09 14:55:19.290362 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290267 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e37c595a-6449-4b2a-b398-6a3f7883bc26-konnectivity-ca\") pod \"konnectivity-agent-pvxdf\" (UID: \"e37c595a-6449-4b2a-b398-6a3f7883bc26\") " pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:19.290362 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290284 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-var-lib-cni-multus\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.290362 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290299 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff55c829-f9de-4be8-a09c-0317c6feccc4-tmp\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.290362 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290316 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75737144-b8b7-4ba4-9e47-3af102c57948-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.290362 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290341 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75737144-b8b7-4ba4-9e47-3af102c57948-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.290362 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290352 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d26f442c-10c0-4635-9574-bbf3d35efde9-host\") pod \"node-ca-mqcjt\" (UID: \"d26f442c-10c0-4635-9574-bbf3d35efde9\") " pod="openshift-image-registry/node-ca-mqcjt" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290366 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-run-systemd\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290380 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-var-lib-cni-multus\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290404 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-run-systemd\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290407 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-var-lib-openvswitch\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290523 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-var-lib-openvswitch\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290541 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-run-openvswitch\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290597 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjgrr\" (UniqueName: \"kubernetes.io/projected/ba3827a1-9707-4837-9ded-67c674974b94-kube-api-access-mjgrr\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290627 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wl28\" (UniqueName: \"kubernetes.io/projected/e5b3ed60-a90f-4170-b435-e2d2911c301f-kube-api-access-4wl28\") pod \"iptables-alerter-n5q2b\" (UID: \"e5b3ed60-a90f-4170-b435-e2d2911c301f\") " pod="openshift-network-operator/iptables-alerter-n5q2b" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290654 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrxbq\" (UniqueName: \"kubernetes.io/projected/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-kube-api-access-vrxbq\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290668 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-run-openvswitch\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290681 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94nr6\" (UniqueName: \"kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6\") pod \"network-check-target-k82zv\" (UID: \"5dec1137-cf87-4728-a768-ebff59195ca4\") " pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290679 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 14:55:19.290714 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290707 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290733 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-kubelet-config\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290760 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-run-netns\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290806 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-cni-netd\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290831 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/15b270e9-b495-4155-94bf-e52af210f574-ovnkube-config\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290858 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/15b270e9-b495-4155-94bf-e52af210f574-ovn-node-metrics-cert\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290888 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-multus-cni-dir\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290914 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-multus-conf-dir\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290916 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-kubelet-config\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290937 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-sysctl-d\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290960 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-node-log\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.290987 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-run-k8s-cni-cncf-io\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291011 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-var-lib-kubelet\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291022 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291038 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpm7d\" (UniqueName: \"kubernetes.io/projected/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-kube-api-access-dpm7d\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291038 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75737144-b8b7-4ba4-9e47-3af102c57948-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291069 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e37c595a-6449-4b2a-b398-6a3f7883bc26-konnectivity-ca\") pod \"konnectivity-agent-pvxdf\" (UID: \"e37c595a-6449-4b2a-b398-6a3f7883bc26\") " pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:19.291366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291090 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-run-netns\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291121 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-sys\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291137 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75737144-b8b7-4ba4-9e47-3af102c57948-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291149 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-var-lib-kubelet\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291175 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-host\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291201 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q5tc\" (UniqueName: \"kubernetes.io/projected/d26f442c-10c0-4635-9574-bbf3d35efde9-kube-api-access-7q5tc\") pod \"node-ca-mqcjt\" (UID: \"d26f442c-10c0-4635-9574-bbf3d35efde9\") " pod="openshift-image-registry/node-ca-mqcjt" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291202 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-multus-cni-dir\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291224 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-node-log\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291241 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-slash\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291270 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-sys\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291277 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-multus-conf-dir\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291303 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-slash\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291266 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-cni-netd\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291328 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-var-lib-kubelet\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291345 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-var-lib-kubelet\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291303 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-run-k8s-cni-cncf-io\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291355 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-host\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291390 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-socket-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.292248 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291417 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-kubernetes\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291441 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-lib-modules\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291417 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-sysctl-d\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291464 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/15b270e9-b495-4155-94bf-e52af210f574-ovnkube-script-lib\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291486 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-hostroot\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291529 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-socket-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291574 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-kubernetes\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291596 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8dp\" (UniqueName: \"kubernetes.io/projected/a828edc6-373d-46d7-a9f7-c0d2d0dc431d-kube-api-access-jr8dp\") pod \"node-resolver-9694d\" (UID: \"a828edc6-373d-46d7-a9f7-c0d2d0dc431d\") " pod="openshift-dns/node-resolver-9694d" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291621 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/15b270e9-b495-4155-94bf-e52af210f574-ovnkube-config\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291625 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-system-cni-dir\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291654 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-system-cni-dir\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291627 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-hostroot\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291680 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-sys-fs\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291708 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6qpz\" (UniqueName: \"kubernetes.io/projected/ff55c829-f9de-4be8-a09c-0317c6feccc4-kube-api-access-r6qpz\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291735 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-kubelet\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291750 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-lib-modules\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291759 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-sys-fs\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.293203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291762 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwlc\" (UniqueName: \"kubernetes.io/projected/15b270e9-b495-4155-94bf-e52af210f574-kube-api-access-zrwlc\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291804 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-kubelet\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291807 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-var-lib-cni-bin\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291840 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-var-lib-cni-bin\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291847 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5b3ed60-a90f-4170-b435-e2d2911c301f-host-slash\") pod \"iptables-alerter-n5q2b\" (UID: \"e5b3ed60-a90f-4170-b435-e2d2911c301f\") " pod="openshift-network-operator/iptables-alerter-n5q2b" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291873 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-cnibin\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291899 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-registration-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291925 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-device-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291932 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5b3ed60-a90f-4170-b435-e2d2911c301f-host-slash\") pod \"iptables-alerter-n5q2b\" (UID: \"e5b3ed60-a90f-4170-b435-e2d2911c301f\") " pod="openshift-network-operator/iptables-alerter-n5q2b" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291952 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-system-cni-dir\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291978 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-cnibin\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291991 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-registration-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.291968 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/15b270e9-b495-4155-94bf-e52af210f574-ovnkube-script-lib\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-os-release\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292033 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-multus-socket-dir-parent\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292032 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-cnibin\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292061 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-run-netns\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292061 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-system-cni-dir\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.293947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292002 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-device-dir\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292086 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-cnibin\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292095 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-run-multus-certs\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292115 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-os-release\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292128 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-dbus\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292152 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-run-netns\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292156 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-systemd-units\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292129 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-multus-socket-dir-parent\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292176 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-dbus\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292180 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-etc-openvswitch\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292130 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-host-run-multus-certs\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292223 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-systemd-units\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292224 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-etc-openvswitch\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292266 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-log-socket\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292293 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292309 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-log-socket\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292321 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/15b270e9-b495-4155-94bf-e52af210f574-env-overrides\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292347 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba3827a1-9707-4837-9ded-67c674974b94-cni-binary-copy\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.294562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292400 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ba3827a1-9707-4837-9ded-67c674974b94-multus-daemon-config\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292428 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292440 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292456 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292483 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-sysconfig\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292509 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-etc-kubernetes\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292537 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a828edc6-373d-46d7-a9f7-c0d2d0dc431d-hosts-file\") pod \"node-resolver-9694d\" (UID: \"a828edc6-373d-46d7-a9f7-c0d2d0dc431d\") " pod="openshift-dns/node-resolver-9694d" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292550 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292582 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75737144-b8b7-4ba4-9e47-3af102c57948-cni-binary-copy\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292582 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-sysconfig\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292593 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba3827a1-9707-4837-9ded-67c674974b94-etc-kubernetes\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292631 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjl77\" (UniqueName: \"kubernetes.io/projected/75737144-b8b7-4ba4-9e47-3af102c57948-kube-api-access-pjl77\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292653 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a828edc6-373d-46d7-a9f7-c0d2d0dc431d-hosts-file\") pod \"node-resolver-9694d\" (UID: \"a828edc6-373d-46d7-a9f7-c0d2d0dc431d\") " pod="openshift-dns/node-resolver-9694d" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292665 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-modprobe-d\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292694 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-sysctl-conf\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292719 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d26f442c-10c0-4635-9574-bbf3d35efde9-serviceca\") pod \"node-ca-mqcjt\" (UID: \"d26f442c-10c0-4635-9574-bbf3d35efde9\") " pod="openshift-image-registry/node-ca-mqcjt" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292746 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292771 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-cni-bin\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.295160 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.292777 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292797 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5b3ed60-a90f-4170-b435-e2d2911c301f-iptables-alerter-script\") pod \"iptables-alerter-n5q2b\" (UID: \"e5b3ed60-a90f-4170-b435-e2d2911c301f\") " pod="openshift-network-operator/iptables-alerter-n5q2b" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292823 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a828edc6-373d-46d7-a9f7-c0d2d0dc431d-tmp-dir\") pod \"node-resolver-9694d\" (UID: \"a828edc6-373d-46d7-a9f7-c0d2d0dc431d\") " pod="openshift-dns/node-resolver-9694d" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.292854 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret podName:c471aae4-d380-41c3-a7c9-0f99c3c9d65a nodeName:}" failed. No retries permitted until 2026-07-09 14:55:19.792830257 +0000 UTC m=+2.115280024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret") pod "global-pull-secret-syncer-hxwrn" (UID: "c471aae4-d380-41c3-a7c9-0f99c3c9d65a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292883 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292910 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-tuned\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292934 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292960 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-os-release\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292970 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba3827a1-9707-4837-9ded-67c674974b94-cni-binary-copy\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.292984 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-run-ovn\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293013 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e37c595a-6449-4b2a-b398-6a3f7883bc26-agent-certs\") pod \"konnectivity-agent-pvxdf\" (UID: \"e37c595a-6449-4b2a-b398-6a3f7883bc26\") " pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293036 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ba3827a1-9707-4837-9ded-67c674974b94-multus-daemon-config\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293041 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-systemd\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293077 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-run\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293084 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-systemd\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293157 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75737144-b8b7-4ba4-9e47-3af102c57948-cni-binary-copy\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293163 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-run\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.295779 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293166 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a828edc6-373d-46d7-a9f7-c0d2d0dc431d-tmp-dir\") pod \"node-resolver-9694d\" (UID: \"a828edc6-373d-46d7-a9f7-c0d2d0dc431d\") " pod="openshift-dns/node-resolver-9694d" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293215 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-os-release\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293216 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-cni-bin\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293250 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293305 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/15b270e9-b495-4155-94bf-e52af210f574-run-ovn\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293332 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-modprobe-d\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293358 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/15b270e9-b495-4155-94bf-e52af210f574-env-overrides\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293370 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75737144-b8b7-4ba4-9e47-3af102c57948-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293391 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d26f442c-10c0-4635-9574-bbf3d35efde9-serviceca\") pod \"node-ca-mqcjt\" (UID: \"d26f442c-10c0-4635-9574-bbf3d35efde9\") " pod="openshift-image-registry/node-ca-mqcjt" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.293434 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293484 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-sysctl-conf\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.293491 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs podName:df75ee8a-be1a-4c76-a301-0c57e03d4e2d nodeName:}" failed. No retries permitted until 2026-07-09 14:55:19.793475166 +0000 UTC m=+2.115924700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs") pod "network-metrics-daemon-zt9qm" (UID: "df75ee8a-be1a-4c76-a301-0c57e03d4e2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.293808 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5b3ed60-a90f-4170-b435-e2d2911c301f-iptables-alerter-script\") pod \"iptables-alerter-n5q2b\" (UID: \"e5b3ed60-a90f-4170-b435-e2d2911c301f\") " pod="openshift-network-operator/iptables-alerter-n5q2b" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.294879 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/15b270e9-b495-4155-94bf-e52af210f574-ovn-node-metrics-cert\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.295464 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff55c829-f9de-4be8-a09c-0317c6feccc4-tmp\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.295868 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff55c829-f9de-4be8-a09c-0317c6feccc4-etc-tuned\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.296403 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.296059 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e37c595a-6449-4b2a-b398-6a3f7883bc26-agent-certs\") pod \"konnectivity-agent-pvxdf\" (UID: \"e37c595a-6449-4b2a-b398-6a3f7883bc26\") " pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:19.306690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.306673 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrxbq\" (UniqueName: \"kubernetes.io/projected/676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce-kube-api-access-vrxbq\") pod \"aws-ebs-csi-driver-node-djfvr\" (UID: \"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.307209 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.307194 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:19.307255 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.307213 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:19.307255 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.307223 2584 projected.go:196] Error preparing data for projected volume kube-api-access-94nr6 for pod openshift-network-diagnostics/network-check-target-k82zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:19.307323 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.307275 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6 podName:5dec1137-cf87-4728-a768-ebff59195ca4 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:19.807264219 +0000 UTC m=+2.129713753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-94nr6" (UniqueName: "kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6") pod "network-check-target-k82zv" (UID: "5dec1137-cf87-4728-a768-ebff59195ca4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:19.310904 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.310880 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrwlc\" (UniqueName: \"kubernetes.io/projected/15b270e9-b495-4155-94bf-e52af210f574-kube-api-access-zrwlc\") pod \"ovnkube-node-v5lwz\" (UID: \"15b270e9-b495-4155-94bf-e52af210f574\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.311516 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.311492 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6qpz\" (UniqueName: \"kubernetes.io/projected/ff55c829-f9de-4be8-a09c-0317c6feccc4-kube-api-access-r6qpz\") pod \"tuned-bgn4v\" (UID: \"ff55c829-f9de-4be8-a09c-0317c6feccc4\") " pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.312646 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.312621 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q5tc\" (UniqueName: \"kubernetes.io/projected/d26f442c-10c0-4635-9574-bbf3d35efde9-kube-api-access-7q5tc\") pod \"node-ca-mqcjt\" (UID: \"d26f442c-10c0-4635-9574-bbf3d35efde9\") " pod="openshift-image-registry/node-ca-mqcjt" Jul 09 14:55:19.313612 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.313559 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjgrr\" (UniqueName: \"kubernetes.io/projected/ba3827a1-9707-4837-9ded-67c674974b94-kube-api-access-mjgrr\") pod \"multus-7pnw5\" (UID: \"ba3827a1-9707-4837-9ded-67c674974b94\") " pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.313720 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.313556 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wl28\" (UniqueName: \"kubernetes.io/projected/e5b3ed60-a90f-4170-b435-e2d2911c301f-kube-api-access-4wl28\") pod \"iptables-alerter-n5q2b\" (UID: \"e5b3ed60-a90f-4170-b435-e2d2911c301f\") " pod="openshift-network-operator/iptables-alerter-n5q2b" Jul 09 14:55:19.313835 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.313816 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjl77\" (UniqueName: \"kubernetes.io/projected/75737144-b8b7-4ba4-9e47-3af102c57948-kube-api-access-pjl77\") pod \"multus-additional-cni-plugins-sncmz\" (UID: \"75737144-b8b7-4ba4-9e47-3af102c57948\") " pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.314046 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.314028 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpm7d\" (UniqueName: \"kubernetes.io/projected/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-kube-api-access-dpm7d\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:19.318454 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.318436 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr8dp\" (UniqueName: \"kubernetes.io/projected/a828edc6-373d-46d7-a9f7-c0d2d0dc431d-kube-api-access-jr8dp\") pod \"node-resolver-9694d\" (UID: \"a828edc6-373d-46d7-a9f7-c0d2d0dc431d\") " pod="openshift-dns/node-resolver-9694d" Jul 09 14:55:19.407800 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.407741 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:19.418029 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:19.418003 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37c595a_6449_4b2a_b398_6a3f7883bc26.slice/crio-03481c34e63c1f1c251b170fa4bd2c6befddc7e60a3662b932555a55f48ccce0 WatchSource:0}: Error finding container 03481c34e63c1f1c251b170fa4bd2c6befddc7e60a3662b932555a55f48ccce0: Status 404 returned error can't find the container with id 03481c34e63c1f1c251b170fa4bd2c6befddc7e60a3662b932555a55f48ccce0 Jul 09 14:55:19.427393 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.427376 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7pnw5" Jul 09 14:55:19.441305 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.441282 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n5q2b" Jul 09 14:55:19.441794 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:19.441773 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78350d0908fbb8795cb0dc5d10a96325.slice/crio-da0f5eda596d5a1fd8c541c4bfbe9501dd7188837a2ea6fe64707392824a3431 WatchSource:0}: Error finding container da0f5eda596d5a1fd8c541c4bfbe9501dd7188837a2ea6fe64707392824a3431: Status 404 returned error can't find the container with id da0f5eda596d5a1fd8c541c4bfbe9501dd7188837a2ea6fe64707392824a3431 Jul 09 14:55:19.442445 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:19.442425 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3827a1_9707_4837_9ded_67c674974b94.slice/crio-7a57b9cf594606d50964052f373090d5bfa0ef2d63a5c98dd5319114e778585c WatchSource:0}: Error finding container 7a57b9cf594606d50964052f373090d5bfa0ef2d63a5c98dd5319114e778585c: Status 404 returned error can't find the container with id 7a57b9cf594606d50964052f373090d5bfa0ef2d63a5c98dd5319114e778585c Jul 09 14:55:19.446622 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.446601 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9694d" Jul 09 14:55:19.450224 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:19.450201 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b3ed60_a90f_4170_b435_e2d2911c301f.slice/crio-3223dc80f7c5460dcb415c82e8299547dbe48e6e89d5571e20e73920e38ba766 WatchSource:0}: Error finding container 3223dc80f7c5460dcb415c82e8299547dbe48e6e89d5571e20e73920e38ba766: Status 404 returned error can't find the container with id 3223dc80f7c5460dcb415c82e8299547dbe48e6e89d5571e20e73920e38ba766 Jul 09 14:55:19.462818 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.462800 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:55:19.468461 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.468443 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" Jul 09 14:55:19.476858 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:19.476834 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff55c829_f9de_4be8_a09c_0317c6feccc4.slice/crio-6e56d35c3062a396de7c6f438d55964d3e3cea1a1ccd9776d61798841fe5e322 WatchSource:0}: Error finding container 6e56d35c3062a396de7c6f438d55964d3e3cea1a1ccd9776d61798841fe5e322: Status 404 returned error can't find the container with id 6e56d35c3062a396de7c6f438d55964d3e3cea1a1ccd9776d61798841fe5e322 Jul 09 14:55:19.496398 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.496382 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sncmz" Jul 09 14:55:19.504691 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.504672 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" Jul 09 14:55:19.505308 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:19.505280 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75737144_b8b7_4ba4_9e47_3af102c57948.slice/crio-802eea6b282f9e2065d42cb4b3bd795b9c23396aba8f13d2cf765fdfe0aa2f75 WatchSource:0}: Error finding container 802eea6b282f9e2065d42cb4b3bd795b9c23396aba8f13d2cf765fdfe0aa2f75: Status 404 returned error can't find the container with id 802eea6b282f9e2065d42cb4b3bd795b9c23396aba8f13d2cf765fdfe0aa2f75 Jul 09 14:55:19.510732 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.510717 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mqcjt" Jul 09 14:55:19.512436 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:19.512414 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676211be_5c3a_4ffb_b15e_fc0a2fa1b4ce.slice/crio-a02fe394f7e1589cb65cb98779c506e5181bca7b1da82a8c750f0606136c15fc WatchSource:0}: Error finding container a02fe394f7e1589cb65cb98779c506e5181bca7b1da82a8c750f0606136c15fc: Status 404 returned error can't find the container with id a02fe394f7e1589cb65cb98779c506e5181bca7b1da82a8c750f0606136c15fc Jul 09 14:55:19.515603 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.515581 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:19.519647 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:19.519628 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26f442c_10c0_4635_9574_bbf3d35efde9.slice/crio-2ca8ff405524bf8a9d386c2cba31278d167ac463f58e500931641d46c4de1c11 WatchSource:0}: Error finding container 2ca8ff405524bf8a9d386c2cba31278d167ac463f58e500931641d46c4de1c11: Status 404 returned error can't find the container with id 2ca8ff405524bf8a9d386c2cba31278d167ac463f58e500931641d46c4de1c11 Jul 09 14:55:19.523486 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:19.523466 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b270e9_b495_4155_94bf_e52af210f574.slice/crio-bed1a5662c6e85c56730c6f3a13d163ffa35b88703cbac101cfb9d947e90a236 WatchSource:0}: Error finding container bed1a5662c6e85c56730c6f3a13d163ffa35b88703cbac101cfb9d947e90a236: Status 404 returned error can't find the container with id bed1a5662c6e85c56730c6f3a13d163ffa35b88703cbac101cfb9d947e90a236 Jul 09 14:55:19.798774 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.798693 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:19.798774 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.798737 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:19.798968 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.798871 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:19.798968 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.798881 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:19.798968 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.798948 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs podName:df75ee8a-be1a-4c76-a301-0c57e03d4e2d nodeName:}" failed. No retries permitted until 2026-07-09 14:55:20.798928504 +0000 UTC m=+3.121378041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs") pod "network-metrics-daemon-zt9qm" (UID: "df75ee8a-be1a-4c76-a301-0c57e03d4e2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:19.799132 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.798968 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret podName:c471aae4-d380-41c3-a7c9-0f99c3c9d65a nodeName:}" failed. No retries permitted until 2026-07-09 14:55:20.798958457 +0000 UTC m=+3.121407990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret") pod "global-pull-secret-syncer-hxwrn" (UID: "c471aae4-d380-41c3-a7c9-0f99c3c9d65a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:19.899729 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:19.899688 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94nr6\" (UniqueName: \"kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6\") pod \"network-check-target-k82zv\" (UID: \"5dec1137-cf87-4728-a768-ebff59195ca4\") " pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:19.899914 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.899892 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:19.899914 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.899913 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:19.900039 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.899926 2584 projected.go:196] Error preparing data for projected volume kube-api-access-94nr6 for pod openshift-network-diagnostics/network-check-target-k82zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:19.900039 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:19.899985 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6 podName:5dec1137-cf87-4728-a768-ebff59195ca4 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:20.899965884 +0000 UTC m=+3.222415433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-94nr6" (UniqueName: "kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6") pod "network-check-target-k82zv" (UID: "5dec1137-cf87-4728-a768-ebff59195ca4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:20.133905 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.133786 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:50:19 +0000 UTC" deadline="2028-01-06 07:02:26.623963139 +0000 UTC" Jul 09 14:55:20.133905 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.133862 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13096h7m6.490105577s" Jul 09 14:55:20.252236 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.252203 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:55:20.254357 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.254316 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" event={"ID":"ff55c829-f9de-4be8-a09c-0317c6feccc4","Type":"ContainerStarted","Data":"6e56d35c3062a396de7c6f438d55964d3e3cea1a1ccd9776d61798841fe5e322"} Jul 09 14:55:20.265186 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.265154 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" event={"ID":"78350d0908fbb8795cb0dc5d10a96325","Type":"ContainerStarted","Data":"da0f5eda596d5a1fd8c541c4bfbe9501dd7188837a2ea6fe64707392824a3431"} Jul 09 14:55:20.270648 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.268382 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pvxdf" event={"ID":"e37c595a-6449-4b2a-b398-6a3f7883bc26","Type":"ContainerStarted","Data":"03481c34e63c1f1c251b170fa4bd2c6befddc7e60a3662b932555a55f48ccce0"} Jul 09 14:55:20.274391 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.274363 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mqcjt" event={"ID":"d26f442c-10c0-4635-9574-bbf3d35efde9","Type":"ContainerStarted","Data":"2ca8ff405524bf8a9d386c2cba31278d167ac463f58e500931641d46c4de1c11"} Jul 09 14:55:20.285244 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.285159 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" event={"ID":"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce","Type":"ContainerStarted","Data":"a02fe394f7e1589cb65cb98779c506e5181bca7b1da82a8c750f0606136c15fc"} Jul 09 14:55:20.311765 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.311417 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sncmz" event={"ID":"75737144-b8b7-4ba4-9e47-3af102c57948","Type":"ContainerStarted","Data":"802eea6b282f9e2065d42cb4b3bd795b9c23396aba8f13d2cf765fdfe0aa2f75"} Jul 09 14:55:20.323580 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.323549 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9694d" event={"ID":"a828edc6-373d-46d7-a9f7-c0d2d0dc431d","Type":"ContainerStarted","Data":"561dccc40f6030246a626dea06ea4b871efcdfd9a95d9ec0c14480990fb39782"} Jul 09 14:55:20.335755 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.335714 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n5q2b" event={"ID":"e5b3ed60-a90f-4170-b435-e2d2911c301f","Type":"ContainerStarted","Data":"3223dc80f7c5460dcb415c82e8299547dbe48e6e89d5571e20e73920e38ba766"} Jul 09 14:55:20.352595 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.352503 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7pnw5" event={"ID":"ba3827a1-9707-4837-9ded-67c674974b94","Type":"ContainerStarted","Data":"7a57b9cf594606d50964052f373090d5bfa0ef2d63a5c98dd5319114e778585c"} Jul 09 14:55:20.384424 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.384282 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" event={"ID":"15b270e9-b495-4155-94bf-e52af210f574","Type":"ContainerStarted","Data":"bed1a5662c6e85c56730c6f3a13d163ffa35b88703cbac101cfb9d947e90a236"} Jul 09 14:55:20.808005 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.807902 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:20.808005 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.807949 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:20.808233 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:20.808112 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:20.808233 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:20.808164 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs podName:df75ee8a-be1a-4c76-a301-0c57e03d4e2d nodeName:}" failed. No retries permitted until 2026-07-09 14:55:22.808149775 +0000 UTC m=+5.130599312 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs") pod "network-metrics-daemon-zt9qm" (UID: "df75ee8a-be1a-4c76-a301-0c57e03d4e2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:20.808530 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:20.808501 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:20.808630 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:20.808561 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret podName:c471aae4-d380-41c3-a7c9-0f99c3c9d65a nodeName:}" failed. No retries permitted until 2026-07-09 14:55:22.808545132 +0000 UTC m=+5.130994679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret") pod "global-pull-secret-syncer-hxwrn" (UID: "c471aae4-d380-41c3-a7c9-0f99c3c9d65a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:20.913042 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:20.912901 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94nr6\" (UniqueName: \"kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6\") pod \"network-check-target-k82zv\" (UID: \"5dec1137-cf87-4728-a768-ebff59195ca4\") " pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:20.913182 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:20.913092 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:20.913182 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:20.913119 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:20.913182 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:20.913133 2584 projected.go:196] Error preparing data for projected volume kube-api-access-94nr6 for pod openshift-network-diagnostics/network-check-target-k82zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:20.913336 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:20.913193 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6 podName:5dec1137-cf87-4728-a768-ebff59195ca4 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:22.913175072 +0000 UTC m=+5.235624626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-94nr6" (UniqueName: "kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6") pod "network-check-target-k82zv" (UID: "5dec1137-cf87-4728-a768-ebff59195ca4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:21.134330 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:21.134225 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:50:19 +0000 UTC" deadline="2028-03-22 19:07:04.303110198 +0000 UTC" Jul 09 14:55:21.134330 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:21.134265 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14932h11m43.168850053s" Jul 09 14:55:21.229871 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:21.229834 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:21.230046 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:21.229975 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:21.230436 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:21.230417 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:21.230525 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:21.230504 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:21.230583 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:21.230551 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:21.230664 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:21.230642 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:21.902463 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:21.902431 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:55:22.827107 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:22.827067 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:22.827634 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:22.827135 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:22.827634 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:22.827335 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:22.827634 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:22.827404 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs podName:df75ee8a-be1a-4c76-a301-0c57e03d4e2d nodeName:}" failed. No retries permitted until 2026-07-09 14:55:26.827381604 +0000 UTC m=+9.149831140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs") pod "network-metrics-daemon-zt9qm" (UID: "df75ee8a-be1a-4c76-a301-0c57e03d4e2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:22.827828 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:22.827818 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:22.827884 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:22.827869 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret podName:c471aae4-d380-41c3-a7c9-0f99c3c9d65a nodeName:}" failed. No retries permitted until 2026-07-09 14:55:26.827853208 +0000 UTC m=+9.150302751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret") pod "global-pull-secret-syncer-hxwrn" (UID: "c471aae4-d380-41c3-a7c9-0f99c3c9d65a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:22.927943 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:22.927900 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94nr6\" (UniqueName: \"kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6\") pod \"network-check-target-k82zv\" (UID: \"5dec1137-cf87-4728-a768-ebff59195ca4\") " pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:22.928109 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:22.928083 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:22.928109 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:22.928106 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:22.928231 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:22.928119 2584 projected.go:196] Error preparing data for projected volume kube-api-access-94nr6 for pod openshift-network-diagnostics/network-check-target-k82zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:22.928231 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:22.928187 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6 podName:5dec1137-cf87-4728-a768-ebff59195ca4 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:26.928166381 +0000 UTC m=+9.250615930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-94nr6" (UniqueName: "kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6") pod "network-check-target-k82zv" (UID: "5dec1137-cf87-4728-a768-ebff59195ca4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:23.229159 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:23.229064 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:23.229324 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:23.229216 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:23.229683 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:23.229654 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:23.229774 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:23.229659 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:23.229844 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:23.229784 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:23.229917 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:23.229894 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:25.230016 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:25.229467 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:25.230016 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:25.229668 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:25.230016 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:25.229702 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:25.230016 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:25.229646 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:25.230016 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:25.229768 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:25.230016 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:25.229851 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:26.860737 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:26.860453 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:26.861183 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:26.860766 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:26.861183 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:26.860701 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:26.861183 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:26.860981 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret podName:c471aae4-d380-41c3-a7c9-0f99c3c9d65a nodeName:}" failed. No retries permitted until 2026-07-09 14:55:34.860963649 +0000 UTC m=+17.183413195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret") pod "global-pull-secret-syncer-hxwrn" (UID: "c471aae4-d380-41c3-a7c9-0f99c3c9d65a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:26.861362 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:26.860919 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:26.861362 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:26.861340 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs podName:df75ee8a-be1a-4c76-a301-0c57e03d4e2d nodeName:}" failed. No retries permitted until 2026-07-09 14:55:34.86132396 +0000 UTC m=+17.183773508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs") pod "network-metrics-daemon-zt9qm" (UID: "df75ee8a-be1a-4c76-a301-0c57e03d4e2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:26.961276 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:26.961246 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94nr6\" (UniqueName: \"kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6\") pod \"network-check-target-k82zv\" (UID: \"5dec1137-cf87-4728-a768-ebff59195ca4\") " pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:26.961463 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:26.961420 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:26.961463 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:26.961446 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:26.961463 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:26.961457 2584 projected.go:196] Error preparing data for projected volume kube-api-access-94nr6 for pod openshift-network-diagnostics/network-check-target-k82zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:26.961643 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:26.961542 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6 podName:5dec1137-cf87-4728-a768-ebff59195ca4 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:34.961522408 +0000 UTC m=+17.283971955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-94nr6" (UniqueName: "kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6") pod "network-check-target-k82zv" (UID: "5dec1137-cf87-4728-a768-ebff59195ca4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:27.230130 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:27.229676 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:27.230130 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:27.229713 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:27.230130 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:27.229713 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:27.230130 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:27.229776 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:27.230130 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:27.229913 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:27.230130 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:27.230005 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:29.229711 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:29.229678 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:29.230088 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:29.229721 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:29.230088 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:29.229678 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:29.230088 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:29.229810 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:29.230088 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:29.229866 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:29.230088 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:29.229944 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:30.232597 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:30.232572 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:30.233040 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:30.232707 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:31.229020 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:31.228978 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:31.229189 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:31.229085 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:31.229189 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:31.229150 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:31.229307 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:31.229264 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:32.229576 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:32.229439 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:32.230006 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:32.229578 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:33.229715 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:33.229672 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:33.230097 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:33.229783 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:33.230097 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:33.229847 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:33.230097 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:33.229943 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:34.229315 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:34.229279 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:34.229518 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:34.229426 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:34.924879 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:34.924836 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:34.925346 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:34.924890 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:34.925346 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:34.924991 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:34.925346 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:34.925048 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret podName:c471aae4-d380-41c3-a7c9-0f99c3c9d65a nodeName:}" failed. No retries permitted until 2026-07-09 14:55:50.925033934 +0000 UTC m=+33.247483465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret") pod "global-pull-secret-syncer-hxwrn" (UID: "c471aae4-d380-41c3-a7c9-0f99c3c9d65a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:34.925346 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:34.924991 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:34.925346 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:34.925110 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs podName:df75ee8a-be1a-4c76-a301-0c57e03d4e2d nodeName:}" failed. No retries permitted until 2026-07-09 14:55:50.925096849 +0000 UTC m=+33.247546380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs") pod "network-metrics-daemon-zt9qm" (UID: "df75ee8a-be1a-4c76-a301-0c57e03d4e2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:35.026425 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:35.025889 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94nr6\" (UniqueName: \"kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6\") pod \"network-check-target-k82zv\" (UID: \"5dec1137-cf87-4728-a768-ebff59195ca4\") " pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:35.026425 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:35.026021 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:35.026425 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:35.026041 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:35.026425 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:35.026052 2584 projected.go:196] Error preparing data for projected volume kube-api-access-94nr6 for pod openshift-network-diagnostics/network-check-target-k82zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:35.026425 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:35.026114 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6 podName:5dec1137-cf87-4728-a768-ebff59195ca4 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:51.026095255 +0000 UTC m=+33.348544810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-94nr6" (UniqueName: "kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6") pod "network-check-target-k82zv" (UID: "5dec1137-cf87-4728-a768-ebff59195ca4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:35.229954 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:35.229872 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:35.230115 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:35.230004 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:35.230115 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:35.230063 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:35.230211 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:35.230161 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:36.229886 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:36.229855 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:36.230341 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:36.230002 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:37.229983 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:37.229942 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:37.230334 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:37.229949 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:37.230334 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:37.230061 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:37.230334 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:37.230129 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:38.230440 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:38.230406 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:38.230912 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:38.230539 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:39.229028 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:39.228994 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:39.229187 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:39.229008 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:39.229187 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:39.229103 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:39.229291 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:39.229186 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:40.228998 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:40.228969 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:40.229410 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:40.229067 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:41.229993 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.229842 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:41.230345 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.229900 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:41.230345 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:41.230104 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:41.230345 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:41.230166 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:41.436639 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.436460 2584 generic.go:356] "Generic (PLEG): container finished" podID="3e6349be74bf44ff9b94e695d15114e3" containerID="57d0a170ef8f433183b64004e1cc3342918953828e2f055e6eaa97e793132fae" exitCode=0 Jul 09 14:55:41.436746 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.436534 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" event={"ID":"3e6349be74bf44ff9b94e695d15114e3","Type":"ContainerDied","Data":"57d0a170ef8f433183b64004e1cc3342918953828e2f055e6eaa97e793132fae"} Jul 09 14:55:41.438441 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.438262 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mqcjt" event={"ID":"d26f442c-10c0-4635-9574-bbf3d35efde9","Type":"ContainerStarted","Data":"ba38e10cd9153f6d62d14d95ad29fb108706643b8d4ebfb592482bf03487d36e"} Jul 09 14:55:41.439933 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.439908 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" event={"ID":"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce","Type":"ContainerStarted","Data":"fa6afb7dd6614dd2cfd7a44a28bf00654f393a50c6c657c7966eaf0b3fc44afd"} Jul 09 14:55:41.441406 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.441385 2584 generic.go:356] "Generic (PLEG): container finished" podID="75737144-b8b7-4ba4-9e47-3af102c57948" containerID="7b0d462148962d3bbef67371195c1902ba43e1edfe959a4768ef944430be9a05" exitCode=0 Jul 09 14:55:41.441525 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.441417 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sncmz" event={"ID":"75737144-b8b7-4ba4-9e47-3af102c57948","Type":"ContainerDied","Data":"7b0d462148962d3bbef67371195c1902ba43e1edfe959a4768ef944430be9a05"} Jul 09 14:55:41.446179 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.446154 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9694d" event={"ID":"a828edc6-373d-46d7-a9f7-c0d2d0dc431d","Type":"ContainerStarted","Data":"ef8c75d6d6e2bac9aa2fa41cf8ae3656b95f2b006a95e447db7a19cbdaaebfae"} Jul 09 14:55:41.449882 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.449859 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7pnw5" event={"ID":"ba3827a1-9707-4837-9ded-67c674974b94","Type":"ContainerStarted","Data":"e1fe16d6107ef47b718687eb33ee47b1ca83e0e6125b70bf4f26353d656b6e98"} Jul 09 14:55:41.452406 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.452386 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 14:55:41.452776 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.452758 2584 generic.go:356] "Generic (PLEG): container finished" podID="15b270e9-b495-4155-94bf-e52af210f574" containerID="e5ad440b78846ad83cd12f0de5bcfdd4a55a71cfc6950fee2cb50575db8efe76" exitCode=1 Jul 09 14:55:41.452838 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.452818 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" event={"ID":"15b270e9-b495-4155-94bf-e52af210f574","Type":"ContainerStarted","Data":"c8c4b4b953fc2f5eb138cc6056fea8ab4a301cf0c2384ae6aefe95cb4d1760e7"} Jul 09 14:55:41.452900 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.452882 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" event={"ID":"15b270e9-b495-4155-94bf-e52af210f574","Type":"ContainerStarted","Data":"ef69d6f5eb80f4b8e978dd3cbcce6db99bbf1f40f9616ef5bdcb94badab23a1e"} Jul 09 14:55:41.452950 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.452931 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" event={"ID":"15b270e9-b495-4155-94bf-e52af210f574","Type":"ContainerDied","Data":"e5ad440b78846ad83cd12f0de5bcfdd4a55a71cfc6950fee2cb50575db8efe76"} Jul 09 14:55:41.452993 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.452983 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" event={"ID":"15b270e9-b495-4155-94bf-e52af210f574","Type":"ContainerStarted","Data":"2b409615e00aa4f1e6ae747dd0f391dc3a6b05e4bf9f3551c98f531d1ca41156"} Jul 09 14:55:41.454197 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.454170 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" event={"ID":"ff55c829-f9de-4be8-a09c-0317c6feccc4","Type":"ContainerStarted","Data":"70683813cde8aef49d90e47a36d8812a8e4dac8e412fd4bddf50012cc06336ad"} Jul 09 14:55:41.455465 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.455443 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" event={"ID":"78350d0908fbb8795cb0dc5d10a96325","Type":"ContainerStarted","Data":"a076bae27672b4c15d333005e6f743e0ec4a35c49c84636a07f5f4f92f4728e5"} Jul 09 14:55:41.456891 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.456841 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pvxdf" event={"ID":"e37c595a-6449-4b2a-b398-6a3f7883bc26","Type":"ContainerStarted","Data":"cfd588e61d551e5fe4256266339526cb2cdacf3af96dd96fb065745ef63d33b8"} Jul 09 14:55:41.469296 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.469260 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9694d" podStartSLOduration=2.525080804 podStartE2EDuration="23.469248499s" totalImagesPullingTime="20.944167695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:41.469241938 +0000 UTC m=+23.791691511" watchObservedRunningTime="2026-07-09 14:55:41.469248499 +0000 UTC m=+23.791698052" Jul 09 14:55:41.488753 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.488711 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7pnw5" podStartSLOduration=2.495280833 podStartE2EDuration="23.488695361s" totalImagesPullingTime="20.993414528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:41.488418708 +0000 UTC m=+23.810868280" watchObservedRunningTime="2026-07-09 14:55:41.488695361 +0000 UTC m=+23.811144916" Jul 09 14:55:41.532511 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.532459 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mqcjt" podStartSLOduration=2.63604472 podStartE2EDuration="23.532444634s" totalImagesPullingTime="20.896399914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:41.532325566 +0000 UTC m=+23.854775123" watchObservedRunningTime="2026-07-09 14:55:41.532444634 +0000 UTC m=+23.854894187" Jul 09 14:55:41.551760 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.551718 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bgn4v" podStartSLOduration=2.611081551 podStartE2EDuration="23.551702031s" totalImagesPullingTime="20.94062048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:41.551665928 +0000 UTC m=+23.874115483" watchObservedRunningTime="2026-07-09 14:55:41.551702031 +0000 UTC m=+23.874151586" Jul 09 14:55:41.583749 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:41.583698 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-136.ec2.internal" podStartSLOduration=22.583683616 podStartE2EDuration="22.583683616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:41.583652813 +0000 UTC m=+23.906102367" watchObservedRunningTime="2026-07-09 14:55:41.583683616 +0000 UTC m=+23.906133161" Jul 09 14:55:42.232579 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:42.232515 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:42.233175 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:42.232612 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:42.462697 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:42.462659 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n5q2b" event={"ID":"e5b3ed60-a90f-4170-b435-e2d2911c301f","Type":"ContainerStarted","Data":"e7e89996f12d4ce6a3c3df603840b0e1346ee699c25f0865537d3e7c93973f02"} Jul 09 14:55:42.465999 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:42.465977 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 14:55:42.466422 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:42.466368 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" event={"ID":"15b270e9-b495-4155-94bf-e52af210f574","Type":"ContainerStarted","Data":"5f4b3130c362e570919387f27c7c9968fed252dfc52ca310d4f09d39dd1e658d"} Jul 09 14:55:42.466531 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:42.466443 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" event={"ID":"15b270e9-b495-4155-94bf-e52af210f574","Type":"ContainerStarted","Data":"5b19a0ee40db1498356bc95f9a867a5648fa75683c1bb29269d64f115c6c62f9"} Jul 09 14:55:42.468793 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:42.468749 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" event={"ID":"3e6349be74bf44ff9b94e695d15114e3","Type":"ContainerStarted","Data":"ad8ffed5fb0ac0bf1e0b78e968517435b004b26b9f9ca8a1f8935c8e141ffe01"} Jul 09 14:55:42.480280 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:42.480234 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pvxdf" podStartSLOduration=8.24618334 podStartE2EDuration="24.480214896s" totalImagesPullingTime="16.234031556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:41.612992469 +0000 UTC m=+23.935442022" watchObservedRunningTime="2026-07-09 14:55:42.480214896 +0000 UTC m=+24.802664451" Jul 09 14:55:42.481026 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:42.480987 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n5q2b" podStartSLOduration=3.515390131 podStartE2EDuration="24.480971642s" totalImagesPullingTime="20.965581511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:42.480291677 +0000 UTC m=+24.802741252" watchObservedRunningTime="2026-07-09 14:55:42.480971642 +0000 UTC m=+24.803421199" Jul 09 14:55:42.496840 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:42.496772 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-136.ec2.internal" podStartSLOduration=23.496757594 podStartE2EDuration="23.496757594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:42.496693151 +0000 UTC m=+24.819142717" watchObservedRunningTime="2026-07-09 14:55:42.496757594 +0000 UTC m=+24.819207147" Jul 09 14:55:42.952483 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:42.952461 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 14:55:43.151765 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:43.151645 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:55:42.95247967Z","UUID":"e61cfff1-7c1a-495b-9dce-b1953bc9e315","Handler":null,"Name":"","Endpoint":""} Jul 09 14:55:43.153011 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:43.152992 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 14:55:43.153111 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:43.153027 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 14:55:43.229534 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:43.229509 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:43.229674 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:43.229507 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:43.229674 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:43.229599 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:43.229756 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:43.229672 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:43.473319 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:43.473230 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" event={"ID":"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce","Type":"ContainerStarted","Data":"f57623f657b72638d563d1e8a0995e68aa3e842534ff1cef82a5886cdf68915f"} Jul 09 14:55:44.233181 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:44.233157 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:44.233349 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:44.233266 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:44.478234 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:44.478209 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 14:55:44.478664 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:44.478590 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" event={"ID":"15b270e9-b495-4155-94bf-e52af210f574","Type":"ContainerStarted","Data":"b5d57b9331d747e7519fe2d07fdf089eca819d761fa4964ca2e34eaaeb314826"} Jul 09 14:55:45.230131 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:45.229920 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:45.230290 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:45.229990 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:45.230290 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:45.230226 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:45.230412 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:45.230318 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:45.482690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:45.482615 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" event={"ID":"676211be-5c3a-4ffb-b15e-fc0a2fa1b4ce","Type":"ContainerStarted","Data":"7b307de864f3c419fe4d40cdad6088c2551aa59327452253c404f0f9fca66bd2"} Jul 09 14:55:45.508777 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:45.508731 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djfvr" podStartSLOduration=3.423679194 podStartE2EDuration="27.508719025s" totalImagesPullingTime="24.085039831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:45.508549283 +0000 UTC m=+27.830998839" watchObservedRunningTime="2026-07-09 14:55:45.508719025 +0000 UTC m=+27.831168578" Jul 09 14:55:45.840554 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:45.840524 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:45.841366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:45.841342 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:46.232922 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:46.232856 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:46.233057 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:46.232992 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:46.485098 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:46.485021 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:46.485584 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:46.485347 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pvxdf" Jul 09 14:55:47.229968 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:47.229937 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:47.230146 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:47.229937 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:47.230146 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:47.230069 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:47.230248 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:47.230167 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:47.489748 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:47.489722 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 14:55:48.232320 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:48.232228 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:48.232473 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:48.232326 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:48.494017 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:48.493938 2584 generic.go:356] "Generic (PLEG): container finished" podID="75737144-b8b7-4ba4-9e47-3af102c57948" containerID="5cf87f9f98872b9daa54affee2c7f2982f1f0cd9b11caba3aa6eb71c2b223201" exitCode=0 Jul 09 14:55:48.494641 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:48.494003 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sncmz" event={"ID":"75737144-b8b7-4ba4-9e47-3af102c57948","Type":"ContainerDied","Data":"5cf87f9f98872b9daa54affee2c7f2982f1f0cd9b11caba3aa6eb71c2b223201"} Jul 09 14:55:48.497510 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:48.497481 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 14:55:48.497831 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:48.497812 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" event={"ID":"15b270e9-b495-4155-94bf-e52af210f574","Type":"ContainerStarted","Data":"f3f85a0ec6c31c620d6b35159df96a2914683ab911a847f81ec6d8580a39d924"} Jul 09 14:55:48.498112 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:48.498092 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:48.498263 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:48.498159 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:48.498263 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:48.498204 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:48.498338 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:48.498282 2584 scope.go:117] "RemoveContainer" containerID="e5ad440b78846ad83cd12f0de5bcfdd4a55a71cfc6950fee2cb50575db8efe76" Jul 09 14:55:48.514906 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:48.514884 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:48.515067 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:48.515054 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:55:49.229675 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:49.229647 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:49.229898 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:49.229754 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:49.229898 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:49.229823 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:49.230481 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:49.229947 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:49.507067 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:49.507043 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 14:55:49.507474 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:49.507444 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" event={"ID":"15b270e9-b495-4155-94bf-e52af210f574","Type":"ContainerStarted","Data":"cee0259ca943e2a3707966d0d63c156af94dab1a973a75dc4f5b474dc7dd0a22"} Jul 09 14:55:49.730150 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:49.730090 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" podStartSLOduration=10.428764723 podStartE2EDuration="31.730073416s" totalImagesPullingTime="21.301308693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:49.541931281 +0000 UTC m=+31.864380834" watchObservedRunningTime="2026-07-09 14:55:49.730073416 +0000 UTC m=+32.052522948" Jul 09 14:55:49.730883 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:49.730862 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hxwrn"] Jul 09 14:55:49.730984 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:49.730956 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:49.731057 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:49.731040 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:49.733512 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:49.733469 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zt9qm"] Jul 09 14:55:49.733618 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:49.733598 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:49.733753 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:49.733701 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:49.734189 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:49.734162 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k82zv"] Jul 09 14:55:49.734261 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:49.734252 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:49.734369 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:49.734342 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:50.511485 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:50.511457 2584 generic.go:356] "Generic (PLEG): container finished" podID="75737144-b8b7-4ba4-9e47-3af102c57948" containerID="a43c96f50eb77620956e81d00f92a306949edc054806b2d3d0f6be8b5e43c273" exitCode=0 Jul 09 14:55:50.511873 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:50.511551 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sncmz" event={"ID":"75737144-b8b7-4ba4-9e47-3af102c57948","Type":"ContainerDied","Data":"a43c96f50eb77620956e81d00f92a306949edc054806b2d3d0f6be8b5e43c273"} Jul 09 14:55:50.939659 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:50.939429 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:50.939659 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:50.939632 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:50.939819 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:50.939587 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:50.939819 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:50.939726 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:50.939819 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:50.939734 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret podName:c471aae4-d380-41c3-a7c9-0f99c3c9d65a nodeName:}" failed. No retries permitted until 2026-07-09 14:56:22.939717786 +0000 UTC m=+65.262167322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret") pod "global-pull-secret-syncer-hxwrn" (UID: "c471aae4-d380-41c3-a7c9-0f99c3c9d65a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:55:50.939819 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:50.939762 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs podName:df75ee8a-be1a-4c76-a301-0c57e03d4e2d nodeName:}" failed. No retries permitted until 2026-07-09 14:56:22.939750659 +0000 UTC m=+65.262200191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs") pod "network-metrics-daemon-zt9qm" (UID: "df75ee8a-be1a-4c76-a301-0c57e03d4e2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:55:51.040685 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:51.040661 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94nr6\" (UniqueName: \"kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6\") pod \"network-check-target-k82zv\" (UID: \"5dec1137-cf87-4728-a768-ebff59195ca4\") " pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:51.040834 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:51.040755 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:55:51.040834 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:51.040767 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:55:51.040834 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:51.040776 2584 projected.go:196] Error preparing data for projected volume kube-api-access-94nr6 for pod openshift-network-diagnostics/network-check-target-k82zv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:51.040834 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:51.040817 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6 podName:5dec1137-cf87-4728-a768-ebff59195ca4 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:23.040804504 +0000 UTC m=+65.363254039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-94nr6" (UniqueName: "kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6") pod "network-check-target-k82zv" (UID: "5dec1137-cf87-4728-a768-ebff59195ca4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:55:51.229359 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:51.229297 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:51.229475 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:51.229386 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:51.229475 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:51.229391 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:51.229475 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:51.229468 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:51.229596 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:51.229387 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:51.229596 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:51.229561 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:52.518318 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:52.518282 2584 generic.go:356] "Generic (PLEG): container finished" podID="75737144-b8b7-4ba4-9e47-3af102c57948" containerID="52c1cf1e808104e45a9263c65665321a1edd5b8f4a6703d1c6c2acae6099d2b8" exitCode=0 Jul 09 14:55:52.518671 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:52.518356 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sncmz" event={"ID":"75737144-b8b7-4ba4-9e47-3af102c57948","Type":"ContainerDied","Data":"52c1cf1e808104e45a9263c65665321a1edd5b8f4a6703d1c6c2acae6099d2b8"} Jul 09 14:55:53.229866 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:53.229833 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:53.230031 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:53.229879 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:53.230031 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:53.229932 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:53.230031 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:53.229947 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k82zv" podUID="5dec1137-cf87-4728-a768-ebff59195ca4" Jul 09 14:55:53.230031 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:53.230004 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxwrn" podUID="c471aae4-d380-41c3-a7c9-0f99c3c9d65a" Jul 09 14:55:53.230240 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:53.230133 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt9qm" podUID="df75ee8a-be1a-4c76-a301-0c57e03d4e2d" Jul 09 14:55:54.530153 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.530126 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-136.ec2.internal" event="NodeReady" Jul 09 14:55:54.530553 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.530266 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 14:55:54.582288 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.582256 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mrzwc"] Jul 09 14:55:54.584298 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.584277 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.585202 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.585179 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mjzpf"] Jul 09 14:55:54.586760 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.586745 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mjzpf" Jul 09 14:55:54.587057 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.587039 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 14:55:54.587143 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.587130 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 14:55:54.587614 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.587597 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rns85\"" Jul 09 14:55:54.589731 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.589711 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 14:55:54.589826 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.589809 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 14:55:54.589901 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.589829 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 14:55:54.589901 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.589853 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pfsrh\"" Jul 09 14:55:54.599567 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.596785 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mrzwc"] Jul 09 14:55:54.599778 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.599676 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mjzpf"] Jul 09 14:55:54.667093 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.667065 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h75bh\" (UniqueName: \"kubernetes.io/projected/c3206fc5-3f9c-4dc7-b927-2814ca942e2f-kube-api-access-h75bh\") pod \"ingress-canary-mjzpf\" (UID: \"c3206fc5-3f9c-4dc7-b927-2814ca942e2f\") " pod="openshift-ingress-canary/ingress-canary-mjzpf" Jul 09 14:55:54.667253 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.667123 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpnrs\" (UniqueName: \"kubernetes.io/projected/947a6a4b-bd97-4327-ade2-c01882a909e0-kube-api-access-mpnrs\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.667253 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.667153 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/947a6a4b-bd97-4327-ade2-c01882a909e0-tmp-dir\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.667253 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.667200 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.667253 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.667249 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3206fc5-3f9c-4dc7-b927-2814ca942e2f-cert\") pod \"ingress-canary-mjzpf\" (UID: \"c3206fc5-3f9c-4dc7-b927-2814ca942e2f\") " pod="openshift-ingress-canary/ingress-canary-mjzpf" Jul 09 14:55:54.667446 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.667308 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/947a6a4b-bd97-4327-ade2-c01882a909e0-config-volume\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.768350 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.768322 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/947a6a4b-bd97-4327-ade2-c01882a909e0-config-volume\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.768533 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.768387 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h75bh\" (UniqueName: \"kubernetes.io/projected/c3206fc5-3f9c-4dc7-b927-2814ca942e2f-kube-api-access-h75bh\") pod \"ingress-canary-mjzpf\" (UID: \"c3206fc5-3f9c-4dc7-b927-2814ca942e2f\") " pod="openshift-ingress-canary/ingress-canary-mjzpf" Jul 09 14:55:54.768533 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.768426 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpnrs\" (UniqueName: \"kubernetes.io/projected/947a6a4b-bd97-4327-ade2-c01882a909e0-kube-api-access-mpnrs\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.768533 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.768452 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/947a6a4b-bd97-4327-ade2-c01882a909e0-tmp-dir\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.768533 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.768475 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.768533 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.768525 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3206fc5-3f9c-4dc7-b927-2814ca942e2f-cert\") pod \"ingress-canary-mjzpf\" (UID: \"c3206fc5-3f9c-4dc7-b927-2814ca942e2f\") " pod="openshift-ingress-canary/ingress-canary-mjzpf" Jul 09 14:55:54.768973 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:54.768944 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:55:54.769133 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:54.769023 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls podName:947a6a4b-bd97-4327-ade2-c01882a909e0 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:55.269000829 +0000 UTC m=+37.591450372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls") pod "dns-default-mrzwc" (UID: "947a6a4b-bd97-4327-ade2-c01882a909e0") : secret "dns-default-metrics-tls" not found Jul 09 14:55:54.769208 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.769146 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/947a6a4b-bd97-4327-ade2-c01882a909e0-tmp-dir\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.769379 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.769359 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/947a6a4b-bd97-4327-ade2-c01882a909e0-config-volume\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.773978 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.773954 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3206fc5-3f9c-4dc7-b927-2814ca942e2f-cert\") pod \"ingress-canary-mjzpf\" (UID: \"c3206fc5-3f9c-4dc7-b927-2814ca942e2f\") " pod="openshift-ingress-canary/ingress-canary-mjzpf" Jul 09 14:55:54.777761 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.777739 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpnrs\" (UniqueName: \"kubernetes.io/projected/947a6a4b-bd97-4327-ade2-c01882a909e0-kube-api-access-mpnrs\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:54.778525 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.778485 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h75bh\" (UniqueName: \"kubernetes.io/projected/c3206fc5-3f9c-4dc7-b927-2814ca942e2f-kube-api-access-h75bh\") pod \"ingress-canary-mjzpf\" (UID: \"c3206fc5-3f9c-4dc7-b927-2814ca942e2f\") " pod="openshift-ingress-canary/ingress-canary-mjzpf" Jul 09 14:55:54.902902 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:54.902839 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mjzpf" Jul 09 14:55:55.056233 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.056072 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mjzpf"] Jul 09 14:55:55.061043 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:55:55.061018 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3206fc5_3f9c_4dc7_b927_2814ca942e2f.slice/crio-fd22f47bfed4ab8edf01b2c7041823bebcf7f03b62eff9c0ec58573fba5122f2 WatchSource:0}: Error finding container fd22f47bfed4ab8edf01b2c7041823bebcf7f03b62eff9c0ec58573fba5122f2: Status 404 returned error can't find the container with id fd22f47bfed4ab8edf01b2c7041823bebcf7f03b62eff9c0ec58573fba5122f2 Jul 09 14:55:55.229752 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.229672 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:55:55.229904 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.229876 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:55:55.229904 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.229862 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:55:55.238561 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.238542 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:55:55.238703 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.238634 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:55:55.238703 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.238660 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9zbh8\"" Jul 09 14:55:55.238915 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.238898 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:55:55.244183 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.244165 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c5h92\"" Jul 09 14:55:55.244782 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.244763 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:55:55.273272 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.273255 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:55.273381 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:55.273369 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:55:55.273425 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:55.273418 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls podName:947a6a4b-bd97-4327-ade2-c01882a909e0 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:56.27340412 +0000 UTC m=+38.595853652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls") pod "dns-default-mrzwc" (UID: "947a6a4b-bd97-4327-ade2-c01882a909e0") : secret "dns-default-metrics-tls" not found Jul 09 14:55:55.525920 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:55.525886 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mjzpf" event={"ID":"c3206fc5-3f9c-4dc7-b927-2814ca942e2f","Type":"ContainerStarted","Data":"fd22f47bfed4ab8edf01b2c7041823bebcf7f03b62eff9c0ec58573fba5122f2"} Jul 09 14:55:56.282625 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:56.282586 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:56.283449 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:56.282785 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:55:56.283449 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:56.282870 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls podName:947a6a4b-bd97-4327-ade2-c01882a909e0 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:58.282846713 +0000 UTC m=+40.605296252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls") pod "dns-default-mrzwc" (UID: "947a6a4b-bd97-4327-ade2-c01882a909e0") : secret "dns-default-metrics-tls" not found Jul 09 14:55:57.535163 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:57.534604 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sncmz" event={"ID":"75737144-b8b7-4ba4-9e47-3af102c57948","Type":"ContainerStarted","Data":"a5d8b35355743dc3c9745e03b1b8195031c7c020f999a18e8028baf7a37c96b4"} Jul 09 14:55:58.298262 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:58.298230 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:55:58.298470 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:58.298381 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:55:58.298470 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:55:58.298462 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls podName:947a6a4b-bd97-4327-ade2-c01882a909e0 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:02.298438288 +0000 UTC m=+44.620887821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls") pod "dns-default-mrzwc" (UID: "947a6a4b-bd97-4327-ade2-c01882a909e0") : secret "dns-default-metrics-tls" not found Jul 09 14:55:58.539692 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:58.539656 2584 generic.go:356] "Generic (PLEG): container finished" podID="75737144-b8b7-4ba4-9e47-3af102c57948" containerID="a5d8b35355743dc3c9745e03b1b8195031c7c020f999a18e8028baf7a37c96b4" exitCode=0 Jul 09 14:55:58.540053 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:58.539739 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sncmz" event={"ID":"75737144-b8b7-4ba4-9e47-3af102c57948","Type":"ContainerDied","Data":"a5d8b35355743dc3c9745e03b1b8195031c7c020f999a18e8028baf7a37c96b4"} Jul 09 14:55:59.545780 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:59.545749 2584 generic.go:356] "Generic (PLEG): container finished" podID="75737144-b8b7-4ba4-9e47-3af102c57948" containerID="0818dd8e03f32ce96cbd1efb08d9f44ccaae9713fea37ca6ddf9e72255acf966" exitCode=0 Jul 09 14:55:59.546235 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:55:59.545787 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sncmz" event={"ID":"75737144-b8b7-4ba4-9e47-3af102c57948","Type":"ContainerDied","Data":"0818dd8e03f32ce96cbd1efb08d9f44ccaae9713fea37ca6ddf9e72255acf966"} Jul 09 14:56:00.550770 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:00.550741 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sncmz" event={"ID":"75737144-b8b7-4ba4-9e47-3af102c57948","Type":"ContainerStarted","Data":"137bc55f2ab4ec8fd31090987a792430399e01505e72547a9945a958d44ddd10"} Jul 09 14:56:00.552156 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:00.552134 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mjzpf" event={"ID":"c3206fc5-3f9c-4dc7-b927-2814ca942e2f","Type":"ContainerStarted","Data":"a590c840fa59207255885e9eaef9a277f7097e6adde3d36fa7eda25387e9b4fb"} Jul 09 14:56:00.580177 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:00.580132 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sncmz" podStartSLOduration=8.669961459 podStartE2EDuration="42.580118637s" totalImagesPullingTime="33.910157178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:00.579046689 +0000 UTC m=+42.901496292" watchObservedRunningTime="2026-07-09 14:56:00.580118637 +0000 UTC m=+42.902568191" Jul 09 14:56:00.596054 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:00.596007 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mjzpf" podStartSLOduration=1.528389024 podStartE2EDuration="6.595993764s" totalImagesPullingTime="5.06760474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:00.595861227 +0000 UTC m=+42.918310781" watchObservedRunningTime="2026-07-09 14:56:00.595993764 +0000 UTC m=+42.918443317" Jul 09 14:56:02.328003 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:02.327964 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:56:02.328362 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:02.328068 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:56:02.328362 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:02.328142 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls podName:947a6a4b-bd97-4327-ade2-c01882a909e0 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:10.328128839 +0000 UTC m=+52.650578375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls") pod "dns-default-mrzwc" (UID: "947a6a4b-bd97-4327-ade2-c01882a909e0") : secret "dns-default-metrics-tls" not found Jul 09 14:56:10.381448 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:10.381404 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:56:10.382007 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:10.381535 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:56:10.382007 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:10.381600 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls podName:947a6a4b-bd97-4327-ade2-c01882a909e0 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:26.381587537 +0000 UTC m=+68.704037069 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls") pod "dns-default-mrzwc" (UID: "947a6a4b-bd97-4327-ade2-c01882a909e0") : secret "dns-default-metrics-tls" not found Jul 09 14:56:20.525790 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:20.525764 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5lwz" Jul 09 14:56:22.962756 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:22.962049 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:56:22.963338 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:22.962116 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:56:22.965530 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:22.965490 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:56:22.965530 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:22.965510 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:56:22.972461 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:22.972441 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 14:56:22.972594 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:22.972548 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs podName:df75ee8a-be1a-4c76-a301-0c57e03d4e2d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:26.972526694 +0000 UTC m=+129.294976242 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs") pod "network-metrics-daemon-zt9qm" (UID: "df75ee8a-be1a-4c76-a301-0c57e03d4e2d") : secret "metrics-daemon-secret" not found Jul 09 14:56:22.975962 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:22.975936 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c471aae4-d380-41c3-a7c9-0f99c3c9d65a-original-pull-secret\") pod \"global-pull-secret-syncer-hxwrn\" (UID: \"c471aae4-d380-41c3-a7c9-0f99c3c9d65a\") " pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:56:23.064752 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:23.064725 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94nr6\" (UniqueName: \"kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6\") pod \"network-check-target-k82zv\" (UID: \"5dec1137-cf87-4728-a768-ebff59195ca4\") " pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:56:23.067919 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:23.067899 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:56:23.078349 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:23.078327 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:56:23.088083 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:23.088060 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94nr6\" (UniqueName: \"kubernetes.io/projected/5dec1137-cf87-4728-a768-ebff59195ca4-kube-api-access-94nr6\") pod \"network-check-target-k82zv\" (UID: \"5dec1137-cf87-4728-a768-ebff59195ca4\") " pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:56:23.146884 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:23.146867 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c5h92\"" Jul 09 14:56:23.154399 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:23.154379 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:56:23.156692 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:23.156677 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxwrn" Jul 09 14:56:23.290607 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:23.290558 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hxwrn"] Jul 09 14:56:23.294395 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:56:23.294369 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc471aae4_d380_41c3_a7c9_0f99c3c9d65a.slice/crio-4f87d8091a6133ca2f5b3752d7af610203492dc3858c94b07632ba4bbd8daf3b WatchSource:0}: Error finding container 4f87d8091a6133ca2f5b3752d7af610203492dc3858c94b07632ba4bbd8daf3b: Status 404 returned error can't find the container with id 4f87d8091a6133ca2f5b3752d7af610203492dc3858c94b07632ba4bbd8daf3b Jul 09 14:56:23.317827 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:23.317772 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k82zv"] Jul 09 14:56:23.320866 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:56:23.320845 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dec1137_cf87_4728_a768_ebff59195ca4.slice/crio-61e25a092d72ad8ac4c6c85b63acdbe7d37798aa0c2d48ff868346695ca3b822 WatchSource:0}: Error finding container 61e25a092d72ad8ac4c6c85b63acdbe7d37798aa0c2d48ff868346695ca3b822: Status 404 returned error can't find the container with id 61e25a092d72ad8ac4c6c85b63acdbe7d37798aa0c2d48ff868346695ca3b822 Jul 09 14:56:23.608196 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:23.608157 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hxwrn" event={"ID":"c471aae4-d380-41c3-a7c9-0f99c3c9d65a","Type":"ContainerStarted","Data":"4f87d8091a6133ca2f5b3752d7af610203492dc3858c94b07632ba4bbd8daf3b"} Jul 09 14:56:23.609190 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:23.609164 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k82zv" event={"ID":"5dec1137-cf87-4728-a768-ebff59195ca4","Type":"ContainerStarted","Data":"61e25a092d72ad8ac4c6c85b63acdbe7d37798aa0c2d48ff868346695ca3b822"} Jul 09 14:56:26.386969 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:26.386931 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:56:26.387358 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:26.387052 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:56:26.387358 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:26.387111 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls podName:947a6a4b-bd97-4327-ade2-c01882a909e0 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:58.387092178 +0000 UTC m=+100.709541709 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls") pod "dns-default-mrzwc" (UID: "947a6a4b-bd97-4327-ade2-c01882a909e0") : secret "dns-default-metrics-tls" not found Jul 09 14:56:28.624226 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:28.624193 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hxwrn" event={"ID":"c471aae4-d380-41c3-a7c9-0f99c3c9d65a","Type":"ContainerStarted","Data":"054bca9605561e80cac54c42ce6878aa7138ae142aa4dbd5ea042c37ce93a52c"} Jul 09 14:56:28.625724 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:28.625691 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k82zv" event={"ID":"5dec1137-cf87-4728-a768-ebff59195ca4","Type":"ContainerStarted","Data":"3787383874d00798f37bf2a1888b8a7fefabcac596ca11c0fda45ee8cd5653f2"} Jul 09 14:56:28.625856 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:28.625809 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:56:28.660078 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:28.660035 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k82zv" podStartSLOduration=66.092574277 podStartE2EDuration="1m10.66002083s" totalImagesPullingTime="4.567446553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:28.659378012 +0000 UTC m=+70.981827591" watchObservedRunningTime="2026-07-09 14:56:28.66002083 +0000 UTC m=+70.982470384" Jul 09 14:56:28.660217 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:28.660118 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hxwrn" podStartSLOduration=66.063186225 podStartE2EDuration="1m10.660111932s" totalImagesPullingTime="4.596925707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:28.641706756 +0000 UTC m=+70.964156321" watchObservedRunningTime="2026-07-09 14:56:28.660111932 +0000 UTC m=+70.982561488" Jul 09 14:56:51.087879 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.087840 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7bb7644d9b-sr7lc"] Jul 09 14:56:51.092336 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.092306 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.095889 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.095866 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 14:56:51.096118 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.096096 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 14:56:51.096184 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.096126 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 14:56:51.096238 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.096208 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 14:56:51.096548 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.096526 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 14:56:51.096656 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.096607 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f9v2h\"" Jul 09 14:56:51.096994 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.096980 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 14:56:51.107701 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.107677 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bb7644d9b-sr7lc"] Jul 09 14:56:51.142369 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.142348 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.142480 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.142385 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8gdx\" (UniqueName: \"kubernetes.io/projected/ebd75b29-960b-4902-a220-e4943e5fed3c-kube-api-access-s8gdx\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.142480 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.142407 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.142480 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.142427 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-stats-auth\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.142638 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.142516 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-default-certificate\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.219069 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.218173 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbds"] Jul 09 14:56:51.221276 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.221250 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbds" Jul 09 14:56:51.224771 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.224750 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:56:51.225171 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.225155 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cz7lg\"" Jul 09 14:56:51.225457 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.225442 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 14:56:51.235382 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.235361 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbds"] Jul 09 14:56:51.243707 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.243690 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-stats-auth\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.243794 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.243718 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-default-certificate\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.243794 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.243739 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnbkl\" (UniqueName: \"kubernetes.io/projected/0b14a24e-b2d4-48a1-a3c7-f350804a14a5-kube-api-access-nnbkl\") pod \"volume-data-source-validator-78495597f6-tgbds\" (UID: \"0b14a24e-b2d4-48a1-a3c7-f350804a14a5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbds" Jul 09 14:56:51.243794 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.243787 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.243936 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.243813 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8gdx\" (UniqueName: \"kubernetes.io/projected/ebd75b29-960b-4902-a220-e4943e5fed3c-kube-api-access-s8gdx\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.243936 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.243840 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.243936 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:51.243929 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:56:51.244091 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:51.243986 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:56:51.743963997 +0000 UTC m=+94.066413547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : configmap references non-existent config key: service-ca.crt Jul 09 14:56:51.244091 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:51.244023 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:56:51.744003337 +0000 UTC m=+94.066452898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : secret "router-metrics-certs-default" not found Jul 09 14:56:51.246203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.246186 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-stats-auth\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.246337 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.246318 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-default-certificate\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.263057 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.263035 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8gdx\" (UniqueName: \"kubernetes.io/projected/ebd75b29-960b-4902-a220-e4943e5fed3c-kube-api-access-s8gdx\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.308158 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.308139 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z"] Jul 09 14:56:51.311020 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.311007 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:56:51.314881 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.314864 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cv8qq\"" Jul 09 14:56:51.315614 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.315594 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 14:56:51.315886 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.315870 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 14:56:51.316006 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.315937 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:56:51.316566 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.316547 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-v4bth"] Jul 09 14:56:51.319216 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.319198 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.321603 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.321587 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 14:56:51.322673 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.322658 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 14:56:51.323076 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.323051 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-txbc9\"" Jul 09 14:56:51.323172 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.323113 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 14:56:51.323172 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.323130 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 14:56:51.328600 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.328545 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 14:56:51.329691 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.329671 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z"] Jul 09 14:56:51.332636 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.332618 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-v4bth"] Jul 09 14:56:51.344915 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.344867 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71427bca-9234-45e0-a4a5-eb65e439a446-serving-cert\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.344915 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.344909 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkpd9\" (UniqueName: \"kubernetes.io/projected/71427bca-9234-45e0-a4a5-eb65e439a446-kube-api-access-zkpd9\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.345047 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.344961 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwx4f\" (UniqueName: \"kubernetes.io/projected/eea813a9-b795-489b-992d-a6b37da36f6f-kube-api-access-kwx4f\") pod \"cluster-samples-operator-65db858894-vgp7z\" (UID: \"eea813a9-b795-489b-992d-a6b37da36f6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:56:51.345127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.345110 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71427bca-9234-45e0-a4a5-eb65e439a446-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.345175 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.345153 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71427bca-9234-45e0-a4a5-eb65e439a446-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.345217 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.345180 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnbkl\" (UniqueName: \"kubernetes.io/projected/0b14a24e-b2d4-48a1-a3c7-f350804a14a5-kube-api-access-nnbkl\") pod \"volume-data-source-validator-78495597f6-tgbds\" (UID: \"0b14a24e-b2d4-48a1-a3c7-f350804a14a5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbds" Jul 09 14:56:51.345255 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.345238 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71427bca-9234-45e0-a4a5-eb65e439a446-snapshots\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.345307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.345265 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71427bca-9234-45e0-a4a5-eb65e439a446-tmp\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.345307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.345279 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-vgp7z\" (UID: \"eea813a9-b795-489b-992d-a6b37da36f6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:56:51.360827 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.360797 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnbkl\" (UniqueName: \"kubernetes.io/projected/0b14a24e-b2d4-48a1-a3c7-f350804a14a5-kube-api-access-nnbkl\") pod \"volume-data-source-validator-78495597f6-tgbds\" (UID: \"0b14a24e-b2d4-48a1-a3c7-f350804a14a5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbds" Jul 09 14:56:51.445921 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.445893 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71427bca-9234-45e0-a4a5-eb65e439a446-snapshots\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.446041 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.445923 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71427bca-9234-45e0-a4a5-eb65e439a446-tmp\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.446041 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.445940 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-vgp7z\" (UID: \"eea813a9-b795-489b-992d-a6b37da36f6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:56:51.446041 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.445959 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71427bca-9234-45e0-a4a5-eb65e439a446-serving-cert\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.446041 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.445999 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkpd9\" (UniqueName: \"kubernetes.io/projected/71427bca-9234-45e0-a4a5-eb65e439a446-kube-api-access-zkpd9\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.446041 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.446026 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwx4f\" (UniqueName: \"kubernetes.io/projected/eea813a9-b795-489b-992d-a6b37da36f6f-kube-api-access-kwx4f\") pod \"cluster-samples-operator-65db858894-vgp7z\" (UID: \"eea813a9-b795-489b-992d-a6b37da36f6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:56:51.446296 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.446088 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71427bca-9234-45e0-a4a5-eb65e439a446-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.446296 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:51.446092 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:56:51.446296 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.446120 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71427bca-9234-45e0-a4a5-eb65e439a446-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.446594 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:51.446159 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls podName:eea813a9-b795-489b-992d-a6b37da36f6f nodeName:}" failed. No retries permitted until 2026-07-09 14:56:51.946139511 +0000 UTC m=+94.268589057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls") pod "cluster-samples-operator-65db858894-vgp7z" (UID: "eea813a9-b795-489b-992d-a6b37da36f6f") : secret "samples-operator-tls" not found Jul 09 14:56:51.446685 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.446541 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71427bca-9234-45e0-a4a5-eb65e439a446-tmp\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.446685 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.446666 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71427bca-9234-45e0-a4a5-eb65e439a446-snapshots\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.446758 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.446714 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71427bca-9234-45e0-a4a5-eb65e439a446-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.447668 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.447648 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71427bca-9234-45e0-a4a5-eb65e439a446-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.448463 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.448448 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71427bca-9234-45e0-a4a5-eb65e439a446-serving-cert\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.455310 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.455281 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkpd9\" (UniqueName: \"kubernetes.io/projected/71427bca-9234-45e0-a4a5-eb65e439a446-kube-api-access-zkpd9\") pod \"insights-operator-68d9dd94cf-v4bth\" (UID: \"71427bca-9234-45e0-a4a5-eb65e439a446\") " pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.455533 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.455488 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwx4f\" (UniqueName: \"kubernetes.io/projected/eea813a9-b795-489b-992d-a6b37da36f6f-kube-api-access-kwx4f\") pod \"cluster-samples-operator-65db858894-vgp7z\" (UID: \"eea813a9-b795-489b-992d-a6b37da36f6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:56:51.530953 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.530937 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbds" Jul 09 14:56:51.628562 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.628531 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" Jul 09 14:56:51.657359 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.657331 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbds"] Jul 09 14:56:51.660598 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:56:51.660565 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b14a24e_b2d4_48a1_a3c7_f350804a14a5.slice/crio-766e7c25a105fc8dfb8f49b6aa2a20b1c523384256c77a5386ee6ca48431defe WatchSource:0}: Error finding container 766e7c25a105fc8dfb8f49b6aa2a20b1c523384256c77a5386ee6ca48431defe: Status 404 returned error can't find the container with id 766e7c25a105fc8dfb8f49b6aa2a20b1c523384256c77a5386ee6ca48431defe Jul 09 14:56:51.682215 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.682182 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbds" event={"ID":"0b14a24e-b2d4-48a1-a3c7-f350804a14a5","Type":"ContainerStarted","Data":"766e7c25a105fc8dfb8f49b6aa2a20b1c523384256c77a5386ee6ca48431defe"} Jul 09 14:56:51.750082 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.750052 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.750195 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.750113 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:51.750244 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:51.750201 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:56:51.750279 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:51.750250 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:56:52.750237515 +0000 UTC m=+95.072687048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : configmap references non-existent config key: service-ca.crt Jul 09 14:56:51.750279 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:51.750266 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:56:52.750259228 +0000 UTC m=+95.072708760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : secret "router-metrics-certs-default" not found Jul 09 14:56:51.752853 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.752828 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-v4bth"] Jul 09 14:56:51.755952 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:56:51.755931 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71427bca_9234_45e0_a4a5_eb65e439a446.slice/crio-41dd5dceaab93e4394c8ca3f202af430daa2bea255fd04c336b14b73e4df01d0 WatchSource:0}: Error finding container 41dd5dceaab93e4394c8ca3f202af430daa2bea255fd04c336b14b73e4df01d0: Status 404 returned error can't find the container with id 41dd5dceaab93e4394c8ca3f202af430daa2bea255fd04c336b14b73e4df01d0 Jul 09 14:56:51.951640 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:51.951565 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-vgp7z\" (UID: \"eea813a9-b795-489b-992d-a6b37da36f6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:56:51.951753 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:51.951705 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:56:51.951794 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:51.951766 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls podName:eea813a9-b795-489b-992d-a6b37da36f6f nodeName:}" failed. No retries permitted until 2026-07-09 14:56:52.951750973 +0000 UTC m=+95.274200505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls") pod "cluster-samples-operator-65db858894-vgp7z" (UID: "eea813a9-b795-489b-992d-a6b37da36f6f") : secret "samples-operator-tls" not found Jul 09 14:56:52.686825 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:52.686783 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" event={"ID":"71427bca-9234-45e0-a4a5-eb65e439a446","Type":"ContainerStarted","Data":"41dd5dceaab93e4394c8ca3f202af430daa2bea255fd04c336b14b73e4df01d0"} Jul 09 14:56:52.756229 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:52.756191 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:52.756400 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:52.756279 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:52.756400 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:52.756306 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:56:52.756400 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:52.756374 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:56:54.756354949 +0000 UTC m=+97.078804495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : secret "router-metrics-certs-default" not found Jul 09 14:56:52.756400 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:52.756390 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:56:54.756381992 +0000 UTC m=+97.078831523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : configmap references non-existent config key: service-ca.crt Jul 09 14:56:52.957931 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:52.957843 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-vgp7z\" (UID: \"eea813a9-b795-489b-992d-a6b37da36f6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:56:52.958086 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:52.958035 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:56:52.958142 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:52.958096 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls podName:eea813a9-b795-489b-992d-a6b37da36f6f nodeName:}" failed. No retries permitted until 2026-07-09 14:56:54.958082714 +0000 UTC m=+97.280532246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls") pod "cluster-samples-operator-65db858894-vgp7z" (UID: "eea813a9-b795-489b-992d-a6b37da36f6f") : secret "samples-operator-tls" not found Jul 09 14:56:53.691805 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:53.691771 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbds" event={"ID":"0b14a24e-b2d4-48a1-a3c7-f350804a14a5","Type":"ContainerStarted","Data":"84cbd9e1efe60478fa7f682069da3f6e0a30c84d5e266060c00da998f9c668c4"} Jul 09 14:56:53.711491 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:53.711436 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbds" podStartSLOduration=1.261935934 podStartE2EDuration="2.711421107s" totalImagesPullingTime="1.449485173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:53.710806707 +0000 UTC m=+96.033256281" watchObservedRunningTime="2026-07-09 14:56:53.711421107 +0000 UTC m=+96.033870661" Jul 09 14:56:54.696988 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:54.696950 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" event={"ID":"71427bca-9234-45e0-a4a5-eb65e439a446","Type":"ContainerStarted","Data":"5d86f3459d9a00c6f1b5a512746dacb8bd9c535e8531ff3d2167f3ac1f9db2ea"} Jul 09 14:56:54.715875 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:54.715830 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" podStartSLOduration=1.40560375 podStartE2EDuration="3.715814175s" totalImagesPullingTime="2.310210425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:54.715064641 +0000 UTC m=+97.037514215" watchObservedRunningTime="2026-07-09 14:56:54.715814175 +0000 UTC m=+97.038263729" Jul 09 14:56:54.772479 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:54.772449 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:54.772664 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:54.772599 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:56:54.772735 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:54.772666 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:56:58.772647583 +0000 UTC m=+101.095097120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : secret "router-metrics-certs-default" not found Jul 09 14:56:54.772735 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:54.772689 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:54.772880 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:54.772860 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:56:58.772841222 +0000 UTC m=+101.095290764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : configmap references non-existent config key: service-ca.crt Jul 09 14:56:54.975076 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:54.974987 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-vgp7z\" (UID: \"eea813a9-b795-489b-992d-a6b37da36f6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:56:54.975238 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:54.975140 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:56:54.975238 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:54.975216 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls podName:eea813a9-b795-489b-992d-a6b37da36f6f nodeName:}" failed. No retries permitted until 2026-07-09 14:56:58.975197992 +0000 UTC m=+101.297647528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls") pod "cluster-samples-operator-65db858894-vgp7z" (UID: "eea813a9-b795-489b-992d-a6b37da36f6f") : secret "samples-operator-tls" not found Jul 09 14:56:55.344679 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.344630 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xr77k"] Jul 09 14:56:55.347899 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.347877 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.350839 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.350818 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 14:56:55.351319 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.351300 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 14:56:55.351434 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.351406 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cq4x2\"" Jul 09 14:56:55.369956 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.369937 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xr77k"] Jul 09 14:56:55.377790 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.377765 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfmnt\" (UniqueName: \"kubernetes.io/projected/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-api-access-pfmnt\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.377902 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.377803 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-data-volume\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.377902 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.377821 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.378029 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.377925 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-crio-socket\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.378029 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.377958 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.479229 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.479200 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-crio-socket\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.479229 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.479230 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.479381 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.479295 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmnt\" (UniqueName: \"kubernetes.io/projected/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-api-access-pfmnt\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.479381 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.479325 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-crio-socket\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.479381 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.479331 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-data-volume\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.479381 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.479371 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.479559 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:55.479429 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:56:55.479559 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:55.479433 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:56:55.479559 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:55.479489 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls podName:8d9a4c38-828f-42b0-88a3-6c0e6d418bec nodeName:}" failed. No retries permitted until 2026-07-09 14:56:55.979474035 +0000 UTC m=+98.301923567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xr77k" (UID: "8d9a4c38-828f-42b0-88a3-6c0e6d418bec") : secret "insights-runtime-extractor-tls" not found Jul 09 14:56:55.479559 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:55.479529 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm podName:8d9a4c38-828f-42b0-88a3-6c0e6d418bec nodeName:}" failed. No retries permitted until 2026-07-09 14:56:55.97951849 +0000 UTC m=+98.301968028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xr77k" (UID: "8d9a4c38-828f-42b0-88a3-6c0e6d418bec") : configmap "kube-rbac-proxy" not found Jul 09 14:56:55.479689 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.479667 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-data-volume\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.488790 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.488766 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfmnt\" (UniqueName: \"kubernetes.io/projected/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-api-access-pfmnt\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.983330 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.983298 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.983713 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:55.983373 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:55.983713 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:55.983441 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:56:55.983713 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:55.983452 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:56:55.983713 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:55.983518 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm podName:8d9a4c38-828f-42b0-88a3-6c0e6d418bec nodeName:}" failed. No retries permitted until 2026-07-09 14:56:56.98348928 +0000 UTC m=+99.305938812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xr77k" (UID: "8d9a4c38-828f-42b0-88a3-6c0e6d418bec") : configmap "kube-rbac-proxy" not found Jul 09 14:56:55.983713 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:55.983532 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls podName:8d9a4c38-828f-42b0-88a3-6c0e6d418bec nodeName:}" failed. No retries permitted until 2026-07-09 14:56:56.983526061 +0000 UTC m=+99.305975593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xr77k" (UID: "8d9a4c38-828f-42b0-88a3-6c0e6d418bec") : secret "insights-runtime-extractor-tls" not found Jul 09 14:56:56.989307 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:56.989267 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:56.989777 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:56.989343 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:56.989777 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:56.989396 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:56:56.989777 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:56.989466 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm podName:8d9a4c38-828f-42b0-88a3-6c0e6d418bec nodeName:}" failed. No retries permitted until 2026-07-09 14:56:58.989448553 +0000 UTC m=+101.311898089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xr77k" (UID: "8d9a4c38-828f-42b0-88a3-6c0e6d418bec") : configmap "kube-rbac-proxy" not found Jul 09 14:56:56.989777 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:56.989479 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:56:56.989777 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:56.989573 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls podName:8d9a4c38-828f-42b0-88a3-6c0e6d418bec nodeName:}" failed. No retries permitted until 2026-07-09 14:56:58.98955591 +0000 UTC m=+101.312005445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xr77k" (UID: "8d9a4c38-828f-42b0-88a3-6c0e6d418bec") : secret "insights-runtime-extractor-tls" not found Jul 09 14:56:57.099629 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:57.099605 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9694d_a828edc6-373d-46d7-a9f7-c0d2d0dc431d/dns-node-resolver/0.log" Jul 09 14:56:58.300421 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:58.300395 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mqcjt_d26f442c-10c0-4635-9574-bbf3d35efde9/node-ca/0.log" Jul 09 14:56:58.400345 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:58.400313 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:56:58.400490 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:58.400419 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:56:58.400490 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:58.400467 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls podName:947a6a4b-bd97-4327-ade2-c01882a909e0 nodeName:}" failed. No retries permitted until 2026-07-09 14:58:02.400453317 +0000 UTC m=+164.722902851 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls") pod "dns-default-mrzwc" (UID: "947a6a4b-bd97-4327-ade2-c01882a909e0") : secret "dns-default-metrics-tls" not found Jul 09 14:56:58.802313 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:58.802276 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:58.802459 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:58.802347 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:56:58.802459 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:58.802428 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:56:58.802567 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:58.802453 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:57:06.80243856 +0000 UTC m=+109.124888092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : configmap references non-existent config key: service-ca.crt Jul 09 14:56:58.802567 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:58.802478 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:57:06.802466947 +0000 UTC m=+109.124916480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : secret "router-metrics-certs-default" not found Jul 09 14:56:58.900080 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:58.900056 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mjzpf_c3206fc5-3f9c-4dc7-b927-2814ca942e2f/serve-healthcheck-canary/0.log" Jul 09 14:56:59.004204 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.004178 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:59.004332 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.004243 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-vgp7z\" (UID: \"eea813a9-b795-489b-992d-a6b37da36f6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:56:59.004332 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:59.004326 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:56:59.004410 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:59.004377 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls podName:8d9a4c38-828f-42b0-88a3-6c0e6d418bec nodeName:}" failed. No retries permitted until 2026-07-09 14:57:03.004363339 +0000 UTC m=+105.326812870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xr77k" (UID: "8d9a4c38-828f-42b0-88a3-6c0e6d418bec") : secret "insights-runtime-extractor-tls" not found Jul 09 14:56:59.004410 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:59.004327 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:56:59.004489 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.004407 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:56:59.004489 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:59.004455 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls podName:eea813a9-b795-489b-992d-a6b37da36f6f nodeName:}" failed. No retries permitted until 2026-07-09 14:57:07.00444028 +0000 UTC m=+109.326889825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls") pod "cluster-samples-operator-65db858894-vgp7z" (UID: "eea813a9-b795-489b-992d-a6b37da36f6f") : secret "samples-operator-tls" not found Jul 09 14:56:59.004489 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:59.004477 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:56:59.008871 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:56:59.006365 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm podName:8d9a4c38-828f-42b0-88a3-6c0e6d418bec nodeName:}" failed. No retries permitted until 2026-07-09 14:57:03.006336286 +0000 UTC m=+105.328785822 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xr77k" (UID: "8d9a4c38-828f-42b0-88a3-6c0e6d418bec") : configmap "kube-rbac-proxy" not found Jul 09 14:56:59.288755 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.288729 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8j94x"] Jul 09 14:56:59.293746 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.293728 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" Jul 09 14:56:59.298137 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.298118 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 14:56:59.298247 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.298214 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 14:56:59.299263 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.299245 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 14:56:59.299263 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.299258 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9fq5t\"" Jul 09 14:56:59.299415 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.299252 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 14:56:59.302874 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.302855 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8j94x"] Jul 09 14:56:59.409197 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.409168 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtt6h\" (UniqueName: \"kubernetes.io/projected/502018b0-73c8-4828-ada4-f9c1812dc867-kube-api-access-dtt6h\") pod \"service-ca-79f68b9f4f-8j94x\" (UID: \"502018b0-73c8-4828-ada4-f9c1812dc867\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" Jul 09 14:56:59.409337 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.409205 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/502018b0-73c8-4828-ada4-f9c1812dc867-signing-key\") pod \"service-ca-79f68b9f4f-8j94x\" (UID: \"502018b0-73c8-4828-ada4-f9c1812dc867\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" Jul 09 14:56:59.409337 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.409234 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/502018b0-73c8-4828-ada4-f9c1812dc867-signing-cabundle\") pod \"service-ca-79f68b9f4f-8j94x\" (UID: \"502018b0-73c8-4828-ada4-f9c1812dc867\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" Jul 09 14:56:59.510422 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.510395 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtt6h\" (UniqueName: \"kubernetes.io/projected/502018b0-73c8-4828-ada4-f9c1812dc867-kube-api-access-dtt6h\") pod \"service-ca-79f68b9f4f-8j94x\" (UID: \"502018b0-73c8-4828-ada4-f9c1812dc867\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" Jul 09 14:56:59.510573 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.510430 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/502018b0-73c8-4828-ada4-f9c1812dc867-signing-key\") pod \"service-ca-79f68b9f4f-8j94x\" (UID: \"502018b0-73c8-4828-ada4-f9c1812dc867\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" Jul 09 14:56:59.510573 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.510457 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/502018b0-73c8-4828-ada4-f9c1812dc867-signing-cabundle\") pod \"service-ca-79f68b9f4f-8j94x\" (UID: \"502018b0-73c8-4828-ada4-f9c1812dc867\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" Jul 09 14:56:59.511012 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.510992 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/502018b0-73c8-4828-ada4-f9c1812dc867-signing-cabundle\") pod \"service-ca-79f68b9f4f-8j94x\" (UID: \"502018b0-73c8-4828-ada4-f9c1812dc867\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" Jul 09 14:56:59.512992 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.512971 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/502018b0-73c8-4828-ada4-f9c1812dc867-signing-key\") pod \"service-ca-79f68b9f4f-8j94x\" (UID: \"502018b0-73c8-4828-ada4-f9c1812dc867\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" Jul 09 14:56:59.520177 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.520156 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtt6h\" (UniqueName: \"kubernetes.io/projected/502018b0-73c8-4828-ada4-f9c1812dc867-kube-api-access-dtt6h\") pod \"service-ca-79f68b9f4f-8j94x\" (UID: \"502018b0-73c8-4828-ada4-f9c1812dc867\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" Jul 09 14:56:59.603156 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.603089 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" Jul 09 14:56:59.630425 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.630406 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k82zv" Jul 09 14:56:59.745847 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:56:59.745818 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8j94x"] Jul 09 14:56:59.749028 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:56:59.749005 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod502018b0_73c8_4828_ada4_f9c1812dc867.slice/crio-c1137008aab2eb7a4d0d5f90d8cd39eefaad4999056c902eb8e07ae46543d26e WatchSource:0}: Error finding container c1137008aab2eb7a4d0d5f90d8cd39eefaad4999056c902eb8e07ae46543d26e: Status 404 returned error can't find the container with id c1137008aab2eb7a4d0d5f90d8cd39eefaad4999056c902eb8e07ae46543d26e Jul 09 14:57:00.718306 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:00.718267 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" event={"ID":"502018b0-73c8-4828-ada4-f9c1812dc867","Type":"ContainerStarted","Data":"c1137008aab2eb7a4d0d5f90d8cd39eefaad4999056c902eb8e07ae46543d26e"} Jul 09 14:57:02.725769 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:02.725738 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" event={"ID":"502018b0-73c8-4828-ada4-f9c1812dc867","Type":"ContainerStarted","Data":"6ed261e136aa6e4c668bb06addbd70c10498f7eae3f8cc280c6c5beb8ea881af"} Jul 09 14:57:02.767385 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:02.767337 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-8j94x" podStartSLOduration=1.614637141 podStartE2EDuration="3.767321575s" totalImagesPullingTime="2.152684434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:02.765829539 +0000 UTC m=+105.088279107" watchObservedRunningTime="2026-07-09 14:57:02.767321575 +0000 UTC m=+105.089771128" Jul 09 14:57:03.037612 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:03.037577 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:57:03.037811 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:03.037682 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:57:03.037811 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:03.037758 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:57:03.037811 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:03.037797 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:57:03.037966 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:03.037833 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls podName:8d9a4c38-828f-42b0-88a3-6c0e6d418bec nodeName:}" failed. No retries permitted until 2026-07-09 14:57:11.037810599 +0000 UTC m=+113.360260138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xr77k" (UID: "8d9a4c38-828f-42b0-88a3-6c0e6d418bec") : secret "insights-runtime-extractor-tls" not found Jul 09 14:57:03.037966 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:03.037853 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm podName:8d9a4c38-828f-42b0-88a3-6c0e6d418bec nodeName:}" failed. No retries permitted until 2026-07-09 14:57:11.03784322 +0000 UTC m=+113.360292761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xr77k" (UID: "8d9a4c38-828f-42b0-88a3-6c0e6d418bec") : configmap "kube-rbac-proxy" not found Jul 09 14:57:06.869261 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:06.869223 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:57:06.869261 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:06.869267 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:57:06.869775 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:06.869385 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:57:06.869775 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:06.869449 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:57:22.86943212 +0000 UTC m=+125.191881651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : configmap references non-existent config key: service-ca.crt Jul 09 14:57:06.869775 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:06.869465 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs podName:ebd75b29-960b-4902-a220-e4943e5fed3c nodeName:}" failed. No retries permitted until 2026-07-09 14:57:22.86945851 +0000 UTC m=+125.191908041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs") pod "router-default-7bb7644d9b-sr7lc" (UID: "ebd75b29-960b-4902-a220-e4943e5fed3c") : secret "router-metrics-certs-default" not found Jul 09 14:57:07.071378 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:07.071348 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-vgp7z\" (UID: \"eea813a9-b795-489b-992d-a6b37da36f6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:57:07.073900 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:07.073882 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eea813a9-b795-489b-992d-a6b37da36f6f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-vgp7z\" (UID: \"eea813a9-b795-489b-992d-a6b37da36f6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:57:07.219788 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:07.219709 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" Jul 09 14:57:07.350365 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:07.350336 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z"] Jul 09 14:57:07.741477 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:07.741444 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" event={"ID":"eea813a9-b795-489b-992d-a6b37da36f6f","Type":"ContainerStarted","Data":"ea47a866891a793efb96615065c1991ace5e6196ae67b2a05fbc4d41a96715e2"} Jul 09 14:57:09.750233 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:09.750191 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" event={"ID":"eea813a9-b795-489b-992d-a6b37da36f6f","Type":"ContainerStarted","Data":"40b97e6942a2759bcaaf384aee2f65f42abd53e10afe69bdfe8e6239db592c63"} Jul 09 14:57:09.750651 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:09.750299 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" event={"ID":"eea813a9-b795-489b-992d-a6b37da36f6f","Type":"ContainerStarted","Data":"7d2b3776b45b02805640c5fb0f021c65fd92bd43bc9b679b6a54446a6680ebf0"} Jul 09 14:57:09.769031 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:09.768988 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-vgp7z" podStartSLOduration=16.909227124 podStartE2EDuration="18.768972636s" totalImagesPullingTime="1.859745512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:09.768252529 +0000 UTC m=+112.090702082" watchObservedRunningTime="2026-07-09 14:57:09.768972636 +0000 UTC m=+112.091422189" Jul 09 14:57:11.106601 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:11.106564 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:57:11.106940 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:11.106652 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:57:11.106940 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:11.106712 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:57:11.106940 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:11.106785 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls podName:8d9a4c38-828f-42b0-88a3-6c0e6d418bec nodeName:}" failed. No retries permitted until 2026-07-09 14:57:27.106767201 +0000 UTC m=+129.429216733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xr77k" (UID: "8d9a4c38-828f-42b0-88a3-6c0e6d418bec") : secret "insights-runtime-extractor-tls" not found Jul 09 14:57:11.107109 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:11.107092 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:57:22.900357 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:22.900306 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:57:22.900357 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:22.900368 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:57:22.901038 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:22.901016 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd75b29-960b-4902-a220-e4943e5fed3c-service-ca-bundle\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:57:22.902742 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:22.902723 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebd75b29-960b-4902-a220-e4943e5fed3c-metrics-certs\") pod \"router-default-7bb7644d9b-sr7lc\" (UID: \"ebd75b29-960b-4902-a220-e4943e5fed3c\") " pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:57:22.994138 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:22.994099 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-549c9c6997-r5bwx"] Jul 09 14:57:22.996864 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:22.996837 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.002594 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.002571 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 14:57:23.002594 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.002575 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vdfrd\"" Jul 09 14:57:23.003647 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.003629 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 14:57:23.003768 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.003644 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 14:57:23.024987 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.024963 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 14:57:23.032035 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.032009 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-549c9c6997-r5bwx"] Jul 09 14:57:23.080695 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.080669 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-549c9c6997-r5bwx"] Jul 09 14:57:23.080863 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:23.080845 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-rb9l2 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" podUID="dbc3c08a-1338-4475-84ba-6719d1905f21" Jul 09 14:57:23.096628 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.096609 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-4h78l"] Jul 09 14:57:23.098692 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.098679 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-4h78l" Jul 09 14:57:23.101067 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.101048 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbc3c08a-1338-4475-84ba-6719d1905f21-ca-trust-extracted\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.101159 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.101085 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-installation-pull-secrets\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.101159 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.101114 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-trusted-ca\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.101240 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.101181 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-image-registry-private-configuration\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.101240 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.101234 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-bound-sa-token\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.101308 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.101264 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-tls\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.101308 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.101301 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb9l2\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-kube-api-access-rb9l2\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.101371 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.101325 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-certificates\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.105029 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.105010 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 14:57:23.105484 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.105458 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 14:57:23.105933 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.105919 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qr4lm\"" Jul 09 14:57:23.115932 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.115913 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-4h78l"] Jul 09 14:57:23.202356 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.202280 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb9l2\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-kube-api-access-rb9l2\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.202356 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.202323 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-certificates\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.202356 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.202348 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbc3c08a-1338-4475-84ba-6719d1905f21-ca-trust-extracted\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.202652 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.202387 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-installation-pull-secrets\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.202652 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.202426 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-trusted-ca\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.202652 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.202465 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-image-registry-private-configuration\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.202652 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.202516 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-bound-sa-token\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.202652 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.202569 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-tls\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.202652 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.202600 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27r5m\" (UniqueName: \"kubernetes.io/projected/18f9a771-ca82-4708-b8d0-83affd898f1a-kube-api-access-27r5m\") pod \"downloads-68c9cbb497-4h78l\" (UID: \"18f9a771-ca82-4708-b8d0-83affd898f1a\") " pod="openshift-console/downloads-68c9cbb497-4h78l" Jul 09 14:57:23.203017 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.202859 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbc3c08a-1338-4475-84ba-6719d1905f21-ca-trust-extracted\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.203457 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.203432 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-certificates\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.203632 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.203612 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-trusted-ca\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.204527 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.204491 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f9v2h\"" Jul 09 14:57:23.205000 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.204981 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-installation-pull-secrets\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.205094 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.205079 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-image-registry-private-configuration\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.205350 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.205330 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-tls\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.212964 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.212944 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:57:23.215672 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.215540 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-bound-sa-token\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.215818 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.215804 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb9l2\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-kube-api-access-rb9l2\") pod \"image-registry-549c9c6997-r5bwx\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.303774 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.303748 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27r5m\" (UniqueName: \"kubernetes.io/projected/18f9a771-ca82-4708-b8d0-83affd898f1a-kube-api-access-27r5m\") pod \"downloads-68c9cbb497-4h78l\" (UID: \"18f9a771-ca82-4708-b8d0-83affd898f1a\") " pod="openshift-console/downloads-68c9cbb497-4h78l" Jul 09 14:57:23.317164 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.317141 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27r5m\" (UniqueName: \"kubernetes.io/projected/18f9a771-ca82-4708-b8d0-83affd898f1a-kube-api-access-27r5m\") pod \"downloads-68c9cbb497-4h78l\" (UID: \"18f9a771-ca82-4708-b8d0-83affd898f1a\") " pod="openshift-console/downloads-68c9cbb497-4h78l" Jul 09 14:57:23.348069 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.348037 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bb7644d9b-sr7lc"] Jul 09 14:57:23.351455 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:57:23.351431 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd75b29_960b_4902_a220_e4943e5fed3c.slice/crio-f6fe481a739d5939b477f43841bbff542c9962cf535dd84993e7cfcc03393c93 WatchSource:0}: Error finding container f6fe481a739d5939b477f43841bbff542c9962cf535dd84993e7cfcc03393c93: Status 404 returned error can't find the container with id f6fe481a739d5939b477f43841bbff542c9962cf535dd84993e7cfcc03393c93 Jul 09 14:57:23.407076 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.407054 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-4h78l" Jul 09 14:57:23.536969 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.536939 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-4h78l"] Jul 09 14:57:23.539768 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:57:23.539729 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f9a771_ca82_4708_b8d0_83affd898f1a.slice/crio-6750de4e8beadf38011c14539fe343cc956ffdbae3c683771bbad4b3cf23dfba WatchSource:0}: Error finding container 6750de4e8beadf38011c14539fe343cc956ffdbae3c683771bbad4b3cf23dfba: Status 404 returned error can't find the container with id 6750de4e8beadf38011c14539fe343cc956ffdbae3c683771bbad4b3cf23dfba Jul 09 14:57:23.794431 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.794389 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" event={"ID":"ebd75b29-960b-4902-a220-e4943e5fed3c","Type":"ContainerStarted","Data":"e277e060bb9afc1ab5d5f5d37c7d1481daf338286a8ab0016dbb231aeb3f67db"} Jul 09 14:57:23.794636 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.794455 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" event={"ID":"ebd75b29-960b-4902-a220-e4943e5fed3c","Type":"ContainerStarted","Data":"f6fe481a739d5939b477f43841bbff542c9962cf535dd84993e7cfcc03393c93"} Jul 09 14:57:23.795549 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.795525 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-4h78l" event={"ID":"18f9a771-ca82-4708-b8d0-83affd898f1a","Type":"ContainerStarted","Data":"6750de4e8beadf38011c14539fe343cc956ffdbae3c683771bbad4b3cf23dfba"} Jul 09 14:57:23.795549 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.795542 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.803852 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.803833 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:23.818190 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.818128 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" podStartSLOduration=32.818113643 podStartE2EDuration="32.818113643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:23.818096746 +0000 UTC m=+126.140546301" watchObservedRunningTime="2026-07-09 14:57:23.818113643 +0000 UTC m=+126.140563203" Jul 09 14:57:23.909163 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.909126 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-tls\") pod \"dbc3c08a-1338-4475-84ba-6719d1905f21\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " Jul 09 14:57:23.909551 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.909181 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-installation-pull-secrets\") pod \"dbc3c08a-1338-4475-84ba-6719d1905f21\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " Jul 09 14:57:23.909551 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.909210 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-bound-sa-token\") pod \"dbc3c08a-1338-4475-84ba-6719d1905f21\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " Jul 09 14:57:23.909551 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.909334 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb9l2\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-kube-api-access-rb9l2\") pod \"dbc3c08a-1338-4475-84ba-6719d1905f21\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " Jul 09 14:57:23.909551 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.909378 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbc3c08a-1338-4475-84ba-6719d1905f21-ca-trust-extracted\") pod \"dbc3c08a-1338-4475-84ba-6719d1905f21\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " Jul 09 14:57:23.909551 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.909405 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-image-registry-private-configuration\") pod \"dbc3c08a-1338-4475-84ba-6719d1905f21\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " Jul 09 14:57:23.909551 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.909448 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-trusted-ca\") pod \"dbc3c08a-1338-4475-84ba-6719d1905f21\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " Jul 09 14:57:23.909551 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.909476 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-certificates\") pod \"dbc3c08a-1338-4475-84ba-6719d1905f21\" (UID: \"dbc3c08a-1338-4475-84ba-6719d1905f21\") " Jul 09 14:57:23.910924 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.910437 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dbc3c08a-1338-4475-84ba-6719d1905f21" (UID: "dbc3c08a-1338-4475-84ba-6719d1905f21"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:57:23.911580 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.911234 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc3c08a-1338-4475-84ba-6719d1905f21-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dbc3c08a-1338-4475-84ba-6719d1905f21" (UID: "dbc3c08a-1338-4475-84ba-6719d1905f21"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:57:23.911734 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.911713 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dbc3c08a-1338-4475-84ba-6719d1905f21" (UID: "dbc3c08a-1338-4475-84ba-6719d1905f21"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:57:23.911918 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.911894 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dbc3c08a-1338-4475-84ba-6719d1905f21" (UID: "dbc3c08a-1338-4475-84ba-6719d1905f21"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:57:23.912149 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.912125 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dbc3c08a-1338-4475-84ba-6719d1905f21" (UID: "dbc3c08a-1338-4475-84ba-6719d1905f21"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:57:23.912149 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.912136 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dbc3c08a-1338-4475-84ba-6719d1905f21" (UID: "dbc3c08a-1338-4475-84ba-6719d1905f21"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:57:23.913318 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.913297 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dbc3c08a-1338-4475-84ba-6719d1905f21" (UID: "dbc3c08a-1338-4475-84ba-6719d1905f21"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:57:23.913596 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:23.913579 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-kube-api-access-rb9l2" (OuterVolumeSpecName: "kube-api-access-rb9l2") pod "dbc3c08a-1338-4475-84ba-6719d1905f21" (UID: "dbc3c08a-1338-4475-84ba-6719d1905f21"). InnerVolumeSpecName "kube-api-access-rb9l2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:57:24.010929 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.010902 2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-installation-pull-secrets\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:57:24.010929 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.010925 2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-bound-sa-token\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:57:24.010929 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.010934 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb9l2\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-kube-api-access-rb9l2\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:57:24.011124 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.010943 2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbc3c08a-1338-4475-84ba-6719d1905f21-ca-trust-extracted\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:57:24.011124 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.010952 2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbc3c08a-1338-4475-84ba-6719d1905f21-image-registry-private-configuration\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:57:24.011124 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.010961 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-trusted-ca\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:57:24.011124 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.010970 2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-certificates\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:57:24.011124 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.010978 2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbc3c08a-1338-4475-84ba-6719d1905f21-registry-tls\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:57:24.213713 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.213634 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:57:24.216207 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.216184 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:57:24.801921 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.801031 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-549c9c6997-r5bwx" Jul 09 14:57:24.801921 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.801196 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:57:24.802560 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.802540 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7bb7644d9b-sr7lc" Jul 09 14:57:24.855841 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.855781 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-549c9c6997-r5bwx"] Jul 09 14:57:24.865164 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:24.865137 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-549c9c6997-r5bwx"] Jul 09 14:57:25.525392 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:25.525361 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l"] Jul 09 14:57:25.528060 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:25.528041 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l" Jul 09 14:57:25.530765 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:25.530741 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jlv77\"" Jul 09 14:57:25.530869 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:25.530745 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 14:57:25.536854 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:25.536820 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l"] Jul 09 14:57:25.624867 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:25.624838 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fb3d9246-17ac-4a4f-ae78-c5e1a199f7a7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5pv5l\" (UID: \"fb3d9246-17ac-4a4f-ae78-c5e1a199f7a7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l" Jul 09 14:57:25.725686 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:25.725649 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fb3d9246-17ac-4a4f-ae78-c5e1a199f7a7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5pv5l\" (UID: \"fb3d9246-17ac-4a4f-ae78-c5e1a199f7a7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l" Jul 09 14:57:25.728384 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:25.728355 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fb3d9246-17ac-4a4f-ae78-c5e1a199f7a7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5pv5l\" (UID: \"fb3d9246-17ac-4a4f-ae78-c5e1a199f7a7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l" Jul 09 14:57:25.839476 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:25.839406 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l" Jul 09 14:57:25.982461 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:25.982411 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l"] Jul 09 14:57:25.984637 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:57:25.984609 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3d9246_17ac_4a4f_ae78_c5e1a199f7a7.slice/crio-b454a59ac48e90f1fcea750bd306f7771cfb584287d3051f7952c553b0bae9ee WatchSource:0}: Error finding container b454a59ac48e90f1fcea750bd306f7771cfb584287d3051f7952c553b0bae9ee: Status 404 returned error can't find the container with id b454a59ac48e90f1fcea750bd306f7771cfb584287d3051f7952c553b0bae9ee Jul 09 14:57:26.233483 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:26.233409 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbc3c08a-1338-4475-84ba-6719d1905f21" path="/var/lib/kubelet/pods/dbc3c08a-1338-4475-84ba-6719d1905f21/volumes" Jul 09 14:57:26.808748 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:26.808710 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l" event={"ID":"fb3d9246-17ac-4a4f-ae78-c5e1a199f7a7","Type":"ContainerStarted","Data":"b454a59ac48e90f1fcea750bd306f7771cfb584287d3051f7952c553b0bae9ee"} Jul 09 14:57:27.035942 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.035909 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:57:27.038902 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.038872 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df75ee8a-be1a-4c76-a301-0c57e03d4e2d-metrics-certs\") pod \"network-metrics-daemon-zt9qm\" (UID: \"df75ee8a-be1a-4c76-a301-0c57e03d4e2d\") " pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:57:27.054626 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.054605 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9zbh8\"" Jul 09 14:57:27.062416 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.062350 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt9qm" Jul 09 14:57:27.137311 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.137275 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:57:27.140137 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.140114 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8d9a4c38-828f-42b0-88a3-6c0e6d418bec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr77k\" (UID: \"8d9a4c38-828f-42b0-88a3-6c0e6d418bec\") " pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:57:27.161559 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.161531 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cq4x2\"" Jul 09 14:57:27.167867 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.167846 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xr77k" Jul 09 14:57:27.522518 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.522466 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zt9qm"] Jul 09 14:57:27.527395 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:57:27.527367 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf75ee8a_be1a_4c76_a301_0c57e03d4e2d.slice/crio-af6f4893352c65e5a21dee768e006619a64840350e05521d1821912a665b6a9e WatchSource:0}: Error finding container af6f4893352c65e5a21dee768e006619a64840350e05521d1821912a665b6a9e: Status 404 returned error can't find the container with id af6f4893352c65e5a21dee768e006619a64840350e05521d1821912a665b6a9e Jul 09 14:57:27.542094 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.542059 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xr77k"] Jul 09 14:57:27.544445 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:57:27.544405 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d9a4c38_828f_42b0_88a3_6c0e6d418bec.slice/crio-d37b9c2e420eb7f3b97b2559db039903553629756b349c65c3299807d96bc369 WatchSource:0}: Error finding container d37b9c2e420eb7f3b97b2559db039903553629756b349c65c3299807d96bc369: Status 404 returned error can't find the container with id d37b9c2e420eb7f3b97b2559db039903553629756b349c65c3299807d96bc369 Jul 09 14:57:27.814227 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.814123 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l" event={"ID":"fb3d9246-17ac-4a4f-ae78-c5e1a199f7a7","Type":"ContainerStarted","Data":"7702875e1f296a74de983e71324a8b2c79a82667aea0bf5700415244811d81df"} Jul 09 14:57:27.814227 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.814189 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l" Jul 09 14:57:27.816034 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.816009 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zt9qm" event={"ID":"df75ee8a-be1a-4c76-a301-0c57e03d4e2d","Type":"ContainerStarted","Data":"af6f4893352c65e5a21dee768e006619a64840350e05521d1821912a665b6a9e"} Jul 09 14:57:27.817324 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.817305 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr77k" event={"ID":"8d9a4c38-828f-42b0-88a3-6c0e6d418bec","Type":"ContainerStarted","Data":"d37b9c2e420eb7f3b97b2559db039903553629756b349c65c3299807d96bc369"} Jul 09 14:57:27.820191 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.820171 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l" Jul 09 14:57:27.834568 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:27.834513 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5pv5l" podStartSLOduration=1.4163271800000001 podStartE2EDuration="2.834477831s" totalImagesPullingTime="1.418150651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:27.832801073 +0000 UTC m=+130.155250654" watchObservedRunningTime="2026-07-09 14:57:27.834477831 +0000 UTC m=+130.156927382" Jul 09 14:57:28.645664 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.645629 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-j27ml"] Jul 09 14:57:28.650127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.649432 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:28.655912 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.655392 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 14:57:28.664104 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.662582 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 14:57:28.664104 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.662871 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 14:57:28.664104 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.663226 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 14:57:28.664546 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.664372 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 14:57:28.666227 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.666053 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zdltd\"" Jul 09 14:57:28.667210 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.666953 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-j27ml"] Jul 09 14:57:28.751119 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.751087 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb64097f-c144-4b1b-998b-a73ed6b68487-metrics-client-ca\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:28.752563 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.752533 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb64097f-c144-4b1b-998b-a73ed6b68487-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:28.752677 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.752607 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb64097f-c144-4b1b-998b-a73ed6b68487-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:28.752677 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.752638 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gcpt\" (UniqueName: \"kubernetes.io/projected/fb64097f-c144-4b1b-998b-a73ed6b68487-kube-api-access-8gcpt\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:28.853738 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.853637 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb64097f-c144-4b1b-998b-a73ed6b68487-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:28.853738 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.853700 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb64097f-c144-4b1b-998b-a73ed6b68487-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:28.853738 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.853732 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gcpt\" (UniqueName: \"kubernetes.io/projected/fb64097f-c144-4b1b-998b-a73ed6b68487-kube-api-access-8gcpt\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:28.854329 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.853756 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb64097f-c144-4b1b-998b-a73ed6b68487-metrics-client-ca\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:28.854597 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.854567 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb64097f-c144-4b1b-998b-a73ed6b68487-metrics-client-ca\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:28.854706 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:28.854684 2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 09 14:57:28.854765 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:28.854755 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb64097f-c144-4b1b-998b-a73ed6b68487-prometheus-operator-tls podName:fb64097f-c144-4b1b-998b-a73ed6b68487 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:29.35473762 +0000 UTC m=+131.677187160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fb64097f-c144-4b1b-998b-a73ed6b68487-prometheus-operator-tls") pod "prometheus-operator-64785b6675-j27ml" (UID: "fb64097f-c144-4b1b-998b-a73ed6b68487") : secret "prometheus-operator-tls" not found Jul 09 14:57:28.859351 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.859309 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb64097f-c144-4b1b-998b-a73ed6b68487-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:28.868672 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:28.868627 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gcpt\" (UniqueName: \"kubernetes.io/projected/fb64097f-c144-4b1b-998b-a73ed6b68487-kube-api-access-8gcpt\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:29.358640 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:29.358483 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb64097f-c144-4b1b-998b-a73ed6b68487-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:29.361593 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:29.361566 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb64097f-c144-4b1b-998b-a73ed6b68487-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-j27ml\" (UID: \"fb64097f-c144-4b1b-998b-a73ed6b68487\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:29.567726 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:29.567692 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" Jul 09 14:57:29.828290 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:29.828251 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zt9qm" event={"ID":"df75ee8a-be1a-4c76-a301-0c57e03d4e2d","Type":"ContainerStarted","Data":"a6718c981b574c0b05d9cc6734ae4295ca1c7c92377202a4eb682a24f3a642b4"} Jul 09 14:57:29.828478 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:29.828318 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zt9qm" event={"ID":"df75ee8a-be1a-4c76-a301-0c57e03d4e2d","Type":"ContainerStarted","Data":"13351ecf3b91f520f8258ec9fae1fa78e285e3552e4472a07e55fd77caf395e0"} Jul 09 14:57:29.850351 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:29.850297 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zt9qm" podStartSLOduration=130.41169898 podStartE2EDuration="2m11.850282177s" totalImagesPullingTime="1.438583197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:29.848883559 +0000 UTC m=+132.171333143" watchObservedRunningTime="2026-07-09 14:57:29.850282177 +0000 UTC m=+132.172731731" Jul 09 14:57:32.198303 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:32.198266 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-j27ml"] Jul 09 14:57:32.203572 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:57:32.203538 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb64097f_c144_4b1b_998b_a73ed6b68487.slice/crio-962406a6453b880dff88bad160b7e4dcb4712548f61a7ee14a5484936fbff9c0 WatchSource:0}: Error finding container 962406a6453b880dff88bad160b7e4dcb4712548f61a7ee14a5484936fbff9c0: Status 404 returned error can't find the container with id 962406a6453b880dff88bad160b7e4dcb4712548f61a7ee14a5484936fbff9c0 Jul 09 14:57:32.841833 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:32.841803 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr77k" event={"ID":"8d9a4c38-828f-42b0-88a3-6c0e6d418bec","Type":"ContainerStarted","Data":"ac1edd8a25e31c08b6b5d4f5abbf14c4b3d098a4013bd964c3d56109171835d6"} Jul 09 14:57:32.841961 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:32.841863 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr77k" event={"ID":"8d9a4c38-828f-42b0-88a3-6c0e6d418bec","Type":"ContainerStarted","Data":"c3264013e17853286ce09f990560d78f8e481e912d426c153342ea3f60a5830a"} Jul 09 14:57:32.843082 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:32.843057 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" event={"ID":"fb64097f-c144-4b1b-998b-a73ed6b68487","Type":"ContainerStarted","Data":"962406a6453b880dff88bad160b7e4dcb4712548f61a7ee14a5484936fbff9c0"} Jul 09 14:57:34.518343 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.518302 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9457cfd56-g8cnd"] Jul 09 14:57:34.524203 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.524177 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.528060 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.528012 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 14:57:34.528286 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.528257 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 14:57:34.528681 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.528662 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rz7k5\"" Jul 09 14:57:34.528891 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.528875 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 14:57:34.529050 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.528984 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 14:57:34.529050 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.528015 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 14:57:34.533087 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.533060 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 14:57:34.536021 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.535757 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9457cfd56-g8cnd"] Jul 09 14:57:34.606717 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.606681 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-oauth-config\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.606717 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.606717 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-oauth-serving-cert\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.606939 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.606736 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9l99\" (UniqueName: \"kubernetes.io/projected/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-kube-api-access-l9l99\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.606939 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.606770 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-service-ca\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.606939 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.606806 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-config\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.606939 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.606832 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-serving-cert\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.606939 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.606860 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-trusted-ca-bundle\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.708034 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.707996 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-oauth-config\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.708034 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.708037 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-oauth-serving-cert\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.708287 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.708059 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9l99\" (UniqueName: \"kubernetes.io/projected/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-kube-api-access-l9l99\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.708287 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.708109 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-service-ca\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.708287 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.708150 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-config\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.708287 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.708182 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-serving-cert\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.708287 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.708206 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-trusted-ca-bundle\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.708895 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.708864 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-oauth-serving-cert\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.709621 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.709599 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-service-ca\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.710179 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.710157 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-config\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.710432 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.710404 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-trusted-ca-bundle\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.711334 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.711313 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-oauth-config\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.712138 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.712115 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-serving-cert\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.719659 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.719628 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9l99\" (UniqueName: \"kubernetes.io/projected/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-kube-api-access-l9l99\") pod \"console-9457cfd56-g8cnd\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.837382 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.837304 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:34.854969 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.854918 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" event={"ID":"fb64097f-c144-4b1b-998b-a73ed6b68487","Type":"ContainerStarted","Data":"46a71ad535108214758953138821b92db9d4e4c0537616e9b83f8e64d9b95d1a"} Jul 09 14:57:34.855108 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.854997 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" event={"ID":"fb64097f-c144-4b1b-998b-a73ed6b68487","Type":"ContainerStarted","Data":"e26e492ee3d02bd113fb56cf43efdc466f9383f6823c35b3d447d92b39232fb1"} Jul 09 14:57:34.875150 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:34.875093 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-j27ml" podStartSLOduration=5.249787876 podStartE2EDuration="6.875072498s" totalImagesPullingTime="1.625284622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:34.874180859 +0000 UTC m=+137.196630432" watchObservedRunningTime="2026-07-09 14:57:34.875072498 +0000 UTC m=+137.197522045" Jul 09 14:57:37.018531 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.018484 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-b5p6x"] Jul 09 14:57:37.028795 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.028768 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.031721 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.031679 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5q6v6"] Jul 09 14:57:37.031880 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.031861 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gprx8\"" Jul 09 14:57:37.033862 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.033723 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 14:57:37.033862 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.033753 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 14:57:37.034398 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.034379 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 14:57:37.035247 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.035228 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.035344 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.035299 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-b5p6x"] Jul 09 14:57:37.038513 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.038454 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rxjfj\"" Jul 09 14:57:37.038513 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.038474 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 14:57:37.039258 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.038888 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 14:57:37.039258 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.039106 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 14:57:37.130046 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130012 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86679847-306d-4583-99ff-e2bd66b21b29-root\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.130252 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130094 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-tls\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.130252 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130145 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.130252 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130186 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.130252 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130235 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc5d52c3-090e-4012-9945-6919aa07edb4-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.130488 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130259 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lhn5\" (UniqueName: \"kubernetes.io/projected/86679847-306d-4583-99ff-e2bd66b21b29-kube-api-access-2lhn5\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.130488 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130288 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-wtmp\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.130488 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130329 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc5d52c3-090e-4012-9945-6919aa07edb4-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.130488 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130353 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.130488 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130376 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86679847-306d-4583-99ff-e2bd66b21b29-metrics-client-ca\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.130488 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130409 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bwhv\" (UniqueName: \"kubernetes.io/projected/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-api-access-5bwhv\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.130488 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130456 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-accelerators-collector-config\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.130488 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130485 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-textfile\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.130919 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130543 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86679847-306d-4583-99ff-e2bd66b21b29-sys\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.130919 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.130587 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.231740 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.231694 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.231740 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.231743 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.231982 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.231776 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc5d52c3-090e-4012-9945-6919aa07edb4-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.231982 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.231793 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lhn5\" (UniqueName: \"kubernetes.io/projected/86679847-306d-4583-99ff-e2bd66b21b29-kube-api-access-2lhn5\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.231982 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.231811 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-wtmp\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.231982 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.231845 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc5d52c3-090e-4012-9945-6919aa07edb4-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.231982 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.231868 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.231982 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.231889 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86679847-306d-4583-99ff-e2bd66b21b29-metrics-client-ca\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.231982 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.231920 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bwhv\" (UniqueName: \"kubernetes.io/projected/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-api-access-5bwhv\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.231982 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.231965 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-accelerators-collector-config\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.232380 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.232004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-textfile\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.232380 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.232028 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86679847-306d-4583-99ff-e2bd66b21b29-sys\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.232380 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.232059 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.232380 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.232103 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86679847-306d-4583-99ff-e2bd66b21b29-root\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.232380 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:37.232135 2584 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 14:57:37.232380 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:37.232215 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-tls podName:dc5d52c3-090e-4012-9945-6919aa07edb4 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:37.732195748 +0000 UTC m=+140.054645286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-b5p6x" (UID: "dc5d52c3-090e-4012-9945-6919aa07edb4") : secret "kube-state-metrics-tls" not found Jul 09 14:57:37.232710 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.232590 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.232710 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.232612 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-textfile\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.232710 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.232138 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-tls\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.233734 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.233006 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-wtmp\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.233734 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.233337 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86679847-306d-4583-99ff-e2bd66b21b29-metrics-client-ca\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.233734 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.233409 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86679847-306d-4583-99ff-e2bd66b21b29-root\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.233734 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.233423 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-accelerators-collector-config\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.233734 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.233457 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86679847-306d-4583-99ff-e2bd66b21b29-sys\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.233734 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.233520 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc5d52c3-090e-4012-9945-6919aa07edb4-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.233734 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.233642 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc5d52c3-090e-4012-9945-6919aa07edb4-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.234990 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.234936 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.235444 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.235394 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86679847-306d-4583-99ff-e2bd66b21b29-node-exporter-tls\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.236359 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.236336 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.243168 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.243147 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lhn5\" (UniqueName: \"kubernetes.io/projected/86679847-306d-4583-99ff-e2bd66b21b29-kube-api-access-2lhn5\") pod \"node-exporter-5q6v6\" (UID: \"86679847-306d-4583-99ff-e2bd66b21b29\") " pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.243794 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.243753 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bwhv\" (UniqueName: \"kubernetes.io/projected/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-api-access-5bwhv\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.350412 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.350127 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5q6v6" Jul 09 14:57:37.737676 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:37.737473 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:37.737676 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:37.737671 2584 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 14:57:37.737906 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:37.737742 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-tls podName:dc5d52c3-090e-4012-9945-6919aa07edb4 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:38.737723508 +0000 UTC m=+141.060173042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-b5p6x" (UID: "dc5d52c3-090e-4012-9945-6919aa07edb4") : secret "kube-state-metrics-tls" not found Jul 09 14:57:38.745726 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:38.745688 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:38.748578 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:38.748543 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc5d52c3-090e-4012-9945-6919aa07edb4-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-b5p6x\" (UID: \"dc5d52c3-090e-4012-9945-6919aa07edb4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:38.843994 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:38.843959 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" Jul 09 14:57:40.168342 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.168304 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5884cf55b6-jvbcl"] Jul 09 14:57:40.174305 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.174278 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.181095 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.181064 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 14:57:40.183432 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.183408 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 14:57:40.186515 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.186477 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ms2nl\"" Jul 09 14:57:40.186922 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.186903 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 14:57:40.187241 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.187113 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4e18fupbjo0f1\"" Jul 09 14:57:40.187894 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.187873 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 14:57:40.188104 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.188072 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 14:57:40.204271 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.203835 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5884cf55b6-jvbcl"] Jul 09 14:57:40.258448 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.258414 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.258631 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.258466 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-tls\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.258631 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.258594 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.258753 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.258667 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-metrics-client-ca\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.258753 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.258701 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-grpc-tls\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.258753 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.258731 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42pg4\" (UniqueName: \"kubernetes.io/projected/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-kube-api-access-42pg4\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.258903 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.258764 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.258903 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.258793 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.360016 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.359983 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.360195 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.360031 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-tls\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.360195 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.360093 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.360195 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.360148 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-metrics-client-ca\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.360469 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.360434 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-grpc-tls\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.360604 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.360491 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42pg4\" (UniqueName: \"kubernetes.io/projected/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-kube-api-access-42pg4\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.360604 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.360547 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.360604 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.360576 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.361269 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.360922 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-metrics-client-ca\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.365039 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.364995 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.365039 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.365024 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.366238 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.366212 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-grpc-tls\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.366626 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.366597 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-tls\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.366741 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.366646 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.367987 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.367962 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.380029 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.380007 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42pg4\" (UniqueName: \"kubernetes.io/projected/9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b-kube-api-access-42pg4\") pod \"thanos-querier-5884cf55b6-jvbcl\" (UID: \"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b\") " pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:40.491065 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:40.490984 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:41.789900 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:41.789865 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x"] Jul 09 14:57:41.793020 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:41.793000 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" Jul 09 14:57:41.798696 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:41.798622 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 14:57:41.798696 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:41.798673 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4vh7h\"" Jul 09 14:57:41.811680 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:41.811624 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x"] Jul 09 14:57:41.876746 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:41.876705 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpbz4\" (UniqueName: \"kubernetes.io/projected/8dadb04c-2cbc-4d3e-a926-d4085c66f7ba-kube-api-access-tpbz4\") pod \"monitoring-plugin-5f68df7f58-jl97x\" (UID: \"8dadb04c-2cbc-4d3e-a926-d4085c66f7ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" Jul 09 14:57:41.876919 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:41.876797 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dadb04c-2cbc-4d3e-a926-d4085c66f7ba-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jl97x\" (UID: \"8dadb04c-2cbc-4d3e-a926-d4085c66f7ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" Jul 09 14:57:41.977978 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:41.977948 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpbz4\" (UniqueName: \"kubernetes.io/projected/8dadb04c-2cbc-4d3e-a926-d4085c66f7ba-kube-api-access-tpbz4\") pod \"monitoring-plugin-5f68df7f58-jl97x\" (UID: \"8dadb04c-2cbc-4d3e-a926-d4085c66f7ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" Jul 09 14:57:41.978146 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:41.977991 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dadb04c-2cbc-4d3e-a926-d4085c66f7ba-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jl97x\" (UID: \"8dadb04c-2cbc-4d3e-a926-d4085c66f7ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" Jul 09 14:57:41.980864 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:41.980840 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dadb04c-2cbc-4d3e-a926-d4085c66f7ba-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jl97x\" (UID: \"8dadb04c-2cbc-4d3e-a926-d4085c66f7ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" Jul 09 14:57:41.988729 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:41.988704 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpbz4\" (UniqueName: \"kubernetes.io/projected/8dadb04c-2cbc-4d3e-a926-d4085c66f7ba-kube-api-access-tpbz4\") pod \"monitoring-plugin-5f68df7f58-jl97x\" (UID: \"8dadb04c-2cbc-4d3e-a926-d4085c66f7ba\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" Jul 09 14:57:42.104025 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:42.103942 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" Jul 09 14:57:42.542992 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:42.542955 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9457cfd56-g8cnd"] Jul 09 14:57:43.075111 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.074818 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9457cfd56-g8cnd"] Jul 09 14:57:43.079653 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:57:43.079624 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb53b0f5_959f_4bb5_aa40_dc76e8a5184d.slice/crio-5a54471f3cbb37fdeea04c0f5159ede7322716159c6941e58a286d5e6b7568ff WatchSource:0}: Error finding container 5a54471f3cbb37fdeea04c0f5159ede7322716159c6941e58a286d5e6b7568ff: Status 404 returned error can't find the container with id 5a54471f3cbb37fdeea04c0f5159ede7322716159c6941e58a286d5e6b7568ff Jul 09 14:57:43.328947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.323687 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x"] Jul 09 14:57:43.328947 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.325817 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-b5p6x"] Jul 09 14:57:43.328947 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:57:43.326213 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5d52c3_090e_4012_9945_6919aa07edb4.slice/crio-af1c369e4285f91cfde36be007021199d0782ecfadbdc1d3ff204e3db8f932f4 WatchSource:0}: Error finding container af1c369e4285f91cfde36be007021199d0782ecfadbdc1d3ff204e3db8f932f4: Status 404 returned error can't find the container with id af1c369e4285f91cfde36be007021199d0782ecfadbdc1d3ff204e3db8f932f4 Jul 09 14:57:43.329679 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.329400 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5884cf55b6-jvbcl"] Jul 09 14:57:43.329976 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:57:43.329952 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dadb04c_2cbc_4d3e_a926_d4085c66f7ba.slice/crio-5d53bbb7bff21a6522df4be465e1310340c6f4050a605f2d5dff7fc35b2071ac WatchSource:0}: Error finding container 5d53bbb7bff21a6522df4be465e1310340c6f4050a605f2d5dff7fc35b2071ac: Status 404 returned error can't find the container with id 5d53bbb7bff21a6522df4be465e1310340c6f4050a605f2d5dff7fc35b2071ac Jul 09 14:57:43.345699 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:57:43.345444 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9534d3f2_8a36_41ec_9f0b_83a6cc9a5f0b.slice/crio-6ef56d292ea492b174aa897a21e24fa526d0eeae3e62071fefa73f0ce15ddb49 WatchSource:0}: Error finding container 6ef56d292ea492b174aa897a21e24fa526d0eeae3e62071fefa73f0ce15ddb49: Status 404 returned error can't find the container with id 6ef56d292ea492b174aa897a21e24fa526d0eeae3e62071fefa73f0ce15ddb49 Jul 09 14:57:43.378435 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.377074 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:57:43.384888 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.384859 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.390946 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.390112 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 14:57:43.390946 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.390236 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 14:57:43.390946 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.390390 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 14:57:43.390946 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.390430 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s97fx\"" Jul 09 14:57:43.391220 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.390946 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 14:57:43.391309 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.391286 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 14:57:43.391366 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.391355 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 14:57:43.391923 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.391900 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 14:57:43.392310 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.392294 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 14:57:43.392736 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.392720 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 14:57:43.393112 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.393089 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 14:57:43.393206 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.393186 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 14:57:43.393267 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.393099 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 14:57:43.393448 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.393431 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8d2pjf9pu2pq\"" Jul 09 14:57:43.397747 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.397730 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 14:57:43.408526 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.406165 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 14:57:43.409558 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.409539 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 14:57:43.410384 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.410362 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:57:43.492723 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.492681 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.492896 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.492742 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.492896 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.492771 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.492896 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.492795 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.492896 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.492819 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.492896 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.492841 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntw8g\" (UniqueName: \"kubernetes.io/projected/4badcd99-1461-4f7d-8b7c-eb47132586a2-kube-api-access-ntw8g\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.492896 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.492871 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493201 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.492897 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493201 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493028 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493201 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493048 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4badcd99-1461-4f7d-8b7c-eb47132586a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493201 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493084 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493201 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493115 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493201 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493141 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493201 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493165 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4badcd99-1461-4f7d-8b7c-eb47132586a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493201 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493188 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-config\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493582 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493218 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493582 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493242 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493582 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493277 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493582 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493299 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.493582 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.493332 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.595510 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.595038 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.595746 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.595791 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.595821 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4badcd99-1461-4f7d-8b7c-eb47132586a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.595850 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-config\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.595886 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.595913 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.595948 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.595975 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.596017 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.596055 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.596106 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.596140 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.596164 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.596186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.596208 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntw8g\" (UniqueName: \"kubernetes.io/projected/4badcd99-1461-4f7d-8b7c-eb47132586a2-kube-api-access-ntw8g\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.596243 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.597127 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.596273 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.598028 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.596310 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.598028 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.596333 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4badcd99-1461-4f7d-8b7c-eb47132586a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.605080 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.600390 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.605080 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.601213 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.605080 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.601418 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.605080 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.601683 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.605080 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.602282 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.605080 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.595642 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.605080 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.604341 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.605080 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.604685 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.605080 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.604912 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.605576 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.605461 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4badcd99-1461-4f7d-8b7c-eb47132586a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.609885 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.609837 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4badcd99-1461-4f7d-8b7c-eb47132586a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.614802 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.614348 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.614802 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.614625 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.614802 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.614677 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.615373 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.615191 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.615373 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.615217 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.616243 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.615611 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4badcd99-1461-4f7d-8b7c-eb47132586a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.616337 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.616250 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-config\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.617999 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.617659 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4badcd99-1461-4f7d-8b7c-eb47132586a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.618606 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.618559 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntw8g\" (UniqueName: \"kubernetes.io/projected/4badcd99-1461-4f7d-8b7c-eb47132586a2-kube-api-access-ntw8g\") pod \"prometheus-k8s-0\" (UID: \"4badcd99-1461-4f7d-8b7c-eb47132586a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.708878 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.708831 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:43.895990 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.895862 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9457cfd56-g8cnd" event={"ID":"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d","Type":"ContainerStarted","Data":"5a54471f3cbb37fdeea04c0f5159ede7322716159c6941e58a286d5e6b7568ff"} Jul 09 14:57:43.897563 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.897426 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" event={"ID":"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b","Type":"ContainerStarted","Data":"6ef56d292ea492b174aa897a21e24fa526d0eeae3e62071fefa73f0ce15ddb49"} Jul 09 14:57:43.900284 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.899902 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-4h78l" event={"ID":"18f9a771-ca82-4708-b8d0-83affd898f1a","Type":"ContainerStarted","Data":"c666497e204aba276c9188b3d5dbc24350425daffe5c682b0d7fd8a4ab65ac69"} Jul 09 14:57:43.900284 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.900227 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-4h78l" Jul 09 14:57:43.905077 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.903580 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr77k" event={"ID":"8d9a4c38-828f-42b0-88a3-6c0e6d418bec","Type":"ContainerStarted","Data":"9fe63f1a387223a6b96d74dbd154b5b37668ae9c896f59701ce251aa21840172"} Jul 09 14:57:43.906768 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.906722 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-4h78l" Jul 09 14:57:43.908038 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.908013 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" event={"ID":"dc5d52c3-090e-4012-9945-6919aa07edb4","Type":"ContainerStarted","Data":"af1c369e4285f91cfde36be007021199d0782ecfadbdc1d3ff204e3db8f932f4"} Jul 09 14:57:43.909671 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.909607 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5q6v6" event={"ID":"86679847-306d-4583-99ff-e2bd66b21b29","Type":"ContainerStarted","Data":"aac87022c587526865fd60aad56a5b8ab8a6126619dc0aff75483e06fc11a942"} Jul 09 14:57:43.911276 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.911237 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" event={"ID":"8dadb04c-2cbc-4d3e-a926-d4085c66f7ba","Type":"ContainerStarted","Data":"5d53bbb7bff21a6522df4be465e1310340c6f4050a605f2d5dff7fc35b2071ac"} Jul 09 14:57:43.929313 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.928913 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-4h78l" podStartSLOduration=1.5112830609999999 podStartE2EDuration="20.928894031s" totalImagesPullingTime="19.41761097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:43.921987222 +0000 UTC m=+146.244436805" watchObservedRunningTime="2026-07-09 14:57:43.928894031 +0000 UTC m=+146.251343587" Jul 09 14:57:43.980316 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:43.979574 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xr77k" podStartSLOduration=33.764395284 podStartE2EDuration="48.979552708s" totalImagesPullingTime="15.215157424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:56:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:43.952522655 +0000 UTC m=+146.274972233" watchObservedRunningTime="2026-07-09 14:57:43.979552708 +0000 UTC m=+146.302002264" Jul 09 14:57:44.353112 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:44.352643 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:57:44.362845 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:57:44.359160 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4badcd99_1461_4f7d_8b7c_eb47132586a2.slice/crio-b334bc79f5b1c6bc51418de62095057cd4b8b372703b8f8ea884f80142e77938 WatchSource:0}: Error finding container b334bc79f5b1c6bc51418de62095057cd4b8b372703b8f8ea884f80142e77938: Status 404 returned error can't find the container with id b334bc79f5b1c6bc51418de62095057cd4b8b372703b8f8ea884f80142e77938 Jul 09 14:57:44.924966 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:44.924883 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4badcd99-1461-4f7d-8b7c-eb47132586a2","Type":"ContainerStarted","Data":"b334bc79f5b1c6bc51418de62095057cd4b8b372703b8f8ea884f80142e77938"} Jul 09 14:57:44.931223 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:44.929311 2584 generic.go:356] "Generic (PLEG): container finished" podID="86679847-306d-4583-99ff-e2bd66b21b29" containerID="e144e7288eb3362c08eb59670db6f609fe621c426f7ca973a47cd3236da6ca78" exitCode=0 Jul 09 14:57:44.931223 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:44.930436 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5q6v6" event={"ID":"86679847-306d-4583-99ff-e2bd66b21b29","Type":"ContainerDied","Data":"e144e7288eb3362c08eb59670db6f609fe621c426f7ca973a47cd3236da6ca78"} Jul 09 14:57:45.944274 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:45.944124 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5q6v6" event={"ID":"86679847-306d-4583-99ff-e2bd66b21b29","Type":"ContainerStarted","Data":"d317062528425d62c87839c049fe291a2bef14d7a010bf9afc331535faefcf2a"} Jul 09 14:57:45.944274 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:45.944223 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5q6v6" event={"ID":"86679847-306d-4583-99ff-e2bd66b21b29","Type":"ContainerStarted","Data":"eb2c17b268a245c4199b088048cb0ee05c2e2cbdbbebe660414e63fa59b21171"} Jul 09 14:57:45.970940 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:45.970872 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5q6v6" podStartSLOduration=7.493097096 podStartE2EDuration="8.970851876s" totalImagesPullingTime="1.361281231s" totalInitContainerRuntime="116.473549ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:45.968283699 +0000 UTC m=+148.290733254" watchObservedRunningTime="2026-07-09 14:57:45.970851876 +0000 UTC m=+148.293301431" Jul 09 14:57:50.965364 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.965327 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" event={"ID":"8dadb04c-2cbc-4d3e-a926-d4085c66f7ba","Type":"ContainerStarted","Data":"76b67029d46892232d77f688fd428aef9c2cdee539ddd41dbcd11cbd9c7864c5"} Jul 09 14:57:50.965822 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.965799 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" Jul 09 14:57:50.967873 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.967844 2584 generic.go:356] "Generic (PLEG): container finished" podID="4badcd99-1461-4f7d-8b7c-eb47132586a2" containerID="b622b153dbcc7fae0a4ac76a7a2b2b4cb0b351a5cac8aaa55648e6861cba92ce" exitCode=0 Jul 09 14:57:50.967980 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.967960 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4badcd99-1461-4f7d-8b7c-eb47132586a2","Type":"ContainerDied","Data":"b622b153dbcc7fae0a4ac76a7a2b2b4cb0b351a5cac8aaa55648e6861cba92ce"} Jul 09 14:57:50.971230 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.971207 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9457cfd56-g8cnd" event={"ID":"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d","Type":"ContainerStarted","Data":"5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880"} Jul 09 14:57:50.973340 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.973323 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" Jul 09 14:57:50.976344 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.976310 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" event={"ID":"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b","Type":"ContainerStarted","Data":"505699f23d841804fbb2e2d2d9d4fd3c72835a9763a9514349baef24af979b5d"} Jul 09 14:57:50.976444 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.976394 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" event={"ID":"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b","Type":"ContainerStarted","Data":"208f348d4aaed8070d62e1c3f24fd2a056a841698c16e10c3a2f180ae700f8e2"} Jul 09 14:57:50.976444 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.976441 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" event={"ID":"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b","Type":"ContainerStarted","Data":"f3cc62a30378119514f4720d06d3a47595e00a059621d6c71ddcad02282aea8c"} Jul 09 14:57:50.979250 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.979230 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" event={"ID":"dc5d52c3-090e-4012-9945-6919aa07edb4","Type":"ContainerStarted","Data":"023ca45290be70625979b9e5e5427ae822a68e83d775dc82bf7f709d2e66ceb8"} Jul 09 14:57:50.979468 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.979450 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" event={"ID":"dc5d52c3-090e-4012-9945-6919aa07edb4","Type":"ContainerStarted","Data":"d17dca965004e6a2c808c8853c00ee2aed89abbe5c3986f016d943438d43a401"} Jul 09 14:57:50.979627 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.979613 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" event={"ID":"dc5d52c3-090e-4012-9945-6919aa07edb4","Type":"ContainerStarted","Data":"a261424ea07dbb47b24987fc00f9e63c156fe2a15525594b5627fa797698e954"} Jul 09 14:57:50.986014 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:50.985869 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jl97x" podStartSLOduration=2.906307466 podStartE2EDuration="9.985717314s" totalImagesPullingTime="7.079409848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:50.984958776 +0000 UTC m=+153.307408355" watchObservedRunningTime="2026-07-09 14:57:50.985717314 +0000 UTC m=+153.308166869" Jul 09 14:57:51.009544 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:51.009470 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5p6x" podStartSLOduration=7.929065059 podStartE2EDuration="15.009452808s" totalImagesPullingTime="7.080387749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:51.007205048 +0000 UTC m=+153.329654637" watchObservedRunningTime="2026-07-09 14:57:51.009452808 +0000 UTC m=+153.331902360" Jul 09 14:57:51.110574 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:51.110468 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9457cfd56-g8cnd" podStartSLOduration=9.78285405 podStartE2EDuration="17.110447724s" totalImagesPullingTime="7.327593674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:51.108849928 +0000 UTC m=+153.431299502" watchObservedRunningTime="2026-07-09 14:57:51.110447724 +0000 UTC m=+153.432897278" Jul 09 14:57:52.993213 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:52.993053 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" event={"ID":"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b","Type":"ContainerStarted","Data":"cb2618b333f2daf0024c1ca9282d9075048da2c975ce000b6f87857d5ccb4e11"} Jul 09 14:57:52.993213 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:52.993176 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" event={"ID":"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b","Type":"ContainerStarted","Data":"75fd52cc020cef20b686a3b379ecd4e3d2d58a2e1cc4a1968b2cb7f15fac5ea7"} Jul 09 14:57:52.993213 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:52.993220 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" event={"ID":"9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b","Type":"ContainerStarted","Data":"b6d6a12bed14b83c8ccf5e25fbf2b989184f20519d70a299ce54ba069faf6c55"} Jul 09 14:57:52.993907 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:52.993436 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:57:53.020312 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:53.019530 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" podStartSLOduration=4.803996244 podStartE2EDuration="13.019490863s" totalImagesPullingTime="8.215494619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:53.017331132 +0000 UTC m=+155.339780688" watchObservedRunningTime="2026-07-09 14:57:53.019490863 +0000 UTC m=+155.341940420" Jul 09 14:57:54.838012 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:54.837978 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:57:56.011658 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:56.011628 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4badcd99-1461-4f7d-8b7c-eb47132586a2","Type":"ContainerStarted","Data":"cdba53f617d430e8a8a4e8471116b9e0ef36a694a79f60c542a895bcef7f2118"} Jul 09 14:57:56.012091 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:56.011691 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4badcd99-1461-4f7d-8b7c-eb47132586a2","Type":"ContainerStarted","Data":"cf467fdedf30a53de77afa3fd705e686e5bcac74e8d9765d3ab9c1b3761e91e8"} Jul 09 14:57:56.012091 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:56.011723 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4badcd99-1461-4f7d-8b7c-eb47132586a2","Type":"ContainerStarted","Data":"34846ce9e309fe7628cac941bcd1fb0bb81ebc33534f5938c4b5ac7049ca4d85"} Jul 09 14:57:56.012091 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:56.011747 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4badcd99-1461-4f7d-8b7c-eb47132586a2","Type":"ContainerStarted","Data":"eb3390c153bc5c29d6c3c6fa714ac5b404789287972ec0ae5095cd173d0bb7fe"} Jul 09 14:57:56.012091 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:56.011770 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4badcd99-1461-4f7d-8b7c-eb47132586a2","Type":"ContainerStarted","Data":"593ff0f698f08d37a277d98c732a199d9ebe4bc3cab1eabe37711d35c258ad31"} Jul 09 14:57:56.012091 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:56.011792 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4badcd99-1461-4f7d-8b7c-eb47132586a2","Type":"ContainerStarted","Data":"f12439b4a575f9c39b4d2c751ff76270fdd9581000a9b64df0c00b8ecdd2f932"} Jul 09 14:57:56.054683 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:56.054637 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.794043059 podStartE2EDuration="13.054620428s" totalImagesPullingTime="10.241730062s" totalInitContainerRuntime="18.847307ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:56.053207783 +0000 UTC m=+158.375657361" watchObservedRunningTime="2026-07-09 14:57:56.054620428 +0000 UTC m=+158.377069983" Jul 09 14:57:57.594130 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:57:57.594090 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mrzwc" podUID="947a6a4b-bd97-4327-ade2-c01882a909e0" Jul 09 14:57:58.020339 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:58.020310 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mrzwc" Jul 09 14:57:58.710214 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:58.710185 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:57:59.005854 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:57:59.005822 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5884cf55b6-jvbcl" Jul 09 14:58:02.485758 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:02.485722 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:58:02.488230 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:02.488208 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/947a6a4b-bd97-4327-ade2-c01882a909e0-metrics-tls\") pod \"dns-default-mrzwc\" (UID: \"947a6a4b-bd97-4327-ade2-c01882a909e0\") " pod="openshift-dns/dns-default-mrzwc" Jul 09 14:58:02.523555 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:02.523525 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rns85\"" Jul 09 14:58:02.530853 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:02.530835 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mrzwc" Jul 09 14:58:02.705702 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:02.705668 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mrzwc"] Jul 09 14:58:02.709911 ip-10-0-128-136 kubenswrapper[2584]: W0709 14:58:02.709881 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947a6a4b_bd97_4327_ade2_c01882a909e0.slice/crio-a2a65e9f662cc5e5cc3c31a411b09f4e0e0f5f8c8a4f26ca895b99a271381117 WatchSource:0}: Error finding container a2a65e9f662cc5e5cc3c31a411b09f4e0e0f5f8c8a4f26ca895b99a271381117: Status 404 returned error can't find the container with id a2a65e9f662cc5e5cc3c31a411b09f4e0e0f5f8c8a4f26ca895b99a271381117 Jul 09 14:58:03.041950 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:03.041914 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mrzwc" event={"ID":"947a6a4b-bd97-4327-ade2-c01882a909e0","Type":"ContainerStarted","Data":"a2a65e9f662cc5e5cc3c31a411b09f4e0e0f5f8c8a4f26ca895b99a271381117"} Jul 09 14:58:06.055198 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:06.055163 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mrzwc" event={"ID":"947a6a4b-bd97-4327-ade2-c01882a909e0","Type":"ContainerStarted","Data":"23994c83e53d72e374b5f685ded70a437a37151beea38b5ab40108f32a216e0a"} Jul 09 14:58:06.055617 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:06.055222 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mrzwc" event={"ID":"947a6a4b-bd97-4327-ade2-c01882a909e0","Type":"ContainerStarted","Data":"3119dd1cf8c9b940280885581308c85c8079cec66c370f7ad03293fc314bbd41"} Jul 09 14:58:06.055617 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:06.055287 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mrzwc" Jul 09 14:58:06.076060 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:06.076016 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mrzwc" podStartSLOduration=129.601646799 podStartE2EDuration="2m12.076003509s" totalImagesPullingTime="2.47435671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:58:06.074526475 +0000 UTC m=+168.396976040" watchObservedRunningTime="2026-07-09 14:58:06.076003509 +0000 UTC m=+168.398453063" Jul 09 14:58:15.091900 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:15.091811 2584 generic.go:356] "Generic (PLEG): container finished" podID="71427bca-9234-45e0-a4a5-eb65e439a446" containerID="5d86f3459d9a00c6f1b5a512746dacb8bd9c535e8531ff3d2167f3ac1f9db2ea" exitCode=0 Jul 09 14:58:15.092396 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:15.091887 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" event={"ID":"71427bca-9234-45e0-a4a5-eb65e439a446","Type":"ContainerDied","Data":"5d86f3459d9a00c6f1b5a512746dacb8bd9c535e8531ff3d2167f3ac1f9db2ea"} Jul 09 14:58:15.092396 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:15.092337 2584 scope.go:117] "RemoveContainer" containerID="5d86f3459d9a00c6f1b5a512746dacb8bd9c535e8531ff3d2167f3ac1f9db2ea" Jul 09 14:58:15.603141 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:15.603110 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mrzwc_947a6a4b-bd97-4327-ade2-c01882a909e0/dns/0.log" Jul 09 14:58:15.611556 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:15.611533 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mrzwc_947a6a4b-bd97-4327-ade2-c01882a909e0/kube-rbac-proxy/0.log" Jul 09 14:58:15.767433 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:15.767405 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9694d_a828edc6-373d-46d7-a9f7-c0d2d0dc431d/dns-node-resolver/0.log" Jul 09 14:58:15.995527 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:15.995472 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9457cfd56-g8cnd" podUID="fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" containerName="console" containerID="cri-o://5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880" gracePeriod=15 Jul 09 14:58:16.060987 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.060962 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mrzwc" Jul 09 14:58:16.098690 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.098650 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-v4bth" event={"ID":"71427bca-9234-45e0-a4a5-eb65e439a446","Type":"ContainerStarted","Data":"4a04dd5036771e81c9ee039c221beecad5b773f3f4022b2ec1ad20acef072977"} Jul 09 14:58:16.246817 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.246760 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:58:16.289418 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.289395 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-trusted-ca-bundle\") pod \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " Jul 09 14:58:16.289580 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.289431 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-oauth-config\") pod \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " Jul 09 14:58:16.289580 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.289471 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-config\") pod \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " Jul 09 14:58:16.289580 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.289516 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9l99\" (UniqueName: \"kubernetes.io/projected/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-kube-api-access-l9l99\") pod \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " Jul 09 14:58:16.289580 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.289548 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-service-ca\") pod \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " Jul 09 14:58:16.289580 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.289578 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-oauth-serving-cert\") pod \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " Jul 09 14:58:16.289833 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.289628 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-serving-cert\") pod \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\" (UID: \"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d\") " Jul 09 14:58:16.289901 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.289876 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-config" (OuterVolumeSpecName: "console-config") pod "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" (UID: "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:58:16.289956 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.289912 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" (UID: "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:58:16.290155 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.290126 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" (UID: "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:58:16.290155 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.290130 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-service-ca" (OuterVolumeSpecName: "service-ca") pod "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" (UID: "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:58:16.291889 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.291867 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" (UID: "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:58:16.291979 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.291946 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" (UID: "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:58:16.292155 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.292134 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-kube-api-access-l9l99" (OuterVolumeSpecName: "kube-api-access-l9l99") pod "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" (UID: "fb53b0f5-959f-4bb5-aa40-dc76e8a5184d"). InnerVolumeSpecName "kube-api-access-l9l99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:58:16.390582 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.390547 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-serving-cert\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:58:16.390582 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.390580 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-trusted-ca-bundle\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:58:16.390582 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.390589 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-oauth-config\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:58:16.390748 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.390600 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-console-config\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:58:16.390748 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.390608 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9l99\" (UniqueName: \"kubernetes.io/projected/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-kube-api-access-l9l99\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:58:16.390748 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.390616 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-service-ca\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:58:16.390748 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:16.390624 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d-oauth-serving-cert\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 14:58:17.104106 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:17.104071 2584 generic.go:356] "Generic (PLEG): container finished" podID="fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" containerID="5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880" exitCode=0 Jul 09 14:58:17.104527 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:17.104129 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9457cfd56-g8cnd" Jul 09 14:58:17.104527 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:17.104160 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9457cfd56-g8cnd" event={"ID":"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d","Type":"ContainerDied","Data":"5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880"} Jul 09 14:58:17.104527 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:17.104213 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9457cfd56-g8cnd" event={"ID":"fb53b0f5-959f-4bb5-aa40-dc76e8a5184d","Type":"ContainerDied","Data":"5a54471f3cbb37fdeea04c0f5159ede7322716159c6941e58a286d5e6b7568ff"} Jul 09 14:58:17.104527 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:17.104233 2584 scope.go:117] "RemoveContainer" containerID="5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880" Jul 09 14:58:17.113387 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:17.113282 2584 scope.go:117] "RemoveContainer" containerID="5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880" Jul 09 14:58:17.113580 ip-10-0-128-136 kubenswrapper[2584]: E0709 14:58:17.113562 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880\": container with ID starting with 5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880 not found: ID does not exist" containerID="5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880" Jul 09 14:58:17.113623 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:17.113588 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880"} err="failed to get container status \"5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880\": rpc error: code = NotFound desc = could not find container \"5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880\": container with ID starting with 5869d3ab8265e4b0f841c044af53d14b291b2b93c042a732e332bfd1955d4880 not found: ID does not exist" Jul 09 14:58:17.127249 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:17.127225 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9457cfd56-g8cnd"] Jul 09 14:58:17.133891 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:17.133841 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9457cfd56-g8cnd"] Jul 09 14:58:18.233886 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:18.233852 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" path="/var/lib/kubelet/pods/fb53b0f5-959f-4bb5-aa40-dc76e8a5184d/volumes" Jul 09 14:58:43.709579 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:43.709534 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:58:43.726293 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:43.726266 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:58:44.233627 ip-10-0-128-136 kubenswrapper[2584]: I0709 14:58:44.233592 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:00:18.095259 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:18.095228 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:00:18.101836 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:18.101810 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:00:18.103751 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:18.103732 2584 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 15:00:24.382900 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.382868 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4"] Jul 09 15:00:24.384743 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.383340 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" containerName="console" Jul 09 15:00:24.384743 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.383355 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" containerName="console" Jul 09 15:00:24.384743 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.383410 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb53b0f5-959f-4bb5-aa40-dc76e8a5184d" containerName="console" Jul 09 15:00:24.385640 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.385621 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4" Jul 09 15:00:24.388534 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.388511 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 15:00:24.389552 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.389534 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:00:24.389640 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.389539 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-krrjr\"" Jul 09 15:00:24.395960 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.395939 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4"] Jul 09 15:00:24.487675 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.487644 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b7fa743-ed77-4f43-82df-1b5470046a32-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fpqm4\" (UID: \"0b7fa743-ed77-4f43-82df-1b5470046a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4" Jul 09 15:00:24.487782 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.487714 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v76sp\" (UniqueName: \"kubernetes.io/projected/0b7fa743-ed77-4f43-82df-1b5470046a32-kube-api-access-v76sp\") pod \"openshift-lws-operator-fd8ccff4c-fpqm4\" (UID: \"0b7fa743-ed77-4f43-82df-1b5470046a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4" Jul 09 15:00:24.588286 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.588257 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v76sp\" (UniqueName: \"kubernetes.io/projected/0b7fa743-ed77-4f43-82df-1b5470046a32-kube-api-access-v76sp\") pod \"openshift-lws-operator-fd8ccff4c-fpqm4\" (UID: \"0b7fa743-ed77-4f43-82df-1b5470046a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4" Jul 09 15:00:24.588409 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.588297 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b7fa743-ed77-4f43-82df-1b5470046a32-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fpqm4\" (UID: \"0b7fa743-ed77-4f43-82df-1b5470046a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4" Jul 09 15:00:24.588734 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.588719 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b7fa743-ed77-4f43-82df-1b5470046a32-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fpqm4\" (UID: \"0b7fa743-ed77-4f43-82df-1b5470046a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4" Jul 09 15:00:24.597860 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.597841 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v76sp\" (UniqueName: \"kubernetes.io/projected/0b7fa743-ed77-4f43-82df-1b5470046a32-kube-api-access-v76sp\") pod \"openshift-lws-operator-fd8ccff4c-fpqm4\" (UID: \"0b7fa743-ed77-4f43-82df-1b5470046a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4" Jul 09 15:00:24.703821 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.703752 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4" Jul 09 15:00:24.836142 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.836100 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4"] Jul 09 15:00:24.839330 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:00:24.839287 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b7fa743_ed77_4f43_82df_1b5470046a32.slice/crio-499dcc94435f353059226c69e518d9d0c848691d274b4b0aac2763a69f165a6f WatchSource:0}: Error finding container 499dcc94435f353059226c69e518d9d0c848691d274b4b0aac2763a69f165a6f: Status 404 returned error can't find the container with id 499dcc94435f353059226c69e518d9d0c848691d274b4b0aac2763a69f165a6f Jul 09 15:00:24.840828 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:24.840809 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:00:25.611053 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:25.611014 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4" event={"ID":"0b7fa743-ed77-4f43-82df-1b5470046a32","Type":"ContainerStarted","Data":"499dcc94435f353059226c69e518d9d0c848691d274b4b0aac2763a69f165a6f"} Jul 09 15:00:28.625063 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:28.625022 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4" event={"ID":"0b7fa743-ed77-4f43-82df-1b5470046a32","Type":"ContainerStarted","Data":"3bec18e1a7038a2b71da2c6c4afda5c1b8392443b56105016e54cb8c980b85fc"} Jul 09 15:00:28.643349 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:28.643301 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fpqm4" podStartSLOduration=1.863849168 podStartE2EDuration="4.643284973s" totalImagesPullingTime="2.779435805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:00:28.642185371 +0000 UTC m=+310.964634924" watchObservedRunningTime="2026-07-09 15:00:28.643284973 +0000 UTC m=+310.965734527" Jul 09 15:00:44.364451 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.364413 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7"] Jul 09 15:00:44.367016 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.367000 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.376419 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.376398 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 15:00:44.376540 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.376408 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 15:00:44.377307 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.377287 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p9w5l\"" Jul 09 15:00:44.377405 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.377330 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 15:00:44.377405 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.377349 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 15:00:44.387911 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.387885 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7"] Jul 09 15:00:44.432488 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.432462 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.432635 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.432520 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-tmp\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.432635 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.432586 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmq9x\" (UniqueName: \"kubernetes.io/projected/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-kube-api-access-zmq9x\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.432635 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.432626 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.432756 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.432667 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-manifests\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.533298 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.533271 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.533298 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.533300 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-tmp\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.533461 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.533329 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmq9x\" (UniqueName: \"kubernetes.io/projected/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-kube-api-access-zmq9x\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.533549 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.533470 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.533612 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.533576 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-manifests\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.533883 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.533862 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-manifests\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.535700 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.535683 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-tmp\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.535834 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.535815 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.535896 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.535877 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.545381 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.545353 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmq9x\" (UniqueName: \"kubernetes.io/projected/d61a88cd-5fd0-4005-a7f2-fe344099fe9f-kube-api-access-zmq9x\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7\" (UID: \"d61a88cd-5fd0-4005-a7f2-fe344099fe9f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.677355 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.677228 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:44.837354 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:44.837319 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7"] Jul 09 15:00:44.843191 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:00:44.843158 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd61a88cd_5fd0_4005_a7f2_fe344099fe9f.slice/crio-fdfb1f9d28812f6bbf59d56a3ffbc36897a1723b636c37f4d0a8e2e0c2762d1c WatchSource:0}: Error finding container fdfb1f9d28812f6bbf59d56a3ffbc36897a1723b636c37f4d0a8e2e0c2762d1c: Status 404 returned error can't find the container with id fdfb1f9d28812f6bbf59d56a3ffbc36897a1723b636c37f4d0a8e2e0c2762d1c Jul 09 15:00:45.696869 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:45.696825 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" event={"ID":"d61a88cd-5fd0-4005-a7f2-fe344099fe9f","Type":"ContainerStarted","Data":"fdfb1f9d28812f6bbf59d56a3ffbc36897a1723b636c37f4d0a8e2e0c2762d1c"} Jul 09 15:00:48.713088 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:48.713052 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" event={"ID":"d61a88cd-5fd0-4005-a7f2-fe344099fe9f","Type":"ContainerStarted","Data":"6e2009b2174af45ca52165b23a7da794f1cc69c3b920b21f10c3eaeefbbe2ba9"} Jul 09 15:00:49.718957 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:49.718919 2584 generic.go:356] "Generic (PLEG): container finished" podID="d61a88cd-5fd0-4005-a7f2-fe344099fe9f" containerID="6e2009b2174af45ca52165b23a7da794f1cc69c3b920b21f10c3eaeefbbe2ba9" exitCode=0 Jul 09 15:00:49.719378 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:49.719007 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" event={"ID":"d61a88cd-5fd0-4005-a7f2-fe344099fe9f","Type":"ContainerDied","Data":"6e2009b2174af45ca52165b23a7da794f1cc69c3b920b21f10c3eaeefbbe2ba9"} Jul 09 15:00:50.726315 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:50.726259 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" event={"ID":"d61a88cd-5fd0-4005-a7f2-fe344099fe9f","Type":"ContainerStarted","Data":"f2f7da932f9d49361e00d6fd32b5c2e1ae665bf76f5117005ccea590e6d2fb86"} Jul 09 15:00:50.726800 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:50.726363 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:00:50.756621 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:00:50.756567 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" podStartSLOduration=2.390567822 podStartE2EDuration="6.756545955s" totalImagesPullingTime="3.271382007s" totalInitContainerRuntime="1.094596126s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:00:50.753375232 +0000 UTC m=+333.075824807" watchObservedRunningTime="2026-07-09 15:00:50.756545955 +0000 UTC m=+333.078995513" Jul 09 15:01:01.733738 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:01.733709 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7" Jul 09 15:01:04.140385 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.140351 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf"] Jul 09 15:01:04.163837 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.163809 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf"] Jul 09 15:01:04.163974 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.163898 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.166614 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.166589 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h4gmk\"" Jul 09 15:01:04.167962 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.167942 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 15:01:04.168078 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.168021 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 15:01:04.168152 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.168123 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 15:01:04.196211 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.196191 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f"] Jul 09 15:01:04.199652 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.199635 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" Jul 09 15:01:04.202568 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.202546 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4mlg7\"" Jul 09 15:01:04.202666 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.202610 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 15:01:04.202666 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.202610 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 15:01:04.211461 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.211445 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f"] Jul 09 15:01:04.299239 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.299214 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b3ac9cf-b6b8-4268-8b58-48766118417b-tmp\") pod \"kube-auth-proxy-99cb46dbc-dmm6f\" (UID: \"2b3ac9cf-b6b8-4268-8b58-48766118417b\") " pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" Jul 09 15:01:04.299239 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.299242 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cddcde7b-807e-403b-bdca-11b81229e590-manager-config\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.299425 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.299261 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddcde7b-807e-403b-bdca-11b81229e590-cert\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.299425 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.299281 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3ac9cf-b6b8-4268-8b58-48766118417b-tls-certs\") pod \"kube-auth-proxy-99cb46dbc-dmm6f\" (UID: \"2b3ac9cf-b6b8-4268-8b58-48766118417b\") " pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" Jul 09 15:01:04.299425 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.299337 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxgn7\" (UniqueName: \"kubernetes.io/projected/cddcde7b-807e-403b-bdca-11b81229e590-kube-api-access-gxgn7\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.299425 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.299372 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cddcde7b-807e-403b-bdca-11b81229e590-metrics-cert\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.299425 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.299391 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kwzr\" (UniqueName: \"kubernetes.io/projected/2b3ac9cf-b6b8-4268-8b58-48766118417b-kube-api-access-7kwzr\") pod \"kube-auth-proxy-99cb46dbc-dmm6f\" (UID: \"2b3ac9cf-b6b8-4268-8b58-48766118417b\") " pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" Jul 09 15:01:04.400260 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.400184 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b3ac9cf-b6b8-4268-8b58-48766118417b-tmp\") pod \"kube-auth-proxy-99cb46dbc-dmm6f\" (UID: \"2b3ac9cf-b6b8-4268-8b58-48766118417b\") " pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" Jul 09 15:01:04.400260 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.400228 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cddcde7b-807e-403b-bdca-11b81229e590-manager-config\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.400424 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.400349 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddcde7b-807e-403b-bdca-11b81229e590-cert\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.400424 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.400392 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3ac9cf-b6b8-4268-8b58-48766118417b-tls-certs\") pod \"kube-auth-proxy-99cb46dbc-dmm6f\" (UID: \"2b3ac9cf-b6b8-4268-8b58-48766118417b\") " pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" Jul 09 15:01:04.400533 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.400427 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxgn7\" (UniqueName: \"kubernetes.io/projected/cddcde7b-807e-403b-bdca-11b81229e590-kube-api-access-gxgn7\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.400615 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.400592 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cddcde7b-807e-403b-bdca-11b81229e590-metrics-cert\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.400678 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.400643 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kwzr\" (UniqueName: \"kubernetes.io/projected/2b3ac9cf-b6b8-4268-8b58-48766118417b-kube-api-access-7kwzr\") pod \"kube-auth-proxy-99cb46dbc-dmm6f\" (UID: \"2b3ac9cf-b6b8-4268-8b58-48766118417b\") " pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" Jul 09 15:01:04.401339 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.401316 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cddcde7b-807e-403b-bdca-11b81229e590-manager-config\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.403213 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.403186 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b3ac9cf-b6b8-4268-8b58-48766118417b-tmp\") pod \"kube-auth-proxy-99cb46dbc-dmm6f\" (UID: \"2b3ac9cf-b6b8-4268-8b58-48766118417b\") " pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" Jul 09 15:01:04.403535 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.403514 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddcde7b-807e-403b-bdca-11b81229e590-cert\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.403620 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.403541 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3ac9cf-b6b8-4268-8b58-48766118417b-tls-certs\") pod \"kube-auth-proxy-99cb46dbc-dmm6f\" (UID: \"2b3ac9cf-b6b8-4268-8b58-48766118417b\") " pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" Jul 09 15:01:04.403692 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.403672 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cddcde7b-807e-403b-bdca-11b81229e590-metrics-cert\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.418550 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.418529 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kwzr\" (UniqueName: \"kubernetes.io/projected/2b3ac9cf-b6b8-4268-8b58-48766118417b-kube-api-access-7kwzr\") pod \"kube-auth-proxy-99cb46dbc-dmm6f\" (UID: \"2b3ac9cf-b6b8-4268-8b58-48766118417b\") " pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" Jul 09 15:01:04.422236 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.422210 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxgn7\" (UniqueName: \"kubernetes.io/projected/cddcde7b-807e-403b-bdca-11b81229e590-kube-api-access-gxgn7\") pod \"lws-controller-manager-6c4bdcff7c-x29sf\" (UID: \"cddcde7b-807e-403b-bdca-11b81229e590\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.474044 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.474015 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:04.508949 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.508918 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" Jul 09 15:01:04.624587 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.624554 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf"] Jul 09 15:01:04.627901 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:01:04.627874 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcddcde7b_807e_403b_bdca_11b81229e590.slice/crio-8f66a63285d1c4da49ce7213a1705a08484f83a4735c5df3cfce511e8eaeb900 WatchSource:0}: Error finding container 8f66a63285d1c4da49ce7213a1705a08484f83a4735c5df3cfce511e8eaeb900: Status 404 returned error can't find the container with id 8f66a63285d1c4da49ce7213a1705a08484f83a4735c5df3cfce511e8eaeb900 Jul 09 15:01:04.663924 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.663887 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f"] Jul 09 15:01:04.666856 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:01:04.666828 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3ac9cf_b6b8_4268_8b58_48766118417b.slice/crio-b37f9a927828d4b9c0c5e6486ed7d811a27348418e486fb4cfdd7bebed79d40e WatchSource:0}: Error finding container b37f9a927828d4b9c0c5e6486ed7d811a27348418e486fb4cfdd7bebed79d40e: Status 404 returned error can't find the container with id b37f9a927828d4b9c0c5e6486ed7d811a27348418e486fb4cfdd7bebed79d40e Jul 09 15:01:04.790508 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.790459 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" event={"ID":"cddcde7b-807e-403b-bdca-11b81229e590","Type":"ContainerStarted","Data":"8f66a63285d1c4da49ce7213a1705a08484f83a4735c5df3cfce511e8eaeb900"} Jul 09 15:01:04.791549 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:04.791525 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" event={"ID":"2b3ac9cf-b6b8-4268-8b58-48766118417b","Type":"ContainerStarted","Data":"b37f9a927828d4b9c0c5e6486ed7d811a27348418e486fb4cfdd7bebed79d40e"} Jul 09 15:01:08.811275 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:08.811242 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" event={"ID":"cddcde7b-807e-403b-bdca-11b81229e590","Type":"ContainerStarted","Data":"07b7f240d3e7b9bcccdde7656ec3f2c66e70bbc129a5ebab2afbeeeeb37c6da8"} Jul 09 15:01:08.811714 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:08.811333 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:01:08.812875 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:08.812851 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" event={"ID":"2b3ac9cf-b6b8-4268-8b58-48766118417b","Type":"ContainerStarted","Data":"6faae4a3f1cfea6069bace218d1e7182df003c8b2b62997a47fb837600821f38"} Jul 09 15:01:08.830295 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:08.830224 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" podStartSLOduration=1.6910504020000001 podStartE2EDuration="4.830207474s" totalImagesPullingTime="3.139157072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:01:08.829792136 +0000 UTC m=+351.152241711" watchObservedRunningTime="2026-07-09 15:01:08.830207474 +0000 UTC m=+351.152657028" Jul 09 15:01:08.849076 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:08.849040 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-99cb46dbc-dmm6f" podStartSLOduration=0.832274789 podStartE2EDuration="4.849025209s" totalImagesPullingTime="4.01675042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:01:08.848053575 +0000 UTC m=+351.170503151" watchObservedRunningTime="2026-07-09 15:01:08.849025209 +0000 UTC m=+351.171474763" Jul 09 15:01:19.820966 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:01:19.820754 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-x29sf" Jul 09 15:03:42.489870 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.489834 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp"] Jul 09 15:03:42.492664 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.492640 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.496392 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.496369 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5sgft\"" Jul 09 15:03:42.497277 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.497262 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 15:03:42.506904 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.506883 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp"] Jul 09 15:03:42.593310 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.593277 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd8c708d-7346-4506-a606-98455ee496e5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.593310 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.593310 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd8c708d-7346-4506-a606-98455ee496e5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.593543 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.593330 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd8c708d-7346-4506-a606-98455ee496e5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.593543 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.593402 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.593543 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.593424 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljr8l\" (UniqueName: \"kubernetes.io/projected/fd8c708d-7346-4506-a606-98455ee496e5-kube-api-access-ljr8l\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.593543 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.593469 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.593543 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.593488 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.593792 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.593586 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.593792 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.593621 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.694766 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.694731 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.694766 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.694767 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljr8l\" (UniqueName: \"kubernetes.io/projected/fd8c708d-7346-4506-a606-98455ee496e5-kube-api-access-ljr8l\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.694975 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.694805 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.694975 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.694828 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.694975 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.694896 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.694975 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.694933 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.694975 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.694964 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd8c708d-7346-4506-a606-98455ee496e5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.695224 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.694991 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd8c708d-7346-4506-a606-98455ee496e5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.695224 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.695016 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd8c708d-7346-4506-a606-98455ee496e5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.695327 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.695266 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.695472 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.695448 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.695555 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.695491 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.695555 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.695522 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.695703 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.695686 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd8c708d-7346-4506-a606-98455ee496e5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.697531 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.697484 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd8c708d-7346-4506-a606-98455ee496e5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.697671 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.697653 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd8c708d-7346-4506-a606-98455ee496e5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.704893 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.704863 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd8c708d-7346-4506-a606-98455ee496e5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.705034 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.704909 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljr8l\" (UniqueName: \"kubernetes.io/projected/fd8c708d-7346-4506-a606-98455ee496e5-kube-api-access-ljr8l\") pod \"maas-default-gateway-openshift-default-56654dcf7-bckrp\" (UID: \"fd8c708d-7346-4506-a606-98455ee496e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.802991 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.802958 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:42.945839 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:42.945748 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp"] Jul 09 15:03:42.948023 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:03:42.947986 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8c708d_7346_4506_a606_98455ee496e5.slice/crio-5814ed784c33af8d071b9ddafc886432d92d778d615218d7515637994c96edd0 WatchSource:0}: Error finding container 5814ed784c33af8d071b9ddafc886432d92d778d615218d7515637994c96edd0: Status 404 returned error can't find the container with id 5814ed784c33af8d071b9ddafc886432d92d778d615218d7515637994c96edd0 Jul 09 15:03:43.497918 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:43.497866 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" event={"ID":"fd8c708d-7346-4506-a606-98455ee496e5","Type":"ContainerStarted","Data":"5814ed784c33af8d071b9ddafc886432d92d778d615218d7515637994c96edd0"} Jul 09 15:03:45.423780 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:45.423739 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:03:45.424036 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:45.423816 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:03:45.424036 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:45.423852 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:03:45.512879 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:45.512838 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" event={"ID":"fd8c708d-7346-4506-a606-98455ee496e5","Type":"ContainerStarted","Data":"015fc5dbb1d32fd0d1184c2dd90317947468f410abc19d52487dba087814ea0e"} Jul 09 15:03:45.542253 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:45.542192 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" podStartSLOduration=1.06866846 podStartE2EDuration="3.542172988s" totalImagesPullingTime="2.473504528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:45.539553242 +0000 UTC m=+507.862002820" watchObservedRunningTime="2026-07-09 15:03:45.542172988 +0000 UTC m=+507.864622543" Jul 09 15:03:45.803869 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:45.803837 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:46.808010 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:46.807979 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:47.130598 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.130512 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:03:47.133261 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.133238 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" Jul 09 15:03:47.136380 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.136362 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tnv95\"" Jul 09 15:03:47.136824 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.136808 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 15:03:47.136973 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.136956 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 15:03:47.137039 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.136986 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 15:03:47.151976 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.151952 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:03:47.167920 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.167901 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:03:47.234693 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.234659 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq5r2\" (UniqueName: \"kubernetes.io/projected/e4e9505f-ede2-4249-8593-729874d9ff5e-kube-api-access-cq5r2\") pod \"limitador-limitador-54d6d988d5-7sqtx\" (UID: \"e4e9505f-ede2-4249-8593-729874d9ff5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" Jul 09 15:03:47.234693 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.234693 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e4e9505f-ede2-4249-8593-729874d9ff5e-config-file\") pod \"limitador-limitador-54d6d988d5-7sqtx\" (UID: \"e4e9505f-ede2-4249-8593-729874d9ff5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" Jul 09 15:03:47.335997 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.335963 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq5r2\" (UniqueName: \"kubernetes.io/projected/e4e9505f-ede2-4249-8593-729874d9ff5e-kube-api-access-cq5r2\") pod \"limitador-limitador-54d6d988d5-7sqtx\" (UID: \"e4e9505f-ede2-4249-8593-729874d9ff5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" Jul 09 15:03:47.336190 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.336004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e4e9505f-ede2-4249-8593-729874d9ff5e-config-file\") pod \"limitador-limitador-54d6d988d5-7sqtx\" (UID: \"e4e9505f-ede2-4249-8593-729874d9ff5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" Jul 09 15:03:47.336731 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.336706 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e4e9505f-ede2-4249-8593-729874d9ff5e-config-file\") pod \"limitador-limitador-54d6d988d5-7sqtx\" (UID: \"e4e9505f-ede2-4249-8593-729874d9ff5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" Jul 09 15:03:47.345400 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.345375 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq5r2\" (UniqueName: \"kubernetes.io/projected/e4e9505f-ede2-4249-8593-729874d9ff5e-kube-api-access-cq5r2\") pod \"limitador-limitador-54d6d988d5-7sqtx\" (UID: \"e4e9505f-ede2-4249-8593-729874d9ff5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" Jul 09 15:03:47.444487 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.444399 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" Jul 09 15:03:47.492940 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.492912 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-pt82s"] Jul 09 15:03:47.495437 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.495421 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pt82s" Jul 09 15:03:47.498810 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.498779 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pq76b\"" Jul 09 15:03:47.511800 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.511776 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pt82s"] Jul 09 15:03:47.527985 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.527921 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:47.529077 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.529058 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:03:47.537684 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.537653 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs5cn\" (UniqueName: \"kubernetes.io/projected/6cbb4461-a6d9-4b57-8839-f4adf4a16b08-kube-api-access-cs5cn\") pod \"authorino-75d556bd77-pt82s\" (UID: \"6cbb4461-a6d9-4b57-8839-f4adf4a16b08\") " pod="kuadrant-system/authorino-75d556bd77-pt82s" Jul 09 15:03:47.611374 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.611276 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:03:47.613806 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:03:47.613771 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e9505f_ede2_4249_8593_729874d9ff5e.slice/crio-528b5265478e89bab5b1bfcbb6f60cee61d7181d1e4842f86a9d724a1202a932 WatchSource:0}: Error finding container 528b5265478e89bab5b1bfcbb6f60cee61d7181d1e4842f86a9d724a1202a932: Status 404 returned error can't find the container with id 528b5265478e89bab5b1bfcbb6f60cee61d7181d1e4842f86a9d724a1202a932 Jul 09 15:03:47.638683 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.638657 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs5cn\" (UniqueName: \"kubernetes.io/projected/6cbb4461-a6d9-4b57-8839-f4adf4a16b08-kube-api-access-cs5cn\") pod \"authorino-75d556bd77-pt82s\" (UID: \"6cbb4461-a6d9-4b57-8839-f4adf4a16b08\") " pod="kuadrant-system/authorino-75d556bd77-pt82s" Jul 09 15:03:47.648377 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.648347 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs5cn\" (UniqueName: \"kubernetes.io/projected/6cbb4461-a6d9-4b57-8839-f4adf4a16b08-kube-api-access-cs5cn\") pod \"authorino-75d556bd77-pt82s\" (UID: \"6cbb4461-a6d9-4b57-8839-f4adf4a16b08\") " pod="kuadrant-system/authorino-75d556bd77-pt82s" Jul 09 15:03:47.809517 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.809456 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pt82s" Jul 09 15:03:47.942391 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:47.942364 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pt82s"] Jul 09 15:03:47.943948 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:03:47.943922 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cbb4461_a6d9_4b57_8839_f4adf4a16b08.slice/crio-ac8c317b7e6148a43adb010e3e9bd0e13e5ceb590168bb63b8c6f652c6316b79 WatchSource:0}: Error finding container ac8c317b7e6148a43adb010e3e9bd0e13e5ceb590168bb63b8c6f652c6316b79: Status 404 returned error can't find the container with id ac8c317b7e6148a43adb010e3e9bd0e13e5ceb590168bb63b8c6f652c6316b79 Jul 09 15:03:48.533412 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:48.533377 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" event={"ID":"e4e9505f-ede2-4249-8593-729874d9ff5e","Type":"ContainerStarted","Data":"528b5265478e89bab5b1bfcbb6f60cee61d7181d1e4842f86a9d724a1202a932"} Jul 09 15:03:48.534555 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:48.534532 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pt82s" event={"ID":"6cbb4461-a6d9-4b57-8839-f4adf4a16b08","Type":"ContainerStarted","Data":"ac8c317b7e6148a43adb010e3e9bd0e13e5ceb590168bb63b8c6f652c6316b79"} Jul 09 15:03:53.565550 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:53.565490 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" event={"ID":"e4e9505f-ede2-4249-8593-729874d9ff5e","Type":"ContainerStarted","Data":"66b43f174c8f254966104b54f144b037398959090ae78f062e14f7219837302b"} Jul 09 15:03:53.565966 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:53.565575 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" Jul 09 15:03:53.567001 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:53.566980 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pt82s" event={"ID":"6cbb4461-a6d9-4b57-8839-f4adf4a16b08","Type":"ContainerStarted","Data":"76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83"} Jul 09 15:03:53.585172 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:53.585121 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" podStartSLOduration=1.496723795 podStartE2EDuration="6.585109016s" totalImagesPullingTime="5.088385221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:53.583448559 +0000 UTC m=+515.905898114" watchObservedRunningTime="2026-07-09 15:03:53.585109016 +0000 UTC m=+515.907558570" Jul 09 15:03:53.601279 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:03:53.601238 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-pt82s" podStartSLOduration=1.830675888 podStartE2EDuration="6.601224109s" totalImagesPullingTime="4.770548221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:53.600857299 +0000 UTC m=+515.923306874" watchObservedRunningTime="2026-07-09 15:03:53.601224109 +0000 UTC m=+515.923673664" Jul 09 15:04:04.572099 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:04.572063 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7sqtx" Jul 09 15:04:23.061277 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.061200 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pt82s"] Jul 09 15:04:23.061805 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.061372 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-pt82s" podUID="6cbb4461-a6d9-4b57-8839-f4adf4a16b08" containerName="authorino" containerID="cri-o://76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83" gracePeriod=30 Jul 09 15:04:23.303908 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.303884 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pt82s" Jul 09 15:04:23.434203 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.434126 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs5cn\" (UniqueName: \"kubernetes.io/projected/6cbb4461-a6d9-4b57-8839-f4adf4a16b08-kube-api-access-cs5cn\") pod \"6cbb4461-a6d9-4b57-8839-f4adf4a16b08\" (UID: \"6cbb4461-a6d9-4b57-8839-f4adf4a16b08\") " Jul 09 15:04:23.436411 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.436380 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cbb4461-a6d9-4b57-8839-f4adf4a16b08-kube-api-access-cs5cn" (OuterVolumeSpecName: "kube-api-access-cs5cn") pod "6cbb4461-a6d9-4b57-8839-f4adf4a16b08" (UID: "6cbb4461-a6d9-4b57-8839-f4adf4a16b08"). InnerVolumeSpecName "kube-api-access-cs5cn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:04:23.535583 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.535553 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs5cn\" (UniqueName: \"kubernetes.io/projected/6cbb4461-a6d9-4b57-8839-f4adf4a16b08-kube-api-access-cs5cn\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:04:23.708727 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.708652 2584 generic.go:356] "Generic (PLEG): container finished" podID="6cbb4461-a6d9-4b57-8839-f4adf4a16b08" containerID="76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83" exitCode=0 Jul 09 15:04:23.708727 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.708689 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pt82s" event={"ID":"6cbb4461-a6d9-4b57-8839-f4adf4a16b08","Type":"ContainerDied","Data":"76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83"} Jul 09 15:04:23.708892 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.708738 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pt82s" event={"ID":"6cbb4461-a6d9-4b57-8839-f4adf4a16b08","Type":"ContainerDied","Data":"ac8c317b7e6148a43adb010e3e9bd0e13e5ceb590168bb63b8c6f652c6316b79"} Jul 09 15:04:23.708892 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.708756 2584 scope.go:117] "RemoveContainer" containerID="76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83" Jul 09 15:04:23.708892 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.708708 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pt82s" Jul 09 15:04:23.718474 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.718457 2584 scope.go:117] "RemoveContainer" containerID="76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83" Jul 09 15:04:23.718835 ip-10-0-128-136 kubenswrapper[2584]: E0709 15:04:23.718816 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83\": container with ID starting with 76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83 not found: ID does not exist" containerID="76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83" Jul 09 15:04:23.718912 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.718844 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83"} err="failed to get container status \"76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83\": rpc error: code = NotFound desc = could not find container \"76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83\": container with ID starting with 76aed95c5edf3ec92f3f435df99701e2f55ef4d50492d0e6c040f84d6d70bd83 not found: ID does not exist" Jul 09 15:04:23.738505 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.738477 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pt82s"] Jul 09 15:04:23.752327 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:23.752305 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pt82s"] Jul 09 15:04:24.235284 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:04:24.235254 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cbb4461-a6d9-4b57-8839-f4adf4a16b08" path="/var/lib/kubelet/pods/6cbb4461-a6d9-4b57-8839-f4adf4a16b08/volumes" Jul 09 15:05:03.345236 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:03.345199 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:05:10.926266 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:10.926165 2584 generic.go:356] "Generic (PLEG): container finished" podID="fd8c708d-7346-4506-a606-98455ee496e5" containerID="015fc5dbb1d32fd0d1184c2dd90317947468f410abc19d52487dba087814ea0e" exitCode=0 Jul 09 15:05:10.926266 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:10.926248 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" event={"ID":"fd8c708d-7346-4506-a606-98455ee496e5","Type":"ContainerDied","Data":"015fc5dbb1d32fd0d1184c2dd90317947468f410abc19d52487dba087814ea0e"} Jul 09 15:05:10.926844 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:10.926740 2584 scope.go:117] "RemoveContainer" containerID="015fc5dbb1d32fd0d1184c2dd90317947468f410abc19d52487dba087814ea0e" Jul 09 15:05:10.927737 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:10.927707 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:05:10.927837 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:10.927776 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:05:10.927837 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:10.927808 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:05:11.932425 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:11.932390 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" event={"ID":"fd8c708d-7346-4506-a606-98455ee496e5","Type":"ContainerStarted","Data":"5c45d037d18e1fdf713f40e916046d4fb8ee6b70709f80c57a2ba631eb69df8b"} Jul 09 15:05:12.805047 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:12.805003 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:05:12.805245 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:12.805179 2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bckrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 09 15:05:12.805326 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:12.805237 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" podUID="fd8c708d-7346-4506-a606-98455ee496e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 09 15:05:13.804137 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:13.804091 2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bckrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 09 15:05:13.804624 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:13.804163 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" podUID="fd8c708d-7346-4506-a606-98455ee496e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 09 15:05:14.804287 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:14.803854 2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bckrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 09 15:05:14.804287 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:14.803914 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" podUID="fd8c708d-7346-4506-a606-98455ee496e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 09 15:05:15.804056 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:15.803557 2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bckrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 09 15:05:15.804056 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:15.803626 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" podUID="fd8c708d-7346-4506-a606-98455ee496e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 09 15:05:16.807725 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:16.807691 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:05:16.808106 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:16.807951 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:05:16.808716 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:16.808698 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bckrp" Jul 09 15:05:18.125725 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:18.125693 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:05:18.128891 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:18.128871 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:05:26.807713 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:26.807679 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:05:45.809693 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:05:45.809614 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:06:01.901479 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:01.901447 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:06:06.501558 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:06.501526 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:06:16.801297 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.801267 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f"] Jul 09 15:06:16.801850 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.801830 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cbb4461-a6d9-4b57-8839-f4adf4a16b08" containerName="authorino" Jul 09 15:06:16.801927 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.801855 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cbb4461-a6d9-4b57-8839-f4adf4a16b08" containerName="authorino" Jul 09 15:06:16.801978 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.801947 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cbb4461-a6d9-4b57-8839-f4adf4a16b08" containerName="authorino" Jul 09 15:06:16.804228 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.804206 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.817332 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.817316 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 15:06:16.817662 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.817642 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qjgf2\"" Jul 09 15:06:16.817662 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.817650 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 15:06:16.817783 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.817659 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 15:06:16.829087 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.829068 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f"] Jul 09 15:06:16.871538 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.871490 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.871644 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.871578 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129f588f-07b4-47e9-88ee-1c035a5d722a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.871644 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.871614 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.871644 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.871628 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.871775 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.871653 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbtjd\" (UniqueName: \"kubernetes.io/projected/129f588f-07b4-47e9-88ee-1c035a5d722a-kube-api-access-pbtjd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.871775 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.871748 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.972316 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.972279 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.972316 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.972325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.972486 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.972363 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129f588f-07b4-47e9-88ee-1c035a5d722a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.972486 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.972391 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.972486 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.972407 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.972486 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.972423 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtjd\" (UniqueName: \"kubernetes.io/projected/129f588f-07b4-47e9-88ee-1c035a5d722a-kube-api-access-pbtjd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.972761 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.972738 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.972850 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.972833 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.972944 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.972859 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.974735 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.974718 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129f588f-07b4-47e9-88ee-1c035a5d722a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.974878 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.974861 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129f588f-07b4-47e9-88ee-1c035a5d722a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:16.983701 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:16.983682 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbtjd\" (UniqueName: \"kubernetes.io/projected/129f588f-07b4-47e9-88ee-1c035a5d722a-kube-api-access-pbtjd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lvn8f\" (UID: \"129f588f-07b4-47e9-88ee-1c035a5d722a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:17.115210 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:17.115147 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:17.257455 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:17.257426 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f"] Jul 09 15:06:17.259435 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:06:17.259406 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129f588f_07b4_47e9_88ee_1c035a5d722a.slice/crio-d187c8b9a818b54cfb4be08e6d62dd405ef7e5a973f931deca30093d03d07e4a WatchSource:0}: Error finding container d187c8b9a818b54cfb4be08e6d62dd405ef7e5a973f931deca30093d03d07e4a: Status 404 returned error can't find the container with id d187c8b9a818b54cfb4be08e6d62dd405ef7e5a973f931deca30093d03d07e4a Jul 09 15:06:17.260873 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:17.260857 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:06:18.237155 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:18.237123 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" event={"ID":"129f588f-07b4-47e9-88ee-1c035a5d722a","Type":"ContainerStarted","Data":"d187c8b9a818b54cfb4be08e6d62dd405ef7e5a973f931deca30093d03d07e4a"} Jul 09 15:06:18.904460 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:18.904426 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:06:19.240708 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:19.240634 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" event={"ID":"129f588f-07b4-47e9-88ee-1c035a5d722a","Type":"ContainerStarted","Data":"44768e069f93417d29cc08516b5b1338b35deb5ddbbcc22da4e93674c5da47a2"} Jul 09 15:06:19.264632 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:19.264577 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" podStartSLOduration=2.175114688 podStartE2EDuration="3.264562334s" totalImagesPullingTime="1.089447646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:06:19.26276786 +0000 UTC m=+661.585217465" watchObservedRunningTime="2026-07-09 15:06:19.264562334 +0000 UTC m=+661.587011888" Jul 09 15:06:25.799151 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:25.799113 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79"] Jul 09 15:06:25.801837 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:25.801815 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:25.805241 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:25.805220 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 09 15:06:25.818836 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:25.817487 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79"] Jul 09 15:06:25.949034 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:25.949007 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:25.949034 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:25.949040 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:25.949227 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:25.949056 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:25.949227 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:25.949079 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:25.949227 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:25.949145 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:25.949227 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:25.949176 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmzz\" (UniqueName: \"kubernetes.io/projected/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-kube-api-access-whmzz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.050462 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.050387 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.050462 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.050422 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.050462 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.050439 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.050462 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.050460 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.050801 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.050522 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.050801 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.050552 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whmzz\" (UniqueName: \"kubernetes.io/projected/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-kube-api-access-whmzz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.050940 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.050916 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.050992 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.050942 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.051030 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.050995 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.052890 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.052870 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.053169 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.053152 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.062870 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.062842 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmzz\" (UniqueName: \"kubernetes.io/projected/e36e9c2d-0a82-4911-a2ed-dbc4c8860156-kube-api-access-whmzz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79\" (UID: \"e36e9c2d-0a82-4911-a2ed-dbc4c8860156\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.110839 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.110805 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:26.244314 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.244290 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79"] Jul 09 15:06:26.246260 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:06:26.246236 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode36e9c2d_0a82_4911_a2ed_dbc4c8860156.slice/crio-e547719553690140d2a8f21f5006b589efa7fb75a20b07e7eaf3a23e55dcafd8 WatchSource:0}: Error finding container e547719553690140d2a8f21f5006b589efa7fb75a20b07e7eaf3a23e55dcafd8: Status 404 returned error can't find the container with id e547719553690140d2a8f21f5006b589efa7fb75a20b07e7eaf3a23e55dcafd8 Jul 09 15:06:26.271979 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:26.271954 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" event={"ID":"e36e9c2d-0a82-4911-a2ed-dbc4c8860156","Type":"ContainerStarted","Data":"e547719553690140d2a8f21f5006b589efa7fb75a20b07e7eaf3a23e55dcafd8"} Jul 09 15:06:27.115909 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:27.115877 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:27.116365 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:27.115973 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:27.128384 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:27.128363 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:27.277852 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:27.277820 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" event={"ID":"e36e9c2d-0a82-4911-a2ed-dbc4c8860156","Type":"ContainerStarted","Data":"c5efa745426a43f0a72974f0f9218c6564d3409a9c0444f46ba1a01949dee720"} Jul 09 15:06:27.289210 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:27.289188 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lvn8f" Jul 09 15:06:27.301640 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:27.301601 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" podStartSLOduration=2.093596388 podStartE2EDuration="2.301588723s" totalImagesPullingTime="207.992335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:06:27.299910442 +0000 UTC m=+669.622359995" watchObservedRunningTime="2026-07-09 15:06:27.301588723 +0000 UTC m=+669.624038278" Jul 09 15:06:29.105601 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:29.105565 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:06:36.111171 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:36.111134 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:36.111562 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:36.111182 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:36.123871 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:36.123846 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:06:36.329520 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:06:36.329479 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79" Jul 09 15:08:22.505894 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:08:22.505860 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:08:32.407466 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:08:32.407426 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:08:44.607011 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:08:44.606932 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:08:53.313886 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:08:53.313851 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:09:04.096231 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:09:04.096198 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:09:32.109315 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:09:32.109282 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:09:46.816339 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:09:46.816306 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:10:17.602746 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:10:17.602705 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:10:18.156080 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:10:18.156053 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:10:18.156759 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:10:18.156737 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:10:26.700164 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:10:26.700128 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:10:36.598086 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:10:36.598053 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:10:44.298096 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:10:44.298059 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:10:55.010406 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:10:55.010369 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:11:07.405763 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:11:07.405726 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:11:18.398911 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:11:18.398878 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:11:28.197917 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:11:28.197884 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:11:50.103223 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:11:50.103185 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:12:01.098704 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:12:01.098670 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:12:25.709982 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:12:25.709945 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:12:39.506635 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:12:39.506603 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:12:51.111764 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:12:51.111729 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:13:03.611763 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:13:03.611731 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:13:19.608222 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:13:19.608153 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:13:29.419972 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:13:29.419935 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:15:17.911818 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:15:17.911783 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:15:18.189898 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:15:18.189821 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:15:18.191133 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:15:18.191113 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:15:27.529472 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:15:27.529441 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:15:40.204751 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:15:40.204715 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:15:52.005531 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:15:52.005481 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:16:03.307300 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:16:03.307266 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:16:12.905578 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:16:12.905482 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:16:21.898066 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:16:21.898035 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:16:33.502922 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:16:33.502890 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:16:45.510938 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:16:45.510904 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:16:54.301664 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:16:54.301629 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:17:07.913956 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:17:07.913925 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:17:26.210329 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:17:26.210294 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:17:36.109508 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:17:36.109451 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:17:45.613605 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:17:45.613523 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:17:55.799310 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:17:55.799279 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:18:13.497091 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:18:13.497053 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:18:25.946595 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:18:25.946563 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:18:35.623321 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:18:35.623275 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:18:44.110845 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:18:44.110804 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:18:53.635819 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:18:53.635783 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:19:03.614202 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:19:03.614169 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:19:17.836154 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:19:17.836055 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:19:35.013536 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:19:35.013487 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:19:47.617772 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:19:47.617733 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:20:00.032477 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:20:00.032444 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:20:08.213984 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:20:08.213950 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:20:18.218092 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:20:18.218066 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:20:18.220724 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:20:18.220694 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:20:20.913743 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:20:20.913696 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:20:34.313454 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:20:34.313418 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:20:48.010394 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:20:48.010293 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:21:03.610629 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:21:03.610595 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:21:16.503411 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:21:16.503379 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:21:28.408072 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:21:28.408031 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:21:36.104839 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:21:36.104803 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:21:48.120878 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:21:48.120842 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:23:09.407207 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:23:09.401538 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:23:18.819479 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:23:18.819448 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:23:31.196240 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:23:31.196205 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:23:41.013955 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:23:41.013874 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:24:14.100199 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:14.100160 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:24:31.913898 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:31.913863 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6"] Jul 09 15:24:31.917461 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:31.917441 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:31.920367 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:31.920348 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-eebed0bf\"/\"kube-root-ca.crt\"" Jul 09 15:24:31.921533 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:31.921511 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-eebed0bf\"/\"openshift-service-ca.crt\"" Jul 09 15:24:31.921629 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:31.921533 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-eebed0bf\"/\"e2e-lifecycle-model-eebed0bf-kserve-self-signed-certs\"" Jul 09 15:24:31.921629 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:31.921519 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-eebed0bf\"/\"default-dockercfg-g4jk7\"" Jul 09 15:24:31.926546 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:31.926480 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6"] Jul 09 15:24:32.053245 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.053216 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-dshm\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.053397 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.053260 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-home\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.053397 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.053303 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-model-cache\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.053397 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.053319 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlrmp\" (UniqueName: \"kubernetes.io/projected/54ee1cf0-b6cc-4da3-9d65-21287809b26f-kube-api-access-rlrmp\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.053397 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.053339 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tmp-dir\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.053397 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.053368 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tls-certs\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.153918 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.153886 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-model-cache\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.154046 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.153922 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlrmp\" (UniqueName: \"kubernetes.io/projected/54ee1cf0-b6cc-4da3-9d65-21287809b26f-kube-api-access-rlrmp\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.154046 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.153943 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tmp-dir\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.154046 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.154013 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tls-certs\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.154154 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.154067 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-dshm\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.154154 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.154107 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-home\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.154334 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.154315 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-model-cache\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.154405 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.154365 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-home\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.154549 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.154531 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tmp-dir\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.156557 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.156536 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-dshm\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.156659 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.156643 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tls-certs\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.162788 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.162770 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlrmp\" (UniqueName: \"kubernetes.io/projected/54ee1cf0-b6cc-4da3-9d65-21287809b26f-kube-api-access-rlrmp\") pod \"e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.227474 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.227411 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:32.365299 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:32.365250 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6"] Jul 09 15:24:32.368031 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:24:32.368001 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54ee1cf0_b6cc_4da3_9d65_21287809b26f.slice/crio-3ae2417372856fa6d259735d27f2aa2ce538f3193aae78c7cbb0827085f08e67 WatchSource:0}: Error finding container 3ae2417372856fa6d259735d27f2aa2ce538f3193aae78c7cbb0827085f08e67: Status 404 returned error can't find the container with id 3ae2417372856fa6d259735d27f2aa2ce538f3193aae78c7cbb0827085f08e67 Jul 09 15:24:33.308055 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:33.308013 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" event={"ID":"54ee1cf0-b6cc-4da3-9d65-21287809b26f","Type":"ContainerStarted","Data":"0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5"} Jul 09 15:24:33.308055 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:33.308062 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" event={"ID":"54ee1cf0-b6cc-4da3-9d65-21287809b26f","Type":"ContainerStarted","Data":"3ae2417372856fa6d259735d27f2aa2ce538f3193aae78c7cbb0827085f08e67"} Jul 09 15:24:33.327146 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:33.327096 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" podStartSLOduration=2.327080186 podStartE2EDuration="2.327080186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:24:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:24:33.326318889 +0000 UTC m=+1755.648768445" watchObservedRunningTime="2026-07-09 15:24:33.327080186 +0000 UTC m=+1755.649529740" Jul 09 15:24:35.538872 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:35.538840 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:24:42.228441 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:42.228409 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:42.228843 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:42.228468 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:42.240873 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:42.240853 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:42.359331 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:42.359302 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:24:48.439792 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:24:48.439755 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:25:02.110818 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:02.110779 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:25:02.202471 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:02.202443 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6"] Jul 09 15:25:17.223474 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.223414 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" podUID="54ee1cf0-b6cc-4da3-9d65-21287809b26f" containerName="main" containerID="cri-o://0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5" gracePeriod=45 Jul 09 15:25:17.478833 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.478773 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:25:17.517309 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.517273 2584 generic.go:356] "Generic (PLEG): container finished" podID="54ee1cf0-b6cc-4da3-9d65-21287809b26f" containerID="0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5" exitCode=0 Jul 09 15:25:17.517470 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.517322 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" event={"ID":"54ee1cf0-b6cc-4da3-9d65-21287809b26f","Type":"ContainerDied","Data":"0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5"} Jul 09 15:25:17.517470 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.517366 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" event={"ID":"54ee1cf0-b6cc-4da3-9d65-21287809b26f","Type":"ContainerDied","Data":"3ae2417372856fa6d259735d27f2aa2ce538f3193aae78c7cbb0827085f08e67"} Jul 09 15:25:17.517470 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.517388 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6" Jul 09 15:25:17.517470 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.517398 2584 scope.go:117] "RemoveContainer" containerID="0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5" Jul 09 15:25:17.526274 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.526251 2584 scope.go:117] "RemoveContainer" containerID="0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5" Jul 09 15:25:17.526573 ip-10-0-128-136 kubenswrapper[2584]: E0709 15:25:17.526547 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5\": container with ID starting with 0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5 not found: ID does not exist" containerID="0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5" Jul 09 15:25:17.526648 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.526586 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5"} err="failed to get container status \"0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5\": rpc error: code = NotFound desc = could not find container \"0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5\": container with ID starting with 0dfa395dc7f63198f32733df437b867d3e28cbe0a211d521cde7b98bc7a6c6f5 not found: ID does not exist" Jul 09 15:25:17.534867 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.534844 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-dshm\") pod \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " Jul 09 15:25:17.534970 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.534886 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-model-cache\") pod \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " Jul 09 15:25:17.535019 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.534978 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-home\") pod \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " Jul 09 15:25:17.535067 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.535028 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tmp-dir\") pod \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " Jul 09 15:25:17.535118 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.535069 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlrmp\" (UniqueName: \"kubernetes.io/projected/54ee1cf0-b6cc-4da3-9d65-21287809b26f-kube-api-access-rlrmp\") pod \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " Jul 09 15:25:17.535118 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.535103 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tls-certs\") pod \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\" (UID: \"54ee1cf0-b6cc-4da3-9d65-21287809b26f\") " Jul 09 15:25:17.535217 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.535138 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-model-cache" (OuterVolumeSpecName: "model-cache") pod "54ee1cf0-b6cc-4da3-9d65-21287809b26f" (UID: "54ee1cf0-b6cc-4da3-9d65-21287809b26f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:25:17.535275 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.535215 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-home" (OuterVolumeSpecName: "home") pod "54ee1cf0-b6cc-4da3-9d65-21287809b26f" (UID: "54ee1cf0-b6cc-4da3-9d65-21287809b26f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:25:17.535328 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.535300 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "54ee1cf0-b6cc-4da3-9d65-21287809b26f" (UID: "54ee1cf0-b6cc-4da3-9d65-21287809b26f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:25:17.535468 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.535451 2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-home\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:25:17.535599 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.535567 2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tmp-dir\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:25:17.535599 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.535588 2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-model-cache\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:25:17.537407 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.537383 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-dshm" (OuterVolumeSpecName: "dshm") pod "54ee1cf0-b6cc-4da3-9d65-21287809b26f" (UID: "54ee1cf0-b6cc-4da3-9d65-21287809b26f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:25:17.537640 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.537550 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "54ee1cf0-b6cc-4da3-9d65-21287809b26f" (UID: "54ee1cf0-b6cc-4da3-9d65-21287809b26f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:25:17.537640 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.537609 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ee1cf0-b6cc-4da3-9d65-21287809b26f-kube-api-access-rlrmp" (OuterVolumeSpecName: "kube-api-access-rlrmp") pod "54ee1cf0-b6cc-4da3-9d65-21287809b26f" (UID: "54ee1cf0-b6cc-4da3-9d65-21287809b26f"). InnerVolumeSpecName "kube-api-access-rlrmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:25:17.636860 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.636825 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlrmp\" (UniqueName: \"kubernetes.io/projected/54ee1cf0-b6cc-4da3-9d65-21287809b26f-kube-api-access-rlrmp\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:25:17.636860 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.636853 2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ee1cf0-b6cc-4da3-9d65-21287809b26f-tls-certs\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:25:17.636860 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.636865 2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ee1cf0-b6cc-4da3-9d65-21287809b26f-dshm\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:25:17.840405 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.840378 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6"] Jul 09 15:25:17.844805 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:17.844779 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-eebed0bf/e2e-lifecycle-model-eebed0bf-kserve-cb7687947-fpld6"] Jul 09 15:25:18.237293 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:18.237149 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54ee1cf0-b6cc-4da3-9d65-21287809b26f" path="/var/lib/kubelet/pods/54ee1cf0-b6cc-4da3-9d65-21287809b26f/volumes" Jul 09 15:25:18.252741 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:18.249387 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:25:18.252741 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:18.252716 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:25:41.995458 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:41.995423 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:25:55.717621 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:25:55.717589 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:26:10.506110 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:10.506078 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:26:57.821234 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.821202 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf"] Jul 09 15:26:57.821675 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.821580 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ee1cf0-b6cc-4da3-9d65-21287809b26f" containerName="main" Jul 09 15:26:57.821675 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.821593 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ee1cf0-b6cc-4da3-9d65-21287809b26f" containerName="main" Jul 09 15:26:57.821675 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.821670 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ee1cf0-b6cc-4da3-9d65-21287809b26f" containerName="main" Jul 09 15:26:57.824806 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.824781 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:57.827672 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.827651 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-da3a23-openshift-default-dockercfg-bhrzx\"" Jul 09 15:26:57.840171 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.840148 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf"] Jul 09 15:26:57.903078 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.903049 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-envoy\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:57.903221 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.903084 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-podinfo\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:57.903221 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.903196 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-token\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:57.903339 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.903240 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-socket\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:57.903339 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.903271 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-certs\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:57.903339 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.903308 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fktr\" (UniqueName: \"kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-kube-api-access-4fktr\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:57.903523 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.903346 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-data\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:57.903523 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.903369 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istiod-ca-cert\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:57.903523 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:57.903431 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-credential-socket\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004090 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004063 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-token\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004090 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004099 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-socket\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004295 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004115 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-certs\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004295 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004145 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fktr\" (UniqueName: \"kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-kube-api-access-4fktr\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004295 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004176 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-data\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004295 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004204 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istiod-ca-cert\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004295 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004247 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-credential-socket\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004594 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004316 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-envoy\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004594 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004356 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-podinfo\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004594 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004555 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-socket\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004753 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004613 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-certs\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004868 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004843 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-credential-socket\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.004973 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.004906 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-data\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.005045 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.005023 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istiod-ca-cert\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.006833 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.006812 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-envoy\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.007032 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.007016 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-podinfo\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.012977 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.012958 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-token\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.013241 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.013221 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fktr\" (UniqueName: \"kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-kube-api-access-4fktr\") pod \"e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.138359 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.138290 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:58.282518 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.282476 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf"] Jul 09 15:26:58.283617 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:26:58.283593 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb916980f_0c66_4fe4_bfd9_38caea0b90b6.slice/crio-3274959512d56f6695eedd751f4f2eded5c191950496dcce7d371c8bf9bbf461 WatchSource:0}: Error finding container 3274959512d56f6695eedd751f4f2eded5c191950496dcce7d371c8bf9bbf461: Status 404 returned error can't find the container with id 3274959512d56f6695eedd751f4f2eded5c191950496dcce7d371c8bf9bbf461 Jul 09 15:26:58.285914 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.285875 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:26:58.286020 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.285950 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:26:58.286020 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.285981 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:26:58.990706 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.990673 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" event={"ID":"b916980f-0c66-4fe4-bfd9-38caea0b90b6","Type":"ContainerStarted","Data":"a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049"} Jul 09 15:26:58.991094 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:58.990726 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" event={"ID":"b916980f-0c66-4fe4-bfd9-38caea0b90b6","Type":"ContainerStarted","Data":"3274959512d56f6695eedd751f4f2eded5c191950496dcce7d371c8bf9bbf461"} Jul 09 15:26:59.017736 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:59.017688 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" podStartSLOduration=2.017672809 podStartE2EDuration="2.017672809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:59.015694851 +0000 UTC m=+1901.338144425" watchObservedRunningTime="2026-07-09 15:26:59.017672809 +0000 UTC m=+1901.340122363" Jul 09 15:26:59.139063 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:59.139026 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:59.144591 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:59.144565 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:59.995623 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:59.995591 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:26:59.996534 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:26:59.996486 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:27:00.501933 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:00.501902 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:27:14.505868 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:14.505829 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:27:16.037695 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:16.037649 2584 patch_prober.go:28] interesting pod/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 15:27:16.038078 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:16.037724 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 15:27:17.076240 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:17.076204 2584 generic.go:356] "Generic (PLEG): container finished" podID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerID="a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049" exitCode=0 Jul 09 15:27:17.076647 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:17.076280 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" event={"ID":"b916980f-0c66-4fe4-bfd9-38caea0b90b6","Type":"ContainerDied","Data":"a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049"} Jul 09 15:27:17.076702 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:17.076688 2584 scope.go:117] "RemoveContainer" containerID="a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049" Jul 09 15:27:17.077684 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:17.077656 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:27:17.077745 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:17.077722 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:27:17.077780 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:17.077752 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:27:18.082897 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:18.082864 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" event={"ID":"b916980f-0c66-4fe4-bfd9-38caea0b90b6","Type":"ContainerStarted","Data":"f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd"} Jul 09 15:27:18.139457 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:18.139421 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:27:18.139665 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:18.139641 2584 patch_prober.go:28] interesting pod/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 09 15:27:18.139712 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:18.139693 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 09 15:27:19.138881 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:19.138851 2584 patch_prober.go:28] interesting pod/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 09 15:27:19.139261 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:19.138902 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 09 15:27:20.139212 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:20.139178 2584 patch_prober.go:28] interesting pod/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 09 15:27:20.139587 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:20.139243 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 09 15:27:21.139176 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:21.139139 2584 patch_prober.go:28] interesting pod/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 09 15:27:21.139350 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:21.139198 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 09 15:27:22.142936 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:22.142899 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:27:22.143306 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:22.143174 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:27:22.143920 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:22.143904 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:27:25.404541 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.404509 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv"] Jul 09 15:27:25.407366 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.407345 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.410748 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.410726 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-476308\"/\"default-dockercfg-bkr6v\"" Jul 09 15:27:25.410875 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.410774 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-476308\"/\"kube-root-ca.crt\"" Jul 09 15:27:25.411748 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.411726 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-476308\"/\"test-model-476308-kserve-self-signed-certs\"" Jul 09 15:27:25.411854 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.411766 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-476308\"/\"openshift-service-ca.crt\"" Jul 09 15:27:25.420433 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.420413 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv"] Jul 09 15:27:25.475726 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.475701 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-model-cache\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.475825 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.475756 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-home\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.475825 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.475810 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-dshm\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.475894 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.475836 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tmp-dir\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.475894 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.475871 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rjfn\" (UniqueName: \"kubernetes.io/projected/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-kube-api-access-7rjfn\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.475956 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.475896 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tls-certs\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.576442 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.576409 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rjfn\" (UniqueName: \"kubernetes.io/projected/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-kube-api-access-7rjfn\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.576442 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.576447 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tls-certs\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.576680 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.576646 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-model-cache\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.576749 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.576734 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-home\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.576824 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.576801 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-dshm\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.576876 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.576858 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tmp-dir\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.577042 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.577019 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-model-cache\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.577118 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.577051 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-home\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.577278 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.577176 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tmp-dir\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.579117 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.579095 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-dshm\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.579220 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.579192 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tls-certs\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.586833 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.586813 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rjfn\" (UniqueName: \"kubernetes.io/projected/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-kube-api-access-7rjfn\") pod \"test-model-476308-kserve-78d4687969-5wlnv\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.717795 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.717711 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:25.851989 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:25.851969 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv"] Jul 09 15:27:25.854087 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:27:25.854061 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode85d4a62_d31e_4b8c_bd96_7b60e92cd5ba.slice/crio-106f2b125ec4a0a5455dd11679fbb5aec67e0b4a012c97ba62813b813be0bbb8 WatchSource:0}: Error finding container 106f2b125ec4a0a5455dd11679fbb5aec67e0b4a012c97ba62813b813be0bbb8: Status 404 returned error can't find the container with id 106f2b125ec4a0a5455dd11679fbb5aec67e0b4a012c97ba62813b813be0bbb8 Jul 09 15:27:26.126309 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:26.126273 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" event={"ID":"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba","Type":"ContainerStarted","Data":"ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53"} Jul 09 15:27:26.126309 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:26.126313 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" event={"ID":"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba","Type":"ContainerStarted","Data":"106f2b125ec4a0a5455dd11679fbb5aec67e0b4a012c97ba62813b813be0bbb8"} Jul 09 15:27:26.148549 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:26.148486 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" podStartSLOduration=1.14847265 podStartE2EDuration="1.14847265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:26.147199913 +0000 UTC m=+1928.469649467" watchObservedRunningTime="2026-07-09 15:27:26.14847265 +0000 UTC m=+1928.470922254" Jul 09 15:27:30.405180 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:30.405146 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:27:35.718002 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:35.717968 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:35.718384 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:35.718230 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:35.730783 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:35.730755 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:36.183026 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:36.182999 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:27:57.504761 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:27:57.504731 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:28:14.586981 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:14.586906 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv"] Jul 09 15:28:22.104535 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:22.104487 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:28:29.607319 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.607280 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" podUID="e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" containerName="main" containerID="cri-o://ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53" gracePeriod=45 Jul 09 15:28:29.852201 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.852181 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:28:29.950621 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.950549 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-dshm\") pod \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " Jul 09 15:28:29.950621 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.950600 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tmp-dir\") pod \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " Jul 09 15:28:29.950621 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.950621 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tls-certs\") pod \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " Jul 09 15:28:29.950887 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.950642 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-model-cache\") pod \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " Jul 09 15:28:29.950887 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.950660 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rjfn\" (UniqueName: \"kubernetes.io/projected/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-kube-api-access-7rjfn\") pod \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " Jul 09 15:28:29.950887 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.950683 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-home\") pod \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\" (UID: \"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba\") " Jul 09 15:28:29.950887 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.950815 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" (UID: "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:28:29.951070 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.950913 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-model-cache" (OuterVolumeSpecName: "model-cache") pod "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" (UID: "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:28:29.951070 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.950941 2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tmp-dir\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:28:29.951070 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.951034 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-home" (OuterVolumeSpecName: "home") pod "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" (UID: "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:28:29.952956 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.952937 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-dshm" (OuterVolumeSpecName: "dshm") pod "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" (UID: "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:28:29.953026 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.952961 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-kube-api-access-7rjfn" (OuterVolumeSpecName: "kube-api-access-7rjfn") pod "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" (UID: "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba"). InnerVolumeSpecName "kube-api-access-7rjfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:28:29.953062 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:29.953041 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" (UID: "e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:28:30.052053 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.052025 2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-dshm\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:28:30.052053 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.052049 2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-tls-certs\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:28:30.052053 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.052060 2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-model-cache\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:28:30.052267 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.052078 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rjfn\" (UniqueName: \"kubernetes.io/projected/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-kube-api-access-7rjfn\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:28:30.052267 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.052087 2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba-home\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:28:30.421749 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.421710 2584 generic.go:356] "Generic (PLEG): container finished" podID="e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" containerID="ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53" exitCode=0 Jul 09 15:28:30.421911 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.421756 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" Jul 09 15:28:30.421911 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.421792 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" event={"ID":"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba","Type":"ContainerDied","Data":"ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53"} Jul 09 15:28:30.421911 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.421837 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv" event={"ID":"e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba","Type":"ContainerDied","Data":"106f2b125ec4a0a5455dd11679fbb5aec67e0b4a012c97ba62813b813be0bbb8"} Jul 09 15:28:30.421911 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.421857 2584 scope.go:117] "RemoveContainer" containerID="ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53" Jul 09 15:28:30.430620 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.430569 2584 scope.go:117] "RemoveContainer" containerID="ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53" Jul 09 15:28:30.430847 ip-10-0-128-136 kubenswrapper[2584]: E0709 15:28:30.430829 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53\": container with ID starting with ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53 not found: ID does not exist" containerID="ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53" Jul 09 15:28:30.430892 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.430855 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53"} err="failed to get container status \"ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53\": rpc error: code = NotFound desc = could not find container \"ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53\": container with ID starting with ba188f88eb63b9aed7e074a8041f78f937ce6a14d2c673db4366a0f75eeada53 not found: ID does not exist" Jul 09 15:28:30.439325 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.439301 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv"] Jul 09 15:28:30.445203 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:30.445185 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-476308/test-model-476308-kserve-78d4687969-5wlnv"] Jul 09 15:28:32.234882 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:28:32.234841 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" path="/var/lib/kubelet/pods/e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba/volumes" Jul 09 15:29:03.606725 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:03.606692 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:29:06.149873 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:06.149843 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf"] Jul 09 15:29:06.150240 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:06.150066 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" containerID="cri-o://f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd" gracePeriod=30 Jul 09 15:29:07.145820 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:07.145780 2584 patch_prober.go:28] interesting pod/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 15:29:07.145995 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:07.145853 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:29:11.416537 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.416457 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:29:11.523971 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.523933 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istiod-ca-cert\") pod \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " Jul 09 15:29:11.523971 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.523978 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-envoy\") pod \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " Jul 09 15:29:11.524223 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.523995 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fktr\" (UniqueName: \"kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-kube-api-access-4fktr\") pod \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " Jul 09 15:29:11.524223 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.524014 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-data\") pod \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " Jul 09 15:29:11.524223 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.524150 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-socket\") pod \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " Jul 09 15:29:11.524377 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.524223 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-podinfo\") pod \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " Jul 09 15:29:11.524377 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.524292 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-certs\") pod \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " Jul 09 15:29:11.524377 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.524358 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-credential-socket\") pod \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " Jul 09 15:29:11.524545 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.524388 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-token\") pod \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\" (UID: \"b916980f-0c66-4fe4-bfd9-38caea0b90b6\") " Jul 09 15:29:11.524545 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.524449 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b916980f-0c66-4fe4-bfd9-38caea0b90b6" (UID: "b916980f-0c66-4fe4-bfd9-38caea0b90b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:29:11.524664 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.524608 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b916980f-0c66-4fe4-bfd9-38caea0b90b6" (UID: "b916980f-0c66-4fe4-bfd9-38caea0b90b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:29:11.524664 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.524628 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b916980f-0c66-4fe4-bfd9-38caea0b90b6" (UID: "b916980f-0c66-4fe4-bfd9-38caea0b90b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:29:11.524995 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.524970 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b916980f-0c66-4fe4-bfd9-38caea0b90b6" (UID: "b916980f-0c66-4fe4-bfd9-38caea0b90b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:29:11.524995 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.524975 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "b916980f-0c66-4fe4-bfd9-38caea0b90b6" (UID: "b916980f-0c66-4fe4-bfd9-38caea0b90b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:29:11.525318 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.525035 2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-socket\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:11.525318 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.525053 2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-workload-certs\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:11.525318 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.525067 2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istiod-ca-cert\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:11.526645 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.526619 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b916980f-0c66-4fe4-bfd9-38caea0b90b6" (UID: "b916980f-0c66-4fe4-bfd9-38caea0b90b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:29:11.526645 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.526617 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b916980f-0c66-4fe4-bfd9-38caea0b90b6" (UID: "b916980f-0c66-4fe4-bfd9-38caea0b90b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:29:11.526776 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.526665 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "b916980f-0c66-4fe4-bfd9-38caea0b90b6" (UID: "b916980f-0c66-4fe4-bfd9-38caea0b90b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:29:11.526776 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.526732 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-kube-api-access-4fktr" (OuterVolumeSpecName: "kube-api-access-4fktr") pod "b916980f-0c66-4fe4-bfd9-38caea0b90b6" (UID: "b916980f-0c66-4fe4-bfd9-38caea0b90b6"). InnerVolumeSpecName "kube-api-access-4fktr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:29:11.617623 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.617594 2584 generic.go:356] "Generic (PLEG): container finished" podID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerID="f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd" exitCode=0 Jul 09 15:29:11.617750 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.617641 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" Jul 09 15:29:11.617750 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.617667 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" event={"ID":"b916980f-0c66-4fe4-bfd9-38caea0b90b6","Type":"ContainerDied","Data":"f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd"} Jul 09 15:29:11.617750 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.617709 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf" event={"ID":"b916980f-0c66-4fe4-bfd9-38caea0b90b6","Type":"ContainerDied","Data":"3274959512d56f6695eedd751f4f2eded5c191950496dcce7d371c8bf9bbf461"} Jul 09 15:29:11.617750 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.617732 2584 scope.go:117] "RemoveContainer" containerID="f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd" Jul 09 15:29:11.625641 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.625621 2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-podinfo\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:11.625641 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.625640 2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-credential-socket\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:11.625808 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.625650 2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-token\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:11.625808 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.625659 2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-envoy\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:11.625808 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.625666 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fktr\" (UniqueName: \"kubernetes.io/projected/b916980f-0c66-4fe4-bfd9-38caea0b90b6-kube-api-access-4fktr\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:11.625808 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.625674 2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b916980f-0c66-4fe4-bfd9-38caea0b90b6-istio-data\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:11.626854 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.626838 2584 scope.go:117] "RemoveContainer" containerID="a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049" Jul 09 15:29:11.634798 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.634782 2584 scope.go:117] "RemoveContainer" containerID="f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd" Jul 09 15:29:11.635039 ip-10-0-128-136 kubenswrapper[2584]: E0709 15:29:11.635023 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd\": container with ID starting with f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd not found: ID does not exist" containerID="f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd" Jul 09 15:29:11.635086 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.635047 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd"} err="failed to get container status \"f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd\": rpc error: code = NotFound desc = could not find container \"f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd\": container with ID starting with f9b9b8142c65de04da76edd7dba9988b3412f9ef7d5e8833ff613ec8309e3ddd not found: ID does not exist" Jul 09 15:29:11.635086 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.635062 2584 scope.go:117] "RemoveContainer" containerID="a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049" Jul 09 15:29:11.635276 ip-10-0-128-136 kubenswrapper[2584]: E0709 15:29:11.635260 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049\": container with ID starting with a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049 not found: ID does not exist" containerID="a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049" Jul 09 15:29:11.635315 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.635280 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049"} err="failed to get container status \"a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049\": rpc error: code = NotFound desc = could not find container \"a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049\": container with ID starting with a343e0eaf2b2d86b1cb8018ebca2d5127291ee0161a52b264bdf761d5c99c049 not found: ID does not exist" Jul 09 15:29:11.643401 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.643376 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf"] Jul 09 15:29:11.649649 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:11.649630 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-da3a23-openshift-default-57d698c44c-nnlsf"] Jul 09 15:29:12.234986 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:12.234953 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" path="/var/lib/kubelet/pods/b916980f-0c66-4fe4-bfd9-38caea0b90b6/volumes" Jul 09 15:29:15.449632 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.449598 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv"] Jul 09 15:29:15.450125 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.450109 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" containerName="main" Jul 09 15:29:15.450171 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.450128 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" containerName="main" Jul 09 15:29:15.450171 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.450158 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" Jul 09 15:29:15.450171 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.450167 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" Jul 09 15:29:15.450269 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.450179 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" Jul 09 15:29:15.450269 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.450187 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" Jul 09 15:29:15.450335 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.450274 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" Jul 09 15:29:15.450335 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.450287 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e85d4a62-d31e-4b8c-bd96-7b60e92cd5ba" containerName="main" Jul 09 15:29:15.450335 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.450297 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b916980f-0c66-4fe4-bfd9-38caea0b90b6" containerName="istio-proxy" Jul 09 15:29:15.455168 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.455149 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.457957 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.457937 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e415c5-openshift-default-dockercfg-7657p\"" Jul 09 15:29:15.467173 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.467153 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv"] Jul 09 15:29:15.559715 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.559680 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-certs\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.559715 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.559720 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-socket\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.559949 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.559738 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-data\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.559949 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.559856 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-podinfo\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.559949 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.559906 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-token\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.560114 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.559961 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istiod-ca-cert\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.560114 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.559990 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-envoy\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.560114 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.560081 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8mcl\" (UniqueName: \"kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-kube-api-access-q8mcl\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.560269 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.560123 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-credential-socket\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.661477 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.661438 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istiod-ca-cert\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.661665 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.661487 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-envoy\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.661665 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.661556 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8mcl\" (UniqueName: \"kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-kube-api-access-q8mcl\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.661665 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.661584 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-credential-socket\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.661665 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.661639 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-certs\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.661875 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.661669 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-socket\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.661875 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.661693 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-data\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.661875 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.661746 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-podinfo\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.661875 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.661781 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-token\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.662185 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.662131 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-data\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.662332 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.662183 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-socket\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.662332 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.662300 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istiod-ca-cert\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.662437 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.662327 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-certs\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.662437 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.662347 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-credential-socket\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.664350 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.664332 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-podinfo\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.664441 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.664382 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-envoy\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.670062 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.670035 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-token\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.670235 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.670217 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8mcl\" (UniqueName: \"kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-kube-api-access-q8mcl\") pod \"e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.767029 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.766996 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:15.914678 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.914648 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv"] Jul 09 15:29:15.915354 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:29:15.915328 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144dc5fc_cb9b_4e9a_898b_832b5454db5a.slice/crio-afcbecce2b2a89fb948824be02091dd9c09f6224e5432e488266285760b18552 WatchSource:0}: Error finding container afcbecce2b2a89fb948824be02091dd9c09f6224e5432e488266285760b18552: Status 404 returned error can't find the container with id afcbecce2b2a89fb948824be02091dd9c09f6224e5432e488266285760b18552 Jul 09 15:29:15.917680 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.917636 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:29:15.917771 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.917715 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:29:15.917771 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:15.917757 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:29:16.644782 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:16.644743 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" event={"ID":"144dc5fc-cb9b-4e9a-898b-832b5454db5a","Type":"ContainerStarted","Data":"0d715b46a052d61da3601f3bb5fd0c402f72061824e7333d50bd8fab12ac66e5"} Jul 09 15:29:16.645369 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:16.644806 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" event={"ID":"144dc5fc-cb9b-4e9a-898b-832b5454db5a","Type":"ContainerStarted","Data":"afcbecce2b2a89fb948824be02091dd9c09f6224e5432e488266285760b18552"} Jul 09 15:29:16.680456 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:16.680406 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" podStartSLOduration=1.68038659 podStartE2EDuration="1.68038659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:29:16.680260987 +0000 UTC m=+2039.002710562" watchObservedRunningTime="2026-07-09 15:29:16.68038659 +0000 UTC m=+2039.002836137" Jul 09 15:29:16.767921 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:16.767888 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:16.773188 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:16.773165 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:17.650278 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:17.650246 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:17.651173 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:17.651150 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:18.398256 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:18.398219 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:29:35.403837 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:35.403803 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:29:36.752594 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:36.752556 2584 generic.go:356] "Generic (PLEG): container finished" podID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerID="0d715b46a052d61da3601f3bb5fd0c402f72061824e7333d50bd8fab12ac66e5" exitCode=0 Jul 09 15:29:36.753013 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:36.752622 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" event={"ID":"144dc5fc-cb9b-4e9a-898b-832b5454db5a","Type":"ContainerDied","Data":"0d715b46a052d61da3601f3bb5fd0c402f72061824e7333d50bd8fab12ac66e5"} Jul 09 15:29:36.753096 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:36.753078 2584 scope.go:117] "RemoveContainer" containerID="0d715b46a052d61da3601f3bb5fd0c402f72061824e7333d50bd8fab12ac66e5" Jul 09 15:29:36.754084 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:36.754056 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:29:36.754144 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:36.754125 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:29:36.754179 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:36.754156 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:29:37.759264 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:37.759231 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" event={"ID":"144dc5fc-cb9b-4e9a-898b-832b5454db5a","Type":"ContainerStarted","Data":"6ad5f071158b2457b3bf2697f297985ed16209669cae3af9b39085ca4d718f38"} Jul 09 15:29:37.767571 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:37.767553 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:37.767756 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:37.767737 2584 patch_prober.go:28] interesting pod/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 09 15:29:37.767798 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:37.767778 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 09 15:29:38.767846 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:38.767772 2584 patch_prober.go:28] interesting pod/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 09 15:29:38.767846 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:38.767820 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 09 15:29:39.773414 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:39.773373 2584 patch_prober.go:28] interesting pod/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 09 15:29:39.773844 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:39.773458 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 09 15:29:40.767366 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:40.767332 2584 patch_prober.go:28] interesting pod/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 09 15:29:40.767560 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:40.767384 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 09 15:29:41.770701 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:41.770673 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:41.771067 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:41.771051 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:41.771853 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:41.771830 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:45.659593 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:45.659564 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv"] Jul 09 15:29:45.660021 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:45.659742 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerName="istio-proxy" containerID="cri-o://6ad5f071158b2457b3bf2697f297985ed16209669cae3af9b39085ca4d718f38" gracePeriod=30 Jul 09 15:29:48.909028 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:48.908991 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:29:50.824592 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.824328 2584 generic.go:356] "Generic (PLEG): container finished" podID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerID="6ad5f071158b2457b3bf2697f297985ed16209669cae3af9b39085ca4d718f38" exitCode=0 Jul 09 15:29:50.824592 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.824402 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" event={"ID":"144dc5fc-cb9b-4e9a-898b-832b5454db5a","Type":"ContainerDied","Data":"6ad5f071158b2457b3bf2697f297985ed16209669cae3af9b39085ca4d718f38"} Jul 09 15:29:50.824592 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.824473 2584 scope.go:117] "RemoveContainer" containerID="0d715b46a052d61da3601f3bb5fd0c402f72061824e7333d50bd8fab12ac66e5" Jul 09 15:29:50.905819 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.905798 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:50.981932 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.981857 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-token\") pod \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " Jul 09 15:29:50.981932 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.981890 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-podinfo\") pod \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " Jul 09 15:29:50.981932 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.981906 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istiod-ca-cert\") pod \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " Jul 09 15:29:50.982190 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.981942 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-data\") pod \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " Jul 09 15:29:50.982190 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982053 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-socket\") pod \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " Jul 09 15:29:50.982190 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982091 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-envoy\") pod \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " Jul 09 15:29:50.982190 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982151 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-certs\") pod \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " Jul 09 15:29:50.982190 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982174 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-credential-socket\") pod \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " Jul 09 15:29:50.982473 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982229 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8mcl\" (UniqueName: \"kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-kube-api-access-q8mcl\") pod \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\" (UID: \"144dc5fc-cb9b-4e9a-898b-832b5454db5a\") " Jul 09 15:29:50.982473 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982345 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "144dc5fc-cb9b-4e9a-898b-832b5454db5a" (UID: "144dc5fc-cb9b-4e9a-898b-832b5454db5a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:29:50.982473 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982359 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "144dc5fc-cb9b-4e9a-898b-832b5454db5a" (UID: "144dc5fc-cb9b-4e9a-898b-832b5454db5a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:29:50.982660 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982468 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "144dc5fc-cb9b-4e9a-898b-832b5454db5a" (UID: "144dc5fc-cb9b-4e9a-898b-832b5454db5a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:29:50.982713 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982668 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "144dc5fc-cb9b-4e9a-898b-832b5454db5a" (UID: "144dc5fc-cb9b-4e9a-898b-832b5454db5a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:29:50.982713 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982674 2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-socket\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:50.982713 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982709 2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-workload-certs\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:50.982877 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982727 2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istiod-ca-cert\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:50.982877 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.982855 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-data" (OuterVolumeSpecName: "istio-data") pod "144dc5fc-cb9b-4e9a-898b-832b5454db5a" (UID: "144dc5fc-cb9b-4e9a-898b-832b5454db5a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:29:50.984324 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.984289 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "144dc5fc-cb9b-4e9a-898b-832b5454db5a" (UID: "144dc5fc-cb9b-4e9a-898b-832b5454db5a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:29:50.984470 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.984444 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "144dc5fc-cb9b-4e9a-898b-832b5454db5a" (UID: "144dc5fc-cb9b-4e9a-898b-832b5454db5a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:29:50.984470 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.984458 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-kube-api-access-q8mcl" (OuterVolumeSpecName: "kube-api-access-q8mcl") pod "144dc5fc-cb9b-4e9a-898b-832b5454db5a" (UID: "144dc5fc-cb9b-4e9a-898b-832b5454db5a"). InnerVolumeSpecName "kube-api-access-q8mcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:29:50.984714 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:50.984692 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-token" (OuterVolumeSpecName: "istio-token") pod "144dc5fc-cb9b-4e9a-898b-832b5454db5a" (UID: "144dc5fc-cb9b-4e9a-898b-832b5454db5a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:29:51.083626 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:51.083599 2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-token\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:51.083626 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:51.083620 2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-podinfo\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:51.083753 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:51.083630 2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-data\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:51.083753 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:51.083647 2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-istio-envoy\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:51.083753 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:51.083656 2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144dc5fc-cb9b-4e9a-898b-832b5454db5a-credential-socket\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:51.083753 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:51.083665 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8mcl\" (UniqueName: \"kubernetes.io/projected/144dc5fc-cb9b-4e9a-898b-832b5454db5a-kube-api-access-q8mcl\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:29:51.829899 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:51.829874 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" Jul 09 15:29:51.830318 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:51.829866 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv" event={"ID":"144dc5fc-cb9b-4e9a-898b-832b5454db5a","Type":"ContainerDied","Data":"afcbecce2b2a89fb948824be02091dd9c09f6224e5432e488266285760b18552"} Jul 09 15:29:51.830318 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:51.830007 2584 scope.go:117] "RemoveContainer" containerID="6ad5f071158b2457b3bf2697f297985ed16209669cae3af9b39085ca4d718f38" Jul 09 15:29:51.858737 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:51.853334 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv"] Jul 09 15:29:51.860226 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:51.860204 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e415c5-openshift-default-6c6798c759-2qttv"] Jul 09 15:29:52.234513 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:52.234421 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" path="/var/lib/kubelet/pods/144dc5fc-cb9b-4e9a-898b-832b5454db5a/volumes" Jul 09 15:29:54.538560 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.538529 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh"] Jul 09 15:29:54.538931 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.538916 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerName="istio-proxy" Jul 09 15:29:54.538974 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.538933 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerName="istio-proxy" Jul 09 15:29:54.538974 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.538944 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerName="istio-proxy" Jul 09 15:29:54.538974 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.538950 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerName="istio-proxy" Jul 09 15:29:54.539065 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.539014 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerName="istio-proxy" Jul 09 15:29:54.539065 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.539023 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="144dc5fc-cb9b-4e9a-898b-832b5454db5a" containerName="istio-proxy" Jul 09 15:29:54.542178 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.542158 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.545295 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.545275 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-19ef0f-openshift-default-dockercfg-9bb82\"" Jul 09 15:29:54.556616 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.556592 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh"] Jul 09 15:29:54.713379 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.713350 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istiod-ca-cert\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.713565 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.713385 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-credential-socket\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.713565 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.713409 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-socket\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.713565 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.713546 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-data\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.713690 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.713582 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-podinfo\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.713690 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.713651 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-certs\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.713762 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.713693 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-token\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.713805 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.713790 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-envoy\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.713883 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.713818 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ctdf\" (UniqueName: \"kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-kube-api-access-7ctdf\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.814968 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.814875 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-envoy\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.814968 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.814913 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ctdf\" (UniqueName: \"kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-kube-api-access-7ctdf\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.815196 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.814972 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istiod-ca-cert\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.815196 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.814998 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-credential-socket\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.815196 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.815114 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-socket\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.815196 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.815183 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-data\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.815396 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.815206 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-podinfo\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.815396 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.815326 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-certs\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.815530 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.815400 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-token\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.815597 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.815526 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-socket\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.815597 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.815545 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-credential-socket\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.815684 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.815606 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-data\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.815791 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.815766 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-certs\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.816024 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.816002 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istiod-ca-cert\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.817439 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.817412 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-envoy\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.818034 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.817999 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-podinfo\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.825086 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.825058 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-token\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.825944 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.825921 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ctdf\" (UniqueName: \"kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-kube-api-access-7ctdf\") pod \"e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.852819 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.852792 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:54.989856 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.989837 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh"] Jul 09 15:29:54.992151 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:29:54.992118 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7ab5f5_dd20_478c_89c1_870147cd8bf6.slice/crio-ff8b18a14eb5684941718898ef9229e5d2c2789e1d2305353d7233b65a1aa63b WatchSource:0}: Error finding container ff8b18a14eb5684941718898ef9229e5d2c2789e1d2305353d7233b65a1aa63b: Status 404 returned error can't find the container with id ff8b18a14eb5684941718898ef9229e5d2c2789e1d2305353d7233b65a1aa63b Jul 09 15:29:54.994308 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.994272 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:29:54.994407 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.994338 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:29:54.994407 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:54.994366 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:29:55.851776 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:55.851741 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" event={"ID":"3d7ab5f5-dd20-478c-89c1-870147cd8bf6","Type":"ContainerStarted","Data":"d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90"} Jul 09 15:29:55.852156 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:55.851792 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" event={"ID":"3d7ab5f5-dd20-478c-89c1-870147cd8bf6","Type":"ContainerStarted","Data":"ff8b18a14eb5684941718898ef9229e5d2c2789e1d2305353d7233b65a1aa63b"} Jul 09 15:29:55.853027 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:55.853006 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:55.875296 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:55.875253 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" podStartSLOduration=1.8752389969999999 podStartE2EDuration="1.875238997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:29:55.874627982 +0000 UTC m=+2078.197077560" watchObservedRunningTime="2026-07-09 15:29:55.875238997 +0000 UTC m=+2078.197688617" Jul 09 15:29:56.858260 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:56.858233 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:57.861958 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:57.861928 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:29:57.862864 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:29:57.862844 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:30:01.706890 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:01.706858 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:30:10.941129 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:10.941090 2584 generic.go:356] "Generic (PLEG): container finished" podID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" containerID="d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90" exitCode=0 Jul 09 15:30:10.941587 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:10.941162 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" event={"ID":"3d7ab5f5-dd20-478c-89c1-870147cd8bf6","Type":"ContainerDied","Data":"d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90"} Jul 09 15:30:10.941587 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:10.941571 2584 scope.go:117] "RemoveContainer" containerID="d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90" Jul 09 15:30:10.942632 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:10.942601 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:30:10.942737 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:10.942671 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:30:10.942737 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:10.942707 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 15:30:11.947919 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:11.947884 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" event={"ID":"3d7ab5f5-dd20-478c-89c1-870147cd8bf6","Type":"ContainerStarted","Data":"b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561"} Jul 09 15:30:12.853713 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:12.853661 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:30:12.855036 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:12.854999 2584 patch_prober.go:28] interesting pod/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 09 15:30:12.855206 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:12.855067 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" podUID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 09 15:30:12.861931 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:12.861907 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:30:13.853913 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:13.853871 2584 patch_prober.go:28] interesting pod/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 09 15:30:13.854371 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:13.853942 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" podUID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 09 15:30:14.854037 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:14.854002 2584 patch_prober.go:28] interesting pod/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 09 15:30:14.854410 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:14.854058 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" podUID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 09 15:30:15.853851 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:15.853814 2584 patch_prober.go:28] interesting pod/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 09 15:30:15.854026 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:15.853866 2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" podUID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 09 15:30:16.857898 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:16.857869 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:30:16.858775 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:16.858754 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:30:18.277652 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:18.277626 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:30:18.282791 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:30:18.282769 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5lwz_15b270e9-b495-4155-94bf-e52af210f574/ovn-acl-logging/0.log" Jul 09 15:33:11.419113 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:11.419081 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:33:21.948939 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:21.948902 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh"] Jul 09 15:33:21.949369 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:21.949092 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" podUID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" containerName="istio-proxy" containerID="cri-o://b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561" gracePeriod=30 Jul 09 15:33:24.009069 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:24.009037 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7sqtx"] Jul 09 15:33:27.206488 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.206465 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:33:27.385725 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.385688 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-token\") pod \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " Jul 09 15:33:27.385914 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.385747 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istiod-ca-cert\") pod \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " Jul 09 15:33:27.385914 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.385772 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-credential-socket\") pod \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " Jul 09 15:33:27.385914 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.385795 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ctdf\" (UniqueName: \"kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-kube-api-access-7ctdf\") pod \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " Jul 09 15:33:27.385914 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.385845 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-certs\") pod \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " Jul 09 15:33:27.385914 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.385885 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-data\") pod \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " Jul 09 15:33:27.386572 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.385927 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-podinfo\") pod \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " Jul 09 15:33:27.386572 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.385984 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-socket\") pod \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " Jul 09 15:33:27.386572 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.386010 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-envoy\") pod \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\" (UID: \"3d7ab5f5-dd20-478c-89c1-870147cd8bf6\") " Jul 09 15:33:27.386572 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.386120 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d7ab5f5-dd20-478c-89c1-870147cd8bf6" (UID: "3d7ab5f5-dd20-478c-89c1-870147cd8bf6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:33:27.386572 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.386165 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d7ab5f5-dd20-478c-89c1-870147cd8bf6" (UID: "3d7ab5f5-dd20-478c-89c1-870147cd8bf6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:33:27.386572 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.386193 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d7ab5f5-dd20-478c-89c1-870147cd8bf6" (UID: "3d7ab5f5-dd20-478c-89c1-870147cd8bf6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:33:27.386572 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.386319 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d7ab5f5-dd20-478c-89c1-870147cd8bf6" (UID: "3d7ab5f5-dd20-478c-89c1-870147cd8bf6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:33:27.386572 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.386384 2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-certs\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:33:27.386572 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.386399 2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istiod-ca-cert\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:33:27.386572 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.386409 2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-credential-socket\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:33:27.387230 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.387200 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d7ab5f5-dd20-478c-89c1-870147cd8bf6" (UID: "3d7ab5f5-dd20-478c-89c1-870147cd8bf6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:33:27.388329 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.388302 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d7ab5f5-dd20-478c-89c1-870147cd8bf6" (UID: "3d7ab5f5-dd20-478c-89c1-870147cd8bf6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:33:27.388427 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.388374 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-kube-api-access-7ctdf" (OuterVolumeSpecName: "kube-api-access-7ctdf") pod "3d7ab5f5-dd20-478c-89c1-870147cd8bf6" (UID: "3d7ab5f5-dd20-478c-89c1-870147cd8bf6"). InnerVolumeSpecName "kube-api-access-7ctdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:33:27.388427 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.388389 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d7ab5f5-dd20-478c-89c1-870147cd8bf6" (UID: "3d7ab5f5-dd20-478c-89c1-870147cd8bf6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:33:27.388427 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.388399 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d7ab5f5-dd20-478c-89c1-870147cd8bf6" (UID: "3d7ab5f5-dd20-478c-89c1-870147cd8bf6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:33:27.487442 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.487416 2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-token\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:33:27.487442 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.487438 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ctdf\" (UniqueName: \"kubernetes.io/projected/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-kube-api-access-7ctdf\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:33:27.487442 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.487447 2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-data\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:33:27.487656 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.487456 2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-podinfo\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:33:27.487656 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.487464 2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-workload-socket\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:33:27.487656 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.487473 2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d7ab5f5-dd20-478c-89c1-870147cd8bf6-istio-envoy\") on node \"ip-10-0-128-136.ec2.internal\" DevicePath \"\"" Jul 09 15:33:27.875358 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.875323 2584 generic.go:356] "Generic (PLEG): container finished" podID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" containerID="b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561" exitCode=0 Jul 09 15:33:27.875529 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.875373 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" Jul 09 15:33:27.875529 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.875401 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" event={"ID":"3d7ab5f5-dd20-478c-89c1-870147cd8bf6","Type":"ContainerDied","Data":"b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561"} Jul 09 15:33:27.875529 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.875446 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh" event={"ID":"3d7ab5f5-dd20-478c-89c1-870147cd8bf6","Type":"ContainerDied","Data":"ff8b18a14eb5684941718898ef9229e5d2c2789e1d2305353d7233b65a1aa63b"} Jul 09 15:33:27.875529 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.875469 2584 scope.go:117] "RemoveContainer" containerID="b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561" Jul 09 15:33:27.885000 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.884984 2584 scope.go:117] "RemoveContainer" containerID="d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90" Jul 09 15:33:27.893326 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.893308 2584 scope.go:117] "RemoveContainer" containerID="b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561" Jul 09 15:33:27.893666 ip-10-0-128-136 kubenswrapper[2584]: E0709 15:33:27.893648 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561\": container with ID starting with b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561 not found: ID does not exist" containerID="b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561" Jul 09 15:33:27.893722 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.893674 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561"} err="failed to get container status \"b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561\": rpc error: code = NotFound desc = could not find container \"b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561\": container with ID starting with b3b9b75eb90fef4a693e2ef9ffec00d22581c94b5ecdee47b650eef687edf561 not found: ID does not exist" Jul 09 15:33:27.893722 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.893691 2584 scope.go:117] "RemoveContainer" containerID="d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90" Jul 09 15:33:27.893917 ip-10-0-128-136 kubenswrapper[2584]: E0709 15:33:27.893900 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90\": container with ID starting with d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90 not found: ID does not exist" containerID="d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90" Jul 09 15:33:27.893958 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.893923 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90"} err="failed to get container status \"d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90\": rpc error: code = NotFound desc = could not find container \"d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90\": container with ID starting with d377405ba50dcf158aee3540af9949fb8dc01b6e23faa0784af4ecbc3338bd90 not found: ID does not exist" Jul 09 15:33:27.899065 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.899046 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh"] Jul 09 15:33:27.903990 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:27.903970 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-19ef0f-openshift-default-766654cf6c-6sbdh"] Jul 09 15:33:28.207436 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:28.207364 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7_d61a88cd-5fd0-4005-a7f2-fe344099fe9f/copy-manifests/0.log" Jul 09 15:33:28.215118 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:28.215096 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7_d61a88cd-5fd0-4005-a7f2-fe344099fe9f/manager/0.log" Jul 09 15:33:28.235132 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:28.235111 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" path="/var/lib/kubelet/pods/3d7ab5f5-dd20-478c-89c1-870147cd8bf6/volumes" Jul 09 15:33:30.628146 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:30.628111 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7sqtx_e4e9505f-ede2-4249-8593-729874d9ff5e/limitador/0.log" Jul 09 15:33:31.379114 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:31.379078 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99cb46dbc-dmm6f_2b3ac9cf-b6b8-4268-8b58-48766118417b/kube-auth-proxy/0.log" Jul 09 15:33:31.628161 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:31.628128 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bckrp_fd8c708d-7346-4506-a606-98455ee496e5/istio-proxy/1.log" Jul 09 15:33:32.024316 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:32.024288 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bb7644d9b-sr7lc_ebd75b29-960b-4902-a220-e4943e5fed3c/router/0.log" Jul 09 15:33:32.906103 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:32.906073 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-lvn8f_129f588f-07b4-47e9-88ee-1c035a5d722a/main/0.log" Jul 09 15:33:33.024232 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:33.024204 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-67p79_e36e9c2d-0a82-4911-a2ed-dbc4c8860156/main/0.log" Jul 09 15:33:41.107288 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:41.107242 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hxwrn_c471aae4-d380-41c3-a7c9-0f99c3c9d65a/global-pull-secret-syncer/0.log" Jul 09 15:33:41.460401 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:41.460318 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pvxdf_e37c595a-6449-4b2a-b398-6a3f7883bc26/konnectivity-agent/0.log" Jul 09 15:33:41.494613 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:41.494586 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-136.ec2.internal_78350d0908fbb8795cb0dc5d10a96325/haproxy/0.log" Jul 09 15:33:46.858119 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:46.858095 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7sqtx_e4e9505f-ede2-4249-8593-729874d9ff5e/limitador/0.log" Jul 09 15:33:48.978109 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:48.978006 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-b5p6x_dc5d52c3-090e-4012-9945-6919aa07edb4/kube-state-metrics/0.log" Jul 09 15:33:49.000299 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.000276 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-b5p6x_dc5d52c3-090e-4012-9945-6919aa07edb4/kube-rbac-proxy-main/0.log" Jul 09 15:33:49.030016 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.029966 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-b5p6x_dc5d52c3-090e-4012-9945-6919aa07edb4/kube-rbac-proxy-self/0.log" Jul 09 15:33:49.099173 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.099153 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-jl97x_8dadb04c-2cbc-4d3e-a926-d4085c66f7ba/monitoring-plugin/0.log" Jul 09 15:33:49.134902 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.134847 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5q6v6_86679847-306d-4583-99ff-e2bd66b21b29/node-exporter/0.log" Jul 09 15:33:49.160508 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.160484 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5q6v6_86679847-306d-4583-99ff-e2bd66b21b29/kube-rbac-proxy/0.log" Jul 09 15:33:49.189617 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.189598 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5q6v6_86679847-306d-4583-99ff-e2bd66b21b29/init-textfile/0.log" Jul 09 15:33:49.650673 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.650648 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4badcd99-1461-4f7d-8b7c-eb47132586a2/prometheus/0.log" Jul 09 15:33:49.677836 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.677815 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4badcd99-1461-4f7d-8b7c-eb47132586a2/config-reloader/0.log" Jul 09 15:33:49.705977 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.705956 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4badcd99-1461-4f7d-8b7c-eb47132586a2/thanos-sidecar/0.log" Jul 09 15:33:49.734953 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.734936 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4badcd99-1461-4f7d-8b7c-eb47132586a2/kube-rbac-proxy-web/0.log" Jul 09 15:33:49.774217 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.774200 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4badcd99-1461-4f7d-8b7c-eb47132586a2/kube-rbac-proxy/0.log" Jul 09 15:33:49.801957 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.801939 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4badcd99-1461-4f7d-8b7c-eb47132586a2/kube-rbac-proxy-thanos/0.log" Jul 09 15:33:49.828889 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.828872 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4badcd99-1461-4f7d-8b7c-eb47132586a2/init-config-reloader/0.log" Jul 09 15:33:49.862154 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.862133 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-j27ml_fb64097f-c144-4b1b-998b-a73ed6b68487/prometheus-operator/0.log" Jul 09 15:33:49.889940 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.889920 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-j27ml_fb64097f-c144-4b1b-998b-a73ed6b68487/kube-rbac-proxy/0.log" Jul 09 15:33:49.917660 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:49.917641 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-5pv5l_fb3d9246-17ac-4a4f-ae78-c5e1a199f7a7/prometheus-operator-admission-webhook/0.log" Jul 09 15:33:50.056764 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:50.056694 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5884cf55b6-jvbcl_9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b/thanos-query/0.log" Jul 09 15:33:50.093840 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:50.093816 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5884cf55b6-jvbcl_9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b/kube-rbac-proxy-web/0.log" Jul 09 15:33:50.120597 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:50.120581 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5884cf55b6-jvbcl_9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b/kube-rbac-proxy/0.log" Jul 09 15:33:50.149715 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:50.149698 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5884cf55b6-jvbcl_9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b/prom-label-proxy/0.log" Jul 09 15:33:50.181269 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:50.181248 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5884cf55b6-jvbcl_9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b/kube-rbac-proxy-rules/0.log" Jul 09 15:33:50.221514 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:50.221480 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5884cf55b6-jvbcl_9534d3f2-8a36-41ec-9f0b-83a6cc9a5f0b/kube-rbac-proxy-metrics/0.log" Jul 09 15:33:51.702612 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.702575 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47"] Jul 09 15:33:51.702988 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.702924 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" containerName="istio-proxy" Jul 09 15:33:51.702988 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.702935 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" containerName="istio-proxy" Jul 09 15:33:51.703080 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.703007 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" containerName="istio-proxy" Jul 09 15:33:51.703080 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.703018 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d7ab5f5-dd20-478c-89c1-870147cd8bf6" containerName="istio-proxy" Jul 09 15:33:51.708130 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.708109 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.710830 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.710810 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8k5dp\"/\"openshift-service-ca.crt\"" Jul 09 15:33:51.711906 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.711879 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8k5dp\"/\"default-dockercfg-ftn9x\"" Jul 09 15:33:51.712046 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.711888 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8k5dp\"/\"kube-root-ca.crt\"" Jul 09 15:33:51.714285 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.714250 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47"] Jul 09 15:33:51.802062 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.802040 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-proc\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.802171 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.802071 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-sys\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.802171 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.802120 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-podres\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.802171 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.802139 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-lib-modules\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.802171 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.802161 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnlzl\" (UniqueName: \"kubernetes.io/projected/aa17933b-a179-43cc-a782-3adcda42bb30-kube-api-access-jnlzl\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.903436 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.903408 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-podres\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.903565 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.903441 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-lib-modules\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.903565 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.903473 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnlzl\" (UniqueName: \"kubernetes.io/projected/aa17933b-a179-43cc-a782-3adcda42bb30-kube-api-access-jnlzl\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.903652 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.903568 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-proc\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.903652 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.903598 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-sys\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.903652 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.903612 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-lib-modules\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.903652 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.903615 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-podres\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.903824 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.903661 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-proc\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.903824 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.903713 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa17933b-a179-43cc-a782-3adcda42bb30-sys\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:51.913023 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:51.912999 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnlzl\" (UniqueName: \"kubernetes.io/projected/aa17933b-a179-43cc-a782-3adcda42bb30-kube-api-access-jnlzl\") pod \"perf-node-gather-daemonset-tdc47\" (UID: \"aa17933b-a179-43cc-a782-3adcda42bb30\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:52.020053 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:52.020031 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:52.154039 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:52.154006 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47"] Jul 09 15:33:52.156596 ip-10-0-128-136 kubenswrapper[2584]: W0709 15:33:52.156560 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaa17933b_a179_43cc_a782_3adcda42bb30.slice/crio-1582b52bb4d9fbf59347260d00048684eda34ab7eb18f8ed189c390186569d6f WatchSource:0}: Error finding container 1582b52bb4d9fbf59347260d00048684eda34ab7eb18f8ed189c390186569d6f: Status 404 returned error can't find the container with id 1582b52bb4d9fbf59347260d00048684eda34ab7eb18f8ed189c390186569d6f Jul 09 15:33:52.728036 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:52.727950 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-4h78l_18f9a771-ca82-4708-b8d0-83affd898f1a/download-server/0.log" Jul 09 15:33:52.993134 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:52.993105 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" event={"ID":"aa17933b-a179-43cc-a782-3adcda42bb30","Type":"ContainerStarted","Data":"10f6e97dfa1329162a8ad7c0c9afe6914f8cb687ca9cafeff3f80e767e912acf"} Jul 09 15:33:52.993299 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:52.993153 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" event={"ID":"aa17933b-a179-43cc-a782-3adcda42bb30","Type":"ContainerStarted","Data":"1582b52bb4d9fbf59347260d00048684eda34ab7eb18f8ed189c390186569d6f"} Jul 09 15:33:52.993299 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:52.993214 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:33:53.018563 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:53.018521 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" podStartSLOduration=2.018485222 podStartE2EDuration="2.018485222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:33:53.018147599 +0000 UTC m=+2315.340597154" watchObservedRunningTime="2026-07-09 15:33:53.018485222 +0000 UTC m=+2315.340934777" Jul 09 15:33:53.395984 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:53.395908 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-tgbds_0b14a24e-b2d4-48a1-a3c7-f350804a14a5/volume-data-source-validator/0.log" Jul 09 15:33:54.514689 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:54.514660 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mrzwc_947a6a4b-bd97-4327-ade2-c01882a909e0/dns/0.log" Jul 09 15:33:54.539437 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:54.539409 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mrzwc_947a6a4b-bd97-4327-ade2-c01882a909e0/kube-rbac-proxy/0.log" Jul 09 15:33:54.629700 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:54.629674 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9694d_a828edc6-373d-46d7-a9f7-c0d2d0dc431d/dns-node-resolver/0.log" Jul 09 15:33:55.374844 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:55.374817 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mqcjt_d26f442c-10c0-4635-9574-bbf3d35efde9/node-ca/0.log" Jul 09 15:33:56.599906 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:56.599878 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99cb46dbc-dmm6f_2b3ac9cf-b6b8-4268-8b58-48766118417b/kube-auth-proxy/0.log" Jul 09 15:33:56.675422 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:56.675391 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bckrp_fd8c708d-7346-4506-a606-98455ee496e5/istio-proxy/0.log" Jul 09 15:33:56.702186 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:56.702154 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bckrp_fd8c708d-7346-4506-a606-98455ee496e5/istio-proxy/1.log" Jul 09 15:33:56.879262 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:56.879195 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bb7644d9b-sr7lc_ebd75b29-960b-4902-a220-e4943e5fed3c/router/0.log" Jul 09 15:33:57.655017 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:57.654985 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mjzpf_c3206fc5-3f9c-4dc7-b927-2814ca942e2f/serve-healthcheck-canary/0.log" Jul 09 15:33:58.173569 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:58.173540 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-v4bth_71427bca-9234-45e0-a4a5-eb65e439a446/insights-operator/0.log" Jul 09 15:33:58.174011 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:58.173996 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-v4bth_71427bca-9234-45e0-a4a5-eb65e439a446/insights-operator/1.log" Jul 09 15:33:58.378562 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:58.378532 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xr77k_8d9a4c38-828f-42b0-88a3-6c0e6d418bec/kube-rbac-proxy/0.log" Jul 09 15:33:58.410709 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:58.410678 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xr77k_8d9a4c38-828f-42b0-88a3-6c0e6d418bec/exporter/0.log" Jul 09 15:33:58.441250 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:58.441196 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xr77k_8d9a4c38-828f-42b0-88a3-6c0e6d418bec/extractor/0.log" Jul 09 15:33:59.009830 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:33:59.009803 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-tdc47" Jul 09 15:34:01.467845 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:01.467817 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7_d61a88cd-5fd0-4005-a7f2-fe344099fe9f/manager/0.log" Jul 09 15:34:01.492596 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:01.492567 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc7dfbfc4-q45j7_d61a88cd-5fd0-4005-a7f2-fe344099fe9f/copy-manifests/0.log" Jul 09 15:34:02.854146 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:02.854121 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99cb46dbc-dmm6f_2b3ac9cf-b6b8-4268-8b58-48766118417b/kube-auth-proxy/0.log" Jul 09 15:34:02.907553 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:02.907526 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bckrp_fd8c708d-7346-4506-a606-98455ee496e5/istio-proxy/0.log" Jul 09 15:34:02.940021 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:02.939991 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bckrp_fd8c708d-7346-4506-a606-98455ee496e5/istio-proxy/1.log" Jul 09 15:34:02.993200 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:02.993168 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c4bdcff7c-x29sf_cddcde7b-807e-403b-bdca-11b81229e590/manager/0.log" Jul 09 15:34:03.030082 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:03.030059 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-fpqm4_0b7fa743-ed77-4f43-82df-1b5470046a32/openshift-lws-operator/0.log" Jul 09 15:34:03.074668 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:03.074646 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bb7644d9b-sr7lc_ebd75b29-960b-4902-a220-e4943e5fed3c/router/0.log" Jul 09 15:34:04.671447 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:04.671413 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99cb46dbc-dmm6f_2b3ac9cf-b6b8-4268-8b58-48766118417b/kube-auth-proxy/0.log" Jul 09 15:34:04.719000 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:04.718977 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bckrp_fd8c708d-7346-4506-a606-98455ee496e5/istio-proxy/0.log" Jul 09 15:34:04.744345 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:04.744320 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bckrp_fd8c708d-7346-4506-a606-98455ee496e5/istio-proxy/1.log" Jul 09 15:34:04.940895 ip-10-0-128-136 kubenswrapper[2584]: I0709 15:34:04.940822 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bb7644d9b-sr7lc_ebd75b29-960b-4902-a220-e4943e5fed3c/router/0.log"