Jul 07 10:25:34.542254 ip-10-0-135-59 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 10:25:34.542269 ip-10-0-135-59 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 10:25:34.542279 ip-10-0-135-59 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 10:25:34.542623 ip-10-0-135-59 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 10:25:44.624466 ip-10-0-135-59 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 10:25:44.624494 ip-10-0-135-59 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot da1e1efc4fad47779ea58b5de0574e8a -- Jul 07 10:27:19.477833 ip-10-0-135-59 systemd[1]: Starting Kubernetes Kubelet... Jul 07 10:27:19.877856 ip-10-0-135-59 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 10:27:19.877856 ip-10-0-135-59 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 10:27:19.877856 ip-10-0-135-59 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 10:27:19.877856 ip-10-0-135-59 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 10:27:19.877856 ip-10-0-135-59 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 10:27:19.879333 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.879202 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 10:27:19.885807 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885791 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 10:27:19.885807 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885807 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885811 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885815 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885818 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885822 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885824 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885827 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885830 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885834 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885840 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885844 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885847 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885850 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885853 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885856 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885859 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885862 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885865 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 10:27:19.885870 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885868 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885871 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885874 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885876 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885879 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885882 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885885 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885887 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885890 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885892 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885895 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885897 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885900 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885902 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885905 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885907 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885910 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885912 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885915 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885917 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 10:27:19.886301 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885920 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885922 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885924 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885927 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885929 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885932 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885934 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885936 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885939 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885942 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885944 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885953 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885956 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885958 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885961 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885963 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885966 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885968 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885970 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885973 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 10:27:19.886806 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885977 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885979 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885981 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885984 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885986 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885989 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885991 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885994 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885996 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.885999 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886002 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886004 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886007 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886009 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886012 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886014 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886017 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886019 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886022 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886024 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 10:27:19.887293 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886027 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886029 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886032 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886034 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886037 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886040 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886043 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886047 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886050 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886052 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886055 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886057 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886060 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886062 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886065 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886067 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886070 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886074 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886077 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 10:27:19.887922 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886080 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886846 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886853 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886856 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886859 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886861 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886864 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886867 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886870 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886873 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886875 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886878 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886881 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886883 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886886 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886888 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886891 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886893 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886901 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886904 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 10:27:19.888651 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886907 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886910 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886912 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886915 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886917 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886920 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886922 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886925 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886927 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886930 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886933 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886935 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886938 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886940 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886942 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886945 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886947 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886950 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886952 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886955 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 10:27:19.889164 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886957 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886961 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886963 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886966 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886968 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886971 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886973 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886976 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886978 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886980 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886983 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886992 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886995 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886997 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.886999 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887002 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887004 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887007 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887009 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 10:27:19.889675 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887013 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887017 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887020 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887023 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887027 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887030 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887033 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887037 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887041 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887044 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887047 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887050 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887052 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887055 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887057 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887060 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887063 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887065 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887069 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 10:27:19.890155 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887071 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887073 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887076 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887078 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887081 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887084 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887087 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887089 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887092 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887094 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887097 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887100 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887102 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887105 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887107 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887110 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887112 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887114 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887117 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887119 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 10:27:19.890642 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887121 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887124 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887774 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887788 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887792 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887800 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887806 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887818 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887823 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887828 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887832 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887837 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887841 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887846 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887850 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887854 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887859 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887864 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887877 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 10:27:19.891129 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887882 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887891 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887895 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887899 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887907 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887913 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887918 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887923 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887928 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887933 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887937 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887942 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887947 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887956 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887960 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887964 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887969 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887973 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887977 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 10:27:19.891628 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887982 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887986 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887990 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887994 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.887998 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888002 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888006 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888015 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888020 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888024 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888028 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888033 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888038 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888043 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888048 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888052 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888056 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888062 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888066 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 10:27:19.892083 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888075 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888080 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888086 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888090 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888095 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888099 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888103 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888110 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888115 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888119 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888123 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888128 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888136 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888141 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888146 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888150 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888154 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888159 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888163 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888167 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 10:27:19.892555 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888171 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888177 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888182 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888190 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888195 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888199 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888203 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888208 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888212 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888227 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888232 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888236 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888240 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888244 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888249 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888253 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888262 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888266 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888271 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888276 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 10:27:19.893031 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888281 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888288 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888293 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.888297 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888495 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888504 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888512 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888531 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888560 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888564 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888667 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888683 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888687 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888690 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888693 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888696 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888699 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888702 2566 flags.go:64] FLAG: --cgroup-root="" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888705 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888708 2566 flags.go:64] FLAG: --client-ca-file="" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888710 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888713 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888718 2566 flags.go:64] FLAG: --cluster-domain="" Jul 07 10:27:19.893577 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888721 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888724 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888727 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888730 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888734 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888737 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888740 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888743 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888748 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888752 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888755 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888758 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888760 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888764 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888767 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888770 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888773 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888776 2566 flags.go:64] FLAG: --enable-server="true" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888779 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888785 2566 flags.go:64] FLAG: --event-burst="100" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888788 2566 flags.go:64] FLAG: --event-qps="50" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888791 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888794 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888796 2566 flags.go:64] FLAG: --eviction-hard="" Jul 07 10:27:19.894118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888800 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888803 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888806 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888808 2566 flags.go:64] FLAG: --eviction-soft="" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888811 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888814 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888816 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888819 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888822 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888825 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888827 2566 flags.go:64] FLAG: --feature-gates="" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888831 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888834 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888837 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888840 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888842 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888846 2566 flags.go:64] FLAG: --help="false" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888849 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-135-59.ec2.internal" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888852 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888855 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888858 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888861 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888864 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888867 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 10:27:19.894727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888870 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888873 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888875 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888879 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888882 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888885 2566 flags.go:64] FLAG: --kube-reserved="" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888887 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888890 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888893 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888896 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888898 2566 flags.go:64] FLAG: --lock-file="" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888901 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888903 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888906 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888911 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888914 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888917 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888919 2566 flags.go:64] FLAG: --logging-format="text" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888922 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888925 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888928 2566 flags.go:64] FLAG: --manifest-url="" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888930 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888935 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888938 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888943 2566 flags.go:64] FLAG: --max-pods="110" Jul 07 10:27:19.895331 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888946 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888949 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888952 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888955 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888958 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888963 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888966 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888974 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888977 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888980 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888983 2566 flags.go:64] FLAG: --pod-cidr="" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888985 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888991 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888994 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.888997 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889000 2566 flags.go:64] FLAG: --port="10250" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889003 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889006 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e105ec88c599b7b3" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889009 2566 flags.go:64] FLAG: --qos-reserved="" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889012 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889015 2566 flags.go:64] FLAG: --register-node="true" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889017 2566 flags.go:64] FLAG: --register-with-taints="" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889021 2566 flags.go:64] FLAG: --registry-burst="10" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889024 2566 flags.go:64] FLAG: --registry-qps="5" Jul 07 10:27:19.896004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889027 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889030 2566 flags.go:64] FLAG: --reserved-memory="" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889033 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889036 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889039 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889042 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889045 2566 flags.go:64] FLAG: --runonce="false" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889048 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889052 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889054 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889057 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889060 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889063 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889068 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889071 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889074 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889077 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889079 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889082 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889085 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889088 2566 flags.go:64] FLAG: --system-cgroups="" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889091 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889097 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889099 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889102 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 10:27:19.896605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889106 2566 flags.go:64] FLAG: --tls-min-version="" Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889109 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889111 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889115 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889117 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889120 2566 flags.go:64] FLAG: --v="2" Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889124 2566 flags.go:64] FLAG: --version="false" Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889128 2566 flags.go:64] FLAG: --vmodule="" Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889132 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.889135 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889246 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889250 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889253 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889256 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889259 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889263 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889266 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889269 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889271 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889274 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889278 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889281 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 10:27:19.897261 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889283 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889286 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889288 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889293 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889298 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889301 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889304 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889307 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889310 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889313 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889316 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889318 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889321 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889324 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889326 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889329 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889331 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889334 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889337 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 10:27:19.897837 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889340 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889343 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889345 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889348 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889350 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889353 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889357 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889359 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889362 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889364 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889367 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889371 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889375 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889379 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889381 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889384 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889386 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889389 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889392 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 10:27:19.898310 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889394 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889397 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889399 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889402 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889404 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889407 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889410 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889412 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889415 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889417 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889420 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889423 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889425 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889427 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889431 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889433 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889436 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889438 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889441 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889444 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 10:27:19.898823 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889447 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889449 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889452 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889454 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889459 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889461 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889463 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889466 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889468 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889471 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889474 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889477 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889479 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889482 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889484 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889486 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889489 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889491 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889494 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889496 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 10:27:19.899306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889498 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889501 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889503 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889506 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889508 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889511 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889527 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889531 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.889533 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.890115 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.897150 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.897164 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.897994 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.898001 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898056 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 10:27:19.899866 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898062 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898065 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898068 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898070 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898074 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898076 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898079 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898082 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898084 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898087 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898090 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898092 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898095 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898097 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898100 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898102 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898105 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898107 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898110 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 10:27:19.900241 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898112 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898115 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898117 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898120 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898122 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898128 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898131 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898134 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898136 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898139 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898143 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898153 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898156 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898159 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898161 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898166 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898170 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898173 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898176 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898178 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 10:27:19.900712 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898181 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898183 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898186 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898188 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898191 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898193 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898196 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898198 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898201 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898203 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898206 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898208 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898211 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898213 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898216 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898218 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898221 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898223 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898227 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898229 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 10:27:19.901194 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898232 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898235 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898237 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898240 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898243 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898245 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898248 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898250 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898253 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898255 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898258 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898261 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898264 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898266 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898269 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898271 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898274 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898276 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898279 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898281 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 10:27:19.901705 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898284 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898286 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898289 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898291 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898293 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898296 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898298 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898300 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898303 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898307 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898310 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898314 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898317 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898321 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898325 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898328 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898345 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898349 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 10:27:19.902191 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898352 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.898357 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898464 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898468 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898470 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898474 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898476 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898479 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898481 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898484 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898487 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898489 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898491 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898494 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898496 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 10:27:19.902634 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898499 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898501 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898504 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898506 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898508 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898511 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898529 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898534 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898538 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898540 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898543 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898546 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898549 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898552 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898554 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898556 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898560 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898562 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898565 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898567 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 10:27:19.903003 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898570 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898572 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898575 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898577 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898580 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898582 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898586 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898589 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898592 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898594 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898597 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898600 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898602 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898605 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898609 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898612 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898615 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898617 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898620 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 10:27:19.903489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898623 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898626 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898629 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898631 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898634 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898637 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898640 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898642 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898645 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898647 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898650 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898652 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898654 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898657 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898659 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898662 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898664 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898667 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898669 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898671 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 10:27:19.904011 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898674 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898676 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898679 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898681 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898684 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898687 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898690 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898693 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898696 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898698 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898700 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898703 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898705 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898708 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898710 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898712 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898715 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898718 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898721 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 10:27:19.904483 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898723 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898725 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898728 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898730 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898733 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898735 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898737 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:19.898740 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.898745 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.898840 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.900934 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.902371 2566 server.go:1019] "Starting client certificate rotation" Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.902463 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 10:27:19.904949 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.902498 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 10:27:19.907242 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.907227 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 10:27:19.908467 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.908454 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 10:27:19.918166 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.918142 2566 log.go:25] "Validated CRI v1 runtime API" Jul 07 10:27:19.921264 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.921248 2566 log.go:25] "Validated CRI v1 image API" Jul 07 10:27:19.923910 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.923893 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 10:27:19.927154 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.927135 2566 fs.go:135] Filesystem UUIDs: map[0b86cc45-b175-4bd4-9ffd-e74a42c4af06:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c440a12c-359b-4302-97cb-0e65929a0170:/dev/nvme0n1p3] Jul 07 10:27:19.927216 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.927154 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 10:27:19.929377 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.929354 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 10:27:19.932794 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.932689 2566 manager.go:216] Machine: {Timestamp:2026-07-07 10:27:19.931334084 +0000 UTC m=+0.334554278 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099614 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec289ebdea398d87062f6045c6fbbe39 SystemUUID:ec289ebd-ea39-8d87-062f-6045c6fbbe39 BootID:da1e1efc-4fad-4777-9ea5-8b5de0574e8a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3b:6d:61:12:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3b:6d:61:12:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:92:09:25:b3:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 10:27:19.932794 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.932788 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 10:27:19.932912 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.932864 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 10:27:19.936249 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.936226 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 10:27:19.936378 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.936252 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-59.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 10:27:19.936960 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.936950 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 10:27:19.936995 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.936964 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 10:27:19.936995 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.936971 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 10:27:19.937542 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.937533 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 10:27:19.939023 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.939013 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 10:27:19.942326 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.942314 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 07 10:27:19.942455 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.942445 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 10:27:19.942483 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.942478 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 07 10:27:19.942510 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.942492 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 10:27:19.942603 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.942593 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 10:27:19.942638 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.942613 2566 kubelet.go:398] "Adding apiserver pod source" Jul 07 10:27:19.942638 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.942625 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 10:27:19.943013 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.943002 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 10:27:19.943047 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.943022 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 10:27:19.945043 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.945024 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 10:27:19.947008 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.946995 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 10:27:19.947065 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.947026 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 10:27:19.948775 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948764 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 10:27:19.948810 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948781 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 10:27:19.948810 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948787 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 10:27:19.948810 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948792 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 10:27:19.948810 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948800 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 10:27:19.948810 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948805 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 10:27:19.948955 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948813 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 10:27:19.948955 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948818 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 10:27:19.948955 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948825 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 10:27:19.948955 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948830 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 10:27:19.948955 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948839 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 10:27:19.948955 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.948844 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 10:27:19.950294 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.950283 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 10:27:19.950328 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.950297 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 10:27:19.950592 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.950576 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-glwzv" Jul 07 10:27:19.951892 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:19.951857 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-59.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 10:27:19.951972 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:19.951884 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 10:27:19.953926 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.953914 2566 server.go:1268] "Started kubelet" Jul 07 10:27:19.954045 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.954000 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 10:27:19.954105 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.954068 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 10:27:19.954784 ip-10-0-135-59 systemd[1]: Started Kubernetes Kubelet. Jul 07 10:27:19.955350 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.954873 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 10:27:19.955859 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.955840 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 07 10:27:19.959199 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.959170 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 10:27:19.959578 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.959538 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-glwzv" Jul 07 10:27:19.960049 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:19.960025 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 10:27:19.965804 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.965777 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-59.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 10:27:19.966617 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.966598 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 10:27:19.966617 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.966604 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 10:27:19.966793 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:19.965824 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-59.ec2.internal.18bffb13cec3ab5d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-59.ec2.internal,UID:ip-10-0-135-59.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-59.ec2.internal,},FirstTimestamp:2026-07-07 10:27:19.953886045 +0000 UTC m=+0.357106239,LastTimestamp:2026-07-07 10:27:19.953886045 +0000 UTC m=+0.357106239,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-59.ec2.internal,}" Jul 07 10:27:19.966878 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:19.966806 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:19.968381 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.968352 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 10:27:19.968381 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.968382 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 10:27:19.968540 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.968359 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 10:27:19.968540 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.968531 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 07 10:27:19.968540 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.968539 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 07 10:27:19.968841 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.968821 2566 factory.go:55] Registering systemd factory Jul 07 10:27:19.968916 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.968846 2566 factory.go:223] Registration of the systemd container factory successfully Jul 07 10:27:19.969215 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.969198 2566 factory.go:153] Registering CRI-O factory Jul 07 10:27:19.969215 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.969217 2566 factory.go:223] Registration of the crio container factory successfully Jul 07 10:27:19.969340 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.969272 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 10:27:19.969340 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.969296 2566 factory.go:103] Registering Raw factory Jul 07 10:27:19.969340 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.969311 2566 manager.go:1196] Started watching for new ooms in manager Jul 07 10:27:19.970023 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.970002 2566 manager.go:349] Starting recovery of all containers Jul 07 10:27:19.976336 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.975887 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 10:27:19.979815 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.979798 2566 manager.go:354] Recovery completed Jul 07 10:27:19.980946 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:19.980927 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-59.ec2.internal\" not found" node="ip-10-0-135-59.ec2.internal" Jul 07 10:27:19.984075 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.984063 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 10:27:19.985950 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.985934 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 07 10:27:19.986012 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.985959 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 10:27:19.986012 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.985972 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 07 10:27:19.986484 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.986472 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 10:27:19.986484 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.986483 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 10:27:19.986625 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.986487 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 10:27:19.986625 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.986500 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 07 10:27:19.987198 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.987184 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 07 10:27:19.987278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.987215 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 10:27:19.987278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.987230 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 07 10:27:19.987921 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.987908 2566 policy_none.go:49] "None policy: Start" Jul 07 10:27:19.987961 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.987925 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 10:27:19.987961 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.987935 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 10:27:19.989046 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:19.989035 2566 policy_none.go:47] "Start" Jul 07 10:27:20.032144 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.032126 2566 manager.go:337] "Starting Device Plugin manager" Jul 07 10:27:20.040465 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.032161 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 10:27:20.040465 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.032173 2566 server.go:87] "Starting device plugin registration server" Jul 07 10:27:20.040465 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.032427 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 10:27:20.040465 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.032438 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 10:27:20.040465 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.032573 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 10:27:20.040465 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.032658 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 10:27:20.040465 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.032668 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 10:27:20.040465 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.033214 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 10:27:20.040465 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.033256 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:20.076450 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.076412 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 10:27:20.077749 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.077728 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 10:27:20.077839 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.077771 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 10:27:20.077839 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.077798 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 10:27:20.077839 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.077829 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 10:27:20.080817 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.080798 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 10:27:20.132961 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.132908 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 10:27:20.133759 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.133743 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 07 10:27:20.133851 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.133772 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 10:27:20.133851 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.133782 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 07 10:27:20.133851 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.133805 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.141811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.141796 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.141875 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.141817 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-59.ec2.internal\": node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:20.152963 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.152935 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:20.179518 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.178841 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal"] Jul 07 10:27:20.179586 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.179582 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 10:27:20.180287 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.180274 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 07 10:27:20.180354 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.180298 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 10:27:20.180354 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.180310 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 07 10:27:20.181651 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.181640 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 10:27:20.181780 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.181766 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.181815 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.181797 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 10:27:20.182509 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.182486 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 07 10:27:20.182509 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.182493 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 07 10:27:20.182509 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.182534 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 10:27:20.182719 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.182549 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 07 10:27:20.182719 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.182550 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 10:27:20.182719 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.182633 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 07 10:27:20.183781 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.183769 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.183841 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.183791 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 10:27:20.184402 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.184384 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientMemory" Jul 07 10:27:20.184461 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.184414 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 10:27:20.184461 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.184424 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeHasSufficientPID" Jul 07 10:27:20.211114 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.211092 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-59.ec2.internal\" not found" node="ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.215440 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.215422 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-59.ec2.internal\" not found" node="ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.253466 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.253442 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:20.270652 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.270632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58dadbf1a87814ee7db1b588f93747d1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"58dadbf1a87814ee7db1b588f93747d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.270727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.270656 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58dadbf1a87814ee7db1b588f93747d1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"58dadbf1a87814ee7db1b588f93747d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.270727 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.270671 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90a4ce6b5344e1b6a330df4dc8cc3efd-config\") pod \"kube-apiserver-proxy-ip-10-0-135-59.ec2.internal\" (UID: \"90a4ce6b5344e1b6a330df4dc8cc3efd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.353716 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.353691 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:20.371119 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.371100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58dadbf1a87814ee7db1b588f93747d1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"58dadbf1a87814ee7db1b588f93747d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.371200 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.371126 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90a4ce6b5344e1b6a330df4dc8cc3efd-config\") pod \"kube-apiserver-proxy-ip-10-0-135-59.ec2.internal\" (UID: \"90a4ce6b5344e1b6a330df4dc8cc3efd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.371200 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.371142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58dadbf1a87814ee7db1b588f93747d1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"58dadbf1a87814ee7db1b588f93747d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.371200 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.371185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58dadbf1a87814ee7db1b588f93747d1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"58dadbf1a87814ee7db1b588f93747d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.371200 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.371189 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58dadbf1a87814ee7db1b588f93747d1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal\" (UID: \"58dadbf1a87814ee7db1b588f93747d1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.371322 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.371190 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90a4ce6b5344e1b6a330df4dc8cc3efd-config\") pod \"kube-apiserver-proxy-ip-10-0-135-59.ec2.internal\" (UID: \"90a4ce6b5344e1b6a330df4dc8cc3efd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.454569 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.454538 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:20.514083 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.514047 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.518695 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.518534 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 07 10:27:20.555222 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.555199 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:20.655833 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.655800 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:20.756398 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.756335 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:20.856915 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.856873 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:20.901463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.901438 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 10:27:20.902034 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.901630 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 10:27:20.902034 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.901643 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 10:27:20.957944 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:20.957905 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:20.966082 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.966043 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 10:22:21 +0000 UTC" deadline="2028-03-04 03:47:39.216682758 +0000 UTC" Jul 07 10:27:20.966082 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:20.966076 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14537h20m18.250611597s" Jul 07 10:27:21.059037 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:21.058960 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:21.127529 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:21.127467 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 10:27:21.159956 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:21.159928 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:21.260603 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:21.260571 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-59.ec2.internal\" not found" Jul 07 10:27:21.284980 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:21.284950 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a4ce6b5344e1b6a330df4dc8cc3efd.slice/crio-7861e7f814f6245fc95b21cee192e088673d06c0e8b18a4f24558d302623db8f WatchSource:0}: Error finding container 7861e7f814f6245fc95b21cee192e088673d06c0e8b18a4f24558d302623db8f: Status 404 returned error can't find the container with id 7861e7f814f6245fc95b21cee192e088673d06c0e8b18a4f24558d302623db8f Jul 07 10:27:21.289345 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:21.289326 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 10:27:21.316222 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:21.316157 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 10:27:21.322082 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:21.322059 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58dadbf1a87814ee7db1b588f93747d1.slice/crio-a88d3f3ee8a456602fe034920edb5d674b4ae28eed33eddc847596b64a278e29 WatchSource:0}: Error finding container a88d3f3ee8a456602fe034920edb5d674b4ae28eed33eddc847596b64a278e29: Status 404 returned error can't find the container with id a88d3f3ee8a456602fe034920edb5d674b4ae28eed33eddc847596b64a278e29 Jul 07 10:27:22.997721 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:22.997703 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" Jul 07 10:27:23.008805 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.008782 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 10:27:23.009706 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.009692 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" Jul 07 10:27:23.020270 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.020256 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 10:27:23.370381 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.370353 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 10:27:23.575662 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.575389 2566 apiserver.go:52] "Watching apiserver" Jul 07 10:27:23.588067 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.588036 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 10:27:23.589685 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.589295 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal","openshift-multus/multus-additional-cni-plugins-5lv72","openshift-multus/network-metrics-daemon-sjkz4","openshift-network-operator/iptables-alerter-w82cv","kube-system/global-pull-secret-syncer-4t7c8","kube-system/konnectivity-agent-zn24z","openshift-dns/node-resolver-5xshq","openshift-multus/multus-5x26k","openshift-network-diagnostics/network-check-target-m5bhq","openshift-ovn-kubernetes/ovnkube-node-vjtwv","kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv","openshift-cluster-node-tuning-operator/tuned-5fhfr","openshift-image-registry/node-ca-d5vcg"] Jul 07 10:27:23.591207 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.590910 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5xshq" Jul 07 10:27:23.592207 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.592191 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.593826 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.593808 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 10:27:23.593918 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.593841 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vb56t\"" Jul 07 10:27:23.594619 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.594370 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:23.594619 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:23.594440 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:23.597608 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.594865 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rkq9g\"" Jul 07 10:27:23.597608 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.594877 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 10:27:23.597608 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.595188 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 10:27:23.597608 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.596733 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 10:27:23.597608 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.597073 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w82cv" Jul 07 10:27:23.597608 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.597561 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 10:27:23.598718 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.598702 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:23.598806 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:23.598760 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:23.599689 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.599667 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 10:27:23.599991 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.599792 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 10:27:23.599991 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.599978 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 10:27:23.600126 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.599979 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8ckfm\"" Jul 07 10:27:23.600403 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.600386 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:23.602265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.602156 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:23.602265 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:23.602227 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:23.603189 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.602986 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 10:27:23.603189 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.603036 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jjvj8\"" Jul 07 10:27:23.603468 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.603450 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 10:27:23.604950 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.604880 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d5vcg" Jul 07 10:27:23.606852 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.606835 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.607444 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.607329 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 10:27:23.607871 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.607854 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 10:27:23.608741 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.608005 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hbjnp\"" Jul 07 10:27:23.608741 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.608069 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 10:27:23.609994 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.609113 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.610476 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.610451 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 10:27:23.610566 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.610503 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 10:27:23.610689 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.610673 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 10:27:23.610905 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.610887 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 10:27:23.610970 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.610933 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cq8kd\"" Jul 07 10:27:23.611156 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-sysconfig\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.611224 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611173 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-sys\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.611224 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611181 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 10:27:23.611224 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611197 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.611360 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611198 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9379b713-f601-4993-9695-95d111564321-agent-certs\") pod \"konnectivity-agent-zn24z\" (UID: \"9379b713-f601-4993-9695-95d111564321\") " pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:23.611360 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611270 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmjz8\" (UniqueName: \"kubernetes.io/projected/3d6a8b5b-baaf-44ea-946e-90569b0de370-kube-api-access-zmjz8\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:23.611360 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611294 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-systemd\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.611360 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-run\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.611360 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611337 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:23.611568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0be0643f-118f-44fb-ab9c-04b0a2bab952-iptables-alerter-script\") pod \"iptables-alerter-w82cv\" (UID: \"0be0643f-118f-44fb-ab9c-04b0a2bab952\") " pod="openshift-network-operator/iptables-alerter-w82cv" Jul 07 10:27:23.611568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611402 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0be0643f-118f-44fb-ab9c-04b0a2bab952-host-slash\") pod \"iptables-alerter-w82cv\" (UID: \"0be0643f-118f-44fb-ab9c-04b0a2bab952\") " pod="openshift-network-operator/iptables-alerter-w82cv" Jul 07 10:27:23.611568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611426 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9379b713-f601-4993-9695-95d111564321-konnectivity-ca\") pod \"konnectivity-agent-zn24z\" (UID: \"9379b713-f601-4993-9695-95d111564321\") " pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:23.611568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h62mc\" (UniqueName: \"kubernetes.io/projected/c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5-kube-api-access-h62mc\") pod \"node-resolver-5xshq\" (UID: \"c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5\") " pod="openshift-dns/node-resolver-5xshq" Jul 07 10:27:23.611568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611472 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-modprobe-d\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.611568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611495 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b7985f2-f553-4967-91f4-df2de480701e-tmp\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.611568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611517 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1f3bd64-ddef-47d4-82bd-405034aac7b6-kubelet-config\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:23.611568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611553 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1f3bd64-ddef-47d4-82bd-405034aac7b6-dbus\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:23.611813 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5-hosts-file\") pod \"node-resolver-5xshq\" (UID: \"c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5\") " pod="openshift-dns/node-resolver-5xshq" Jul 07 10:27:23.611813 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611611 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-kubernetes\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.611813 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611639 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-lib-modules\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.611813 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611661 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b7985f2-f553-4967-91f4-df2de480701e-etc-tuned\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.611813 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611701 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98c5r\" (UniqueName: \"kubernetes.io/projected/7b7985f2-f553-4967-91f4-df2de480701e-kube-api-access-98c5r\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.611813 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611745 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp4tt\" (UniqueName: \"kubernetes.io/projected/0be0643f-118f-44fb-ab9c-04b0a2bab952-kube-api-access-dp4tt\") pod \"iptables-alerter-w82cv\" (UID: \"0be0643f-118f-44fb-ab9c-04b0a2bab952\") " pod="openshift-network-operator/iptables-alerter-w82cv" Jul 07 10:27:23.611813 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611770 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-sysctl-conf\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.611813 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611804 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-var-lib-kubelet\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.612033 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611808 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 10:27:23.612033 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611828 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-host\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.612033 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611868 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 10:27:23.612033 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611867 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:23.612033 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611932 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-sysctl-d\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.612033 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611980 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6xbbt\"" Jul 07 10:27:23.612033 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.611979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5-tmp-dir\") pod \"node-resolver-5xshq\" (UID: \"c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5\") " pod="openshift-dns/node-resolver-5xshq" Jul 07 10:27:23.612332 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.612042 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 10:27:23.612332 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.612318 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 10:27:23.612392 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.612328 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 10:27:23.612855 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.612834 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 10:27:23.613327 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.613306 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.613446 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.613422 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 10:27:23.613825 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.613807 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 10:27:23.613897 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.613827 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-27pvk\"" Jul 07 10:27:23.615843 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.615823 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 10:27:23.616013 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.615823 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jd76f\"" Jul 07 10:27:23.616193 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.616176 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 10:27:23.616262 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.616189 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 10:27:23.631414 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.631391 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2flzh" Jul 07 10:27:23.638900 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.638878 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2flzh" Jul 07 10:27:23.700935 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.700902 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 10:27:23.712180 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712133 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5-tmp-dir\") pod \"node-resolver-5xshq\" (UID: \"c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5\") " pod="openshift-dns/node-resolver-5xshq" Jul 07 10:27:23.712394 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.712394 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-slash\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.712394 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712251 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-run-netns\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.712394 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712274 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgzcm\" (UniqueName: \"kubernetes.io/projected/7aa34fad-be27-460f-9462-24b73575e5b4-kube-api-access-jgzcm\") pod \"node-ca-d5vcg\" (UID: \"7aa34fad-be27-460f-9462-24b73575e5b4\") " pod="openshift-image-registry/node-ca-d5vcg" Jul 07 10:27:23.712394 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712298 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-etc-openvswitch\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.712394 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712321 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-daemon-config\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.712394 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712392 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-system-cni-dir\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712415 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-cnibin\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712438 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-os-release\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r86d9\" (UniqueName: \"kubernetes.io/projected/4576e808-2b7c-4cc6-b23d-bac002368c7f-kube-api-access-r86d9\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712466 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5-tmp-dir\") pod \"node-resolver-5xshq\" (UID: \"c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5\") " pod="openshift-dns/node-resolver-5xshq" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712491 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-systemd\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkv5k\" (UniqueName: \"kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k\") pod \"network-check-target-m5bhq\" (UID: \"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb\") " pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aa34fad-be27-460f-9462-24b73575e5b4-host\") pod \"node-ca-d5vcg\" (UID: \"7aa34fad-be27-460f-9462-24b73575e5b4\") " pod="openshift-image-registry/node-ca-d5vcg" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712558 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-os-release\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712573 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-run-multus-certs\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712582 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-systemd\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712609 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h62mc\" (UniqueName: \"kubernetes.io/projected/c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5-kube-api-access-h62mc\") pod \"node-resolver-5xshq\" (UID: \"c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5\") " pod="openshift-dns/node-resolver-5xshq" Jul 07 10:27:23.712696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-modprobe-d\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b7985f2-f553-4967-91f4-df2de480701e-tmp\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712845 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-modprobe-d\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712852 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1f3bd64-ddef-47d4-82bd-405034aac7b6-kubelet-config\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712902 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1f3bd64-ddef-47d4-82bd-405034aac7b6-kubelet-config\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712930 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712964 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.712996 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-registration-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713017 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713023 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-kubernetes\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98c5r\" (UniqueName: \"kubernetes.io/projected/7b7985f2-f553-4967-91f4-df2de480701e-kube-api-access-98c5r\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713060 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-kubernetes\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp4tt\" (UniqueName: \"kubernetes.io/projected/0be0643f-118f-44fb-ab9c-04b0a2bab952-kube-api-access-dp4tt\") pod \"iptables-alerter-w82cv\" (UID: \"0be0643f-118f-44fb-ab9c-04b0a2bab952\") " pod="openshift-network-operator/iptables-alerter-w82cv" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713099 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-kubelet\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-run-openvswitch\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713163 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-ovnkube-config\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.713230 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713213 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-sysctl-conf\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713272 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-var-lib-openvswitch\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713305 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-cni-bin\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-ovnkube-script-lib\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:23.713345 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713347 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-sysctl-conf\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713362 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-cni-dir\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:23.713421 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret podName:e1f3bd64-ddef-47d4-82bd-405034aac7b6 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:24.213389305 +0000 UTC m=+2.985982339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret") pod "global-pull-secret-syncer-4t7c8" (UID: "e1f3bd64-ddef-47d4-82bd-405034aac7b6") : object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-hostroot\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713494 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-etc-kubernetes\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713530 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-sysctl-d\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713581 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713635 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-ovn-node-metrics-cert\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713649 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-sysctl-d\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.713811 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713658 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-cnibin\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713685 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-var-lib-cni-multus\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4zgk\" (UniqueName: \"kubernetes.io/projected/c0397ccc-cccd-49b7-8bae-bab90ec8156a-kube-api-access-g4zgk\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713729 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-sysconfig\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713745 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-sys\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713760 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9379b713-f601-4993-9695-95d111564321-agent-certs\") pod \"konnectivity-agent-zn24z\" (UID: \"9379b713-f601-4993-9695-95d111564321\") " pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-run-netns\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713791 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-cni-netd\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713782 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-etc-sysconfig\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713809 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-socket-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713789 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-sys\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmjz8\" (UniqueName: \"kubernetes.io/projected/3d6a8b5b-baaf-44ea-946e-90569b0de370-kube-api-access-zmjz8\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713875 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aa34fad-be27-460f-9462-24b73575e5b4-serviceca\") pod \"node-ca-d5vcg\" (UID: \"7aa34fad-be27-460f-9462-24b73575e5b4\") " pod="openshift-image-registry/node-ca-d5vcg" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.713987 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfhnr\" (UniqueName: \"kubernetes.io/projected/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-kube-api-access-pfhnr\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714018 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-socket-dir-parent\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714039 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-run-k8s-cni-cncf-io\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-run\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.714463 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714139 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-run\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714170 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714202 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0be0643f-118f-44fb-ab9c-04b0a2bab952-iptables-alerter-script\") pod \"iptables-alerter-w82cv\" (UID: \"0be0643f-118f-44fb-ab9c-04b0a2bab952\") " pod="openshift-network-operator/iptables-alerter-w82cv" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:23.714268 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0be0643f-118f-44fb-ab9c-04b0a2bab952-host-slash\") pod \"iptables-alerter-w82cv\" (UID: \"0be0643f-118f-44fb-ab9c-04b0a2bab952\") " pod="openshift-network-operator/iptables-alerter-w82cv" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:23.714322 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs podName:3d6a8b5b-baaf-44ea-946e-90569b0de370 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:24.214306505 +0000 UTC m=+2.986899539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs") pod "network-metrics-daemon-sjkz4" (UID: "3d6a8b5b-baaf-44ea-946e-90569b0de370") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0be0643f-118f-44fb-ab9c-04b0a2bab952-host-slash\") pod \"iptables-alerter-w82cv\" (UID: \"0be0643f-118f-44fb-ab9c-04b0a2bab952\") " pod="openshift-network-operator/iptables-alerter-w82cv" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714489 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9379b713-f601-4993-9695-95d111564321-konnectivity-ca\") pod \"konnectivity-agent-zn24z\" (UID: \"9379b713-f601-4993-9695-95d111564321\") " pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5x56\" (UniqueName: \"kubernetes.io/projected/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-kube-api-access-c5x56\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-run-systemd\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714570 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1f3bd64-ddef-47d4-82bd-405034aac7b6-dbus\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714594 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-system-cni-dir\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714619 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-var-lib-cni-bin\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714641 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-var-lib-kubelet\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-conf-dir\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714708 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-sys-fs\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.715265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714732 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5-hosts-file\") pod \"node-resolver-5xshq\" (UID: \"c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5\") " pod="openshift-dns/node-resolver-5xshq" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-lib-modules\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714790 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5-hosts-file\") pod \"node-resolver-5xshq\" (UID: \"c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5\") " pod="openshift-dns/node-resolver-5xshq" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b7985f2-f553-4967-91f4-df2de480701e-etc-tuned\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-node-log\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-log-socket\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714880 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1f3bd64-ddef-47d4-82bd-405034aac7b6-dbus\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714888 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0be0643f-118f-44fb-ab9c-04b0a2bab952-iptables-alerter-script\") pod \"iptables-alerter-w82cv\" (UID: \"0be0643f-118f-44fb-ab9c-04b0a2bab952\") " pod="openshift-network-operator/iptables-alerter-w82cv" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-device-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.714975 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9379b713-f601-4993-9695-95d111564321-konnectivity-ca\") pod \"konnectivity-agent-zn24z\" (UID: \"9379b713-f601-4993-9695-95d111564321\") " pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.715021 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-var-lib-kubelet\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.715037 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-lib-modules\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.715047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-host\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.715072 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-run-ovn\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.715087 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-var-lib-kubelet\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.715097 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-systemd-units\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.716245 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.715121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-env-overrides\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.717039 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.715133 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b7985f2-f553-4967-91f4-df2de480701e-host\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.717039 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.715161 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0397ccc-cccd-49b7-8bae-bab90ec8156a-cni-binary-copy\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.717039 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.715562 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" event={"ID":"58dadbf1a87814ee7db1b588f93747d1","Type":"ContainerStarted","Data":"a88d3f3ee8a456602fe034920edb5d674b4ae28eed33eddc847596b64a278e29"} Jul 07 10:27:23.717039 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.716882 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b7985f2-f553-4967-91f4-df2de480701e-tmp\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.717039 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.716926 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" event={"ID":"90a4ce6b5344e1b6a330df4dc8cc3efd","Type":"ContainerStarted","Data":"7861e7f814f6245fc95b21cee192e088673d06c0e8b18a4f24558d302623db8f"} Jul 07 10:27:23.717609 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.717590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b7985f2-f553-4967-91f4-df2de480701e-etc-tuned\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.717869 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.717845 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9379b713-f601-4993-9695-95d111564321-agent-certs\") pod \"konnectivity-agent-zn24z\" (UID: \"9379b713-f601-4993-9695-95d111564321\") " pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:23.720635 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.720610 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h62mc\" (UniqueName: \"kubernetes.io/projected/c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5-kube-api-access-h62mc\") pod \"node-resolver-5xshq\" (UID: \"c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5\") " pod="openshift-dns/node-resolver-5xshq" Jul 07 10:27:23.722022 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.722002 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98c5r\" (UniqueName: \"kubernetes.io/projected/7b7985f2-f553-4967-91f4-df2de480701e-kube-api-access-98c5r\") pod \"tuned-5fhfr\" (UID: \"7b7985f2-f553-4967-91f4-df2de480701e\") " pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.722240 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.722204 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp4tt\" (UniqueName: \"kubernetes.io/projected/0be0643f-118f-44fb-ab9c-04b0a2bab952-kube-api-access-dp4tt\") pod \"iptables-alerter-w82cv\" (UID: \"0be0643f-118f-44fb-ab9c-04b0a2bab952\") " pod="openshift-network-operator/iptables-alerter-w82cv" Jul 07 10:27:23.722702 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.722680 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmjz8\" (UniqueName: \"kubernetes.io/projected/3d6a8b5b-baaf-44ea-946e-90569b0de370-kube-api-access-zmjz8\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:23.767235 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.767201 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 10:27:23.816370 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816331 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.816516 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.816516 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816406 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-ovn-node-metrics-cert\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.816516 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816429 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-cnibin\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.816516 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816453 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-var-lib-cni-multus\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.816516 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4zgk\" (UniqueName: \"kubernetes.io/projected/c0397ccc-cccd-49b7-8bae-bab90ec8156a-kube-api-access-g4zgk\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.816516 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-run-netns\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.816769 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816525 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-cni-netd\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.816769 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-socket-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.816769 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aa34fad-be27-460f-9462-24b73575e5b4-serviceca\") pod \"node-ca-d5vcg\" (UID: \"7aa34fad-be27-460f-9462-24b73575e5b4\") " pod="openshift-image-registry/node-ca-d5vcg" Jul 07 10:27:23.816769 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816598 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfhnr\" (UniqueName: \"kubernetes.io/projected/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-kube-api-access-pfhnr\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.816769 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-socket-dir-parent\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.816769 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816644 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-run-k8s-cni-cncf-io\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.816769 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816685 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5x56\" (UniqueName: \"kubernetes.io/projected/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-kube-api-access-c5x56\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.816769 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816708 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-run-systemd\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.816769 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816731 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-system-cni-dir\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.816769 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816755 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-var-lib-cni-bin\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816785 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-var-lib-kubelet\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-conf-dir\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816831 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-sys-fs\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816881 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-node-log\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816906 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-log-socket\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816941 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-device-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816965 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.816992 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-run-ovn\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817015 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-systemd-units\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817037 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-env-overrides\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817072 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817061 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0397ccc-cccd-49b7-8bae-bab90ec8156a-cni-binary-copy\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817086 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817110 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-slash\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817134 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-run-netns\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817180 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgzcm\" (UniqueName: \"kubernetes.io/projected/7aa34fad-be27-460f-9462-24b73575e5b4-kube-api-access-jgzcm\") pod \"node-ca-d5vcg\" (UID: \"7aa34fad-be27-460f-9462-24b73575e5b4\") " pod="openshift-image-registry/node-ca-d5vcg" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817206 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-etc-openvswitch\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817230 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-daemon-config\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817256 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-system-cni-dir\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817281 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-cnibin\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-os-release\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817331 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r86d9\" (UniqueName: \"kubernetes.io/projected/4576e808-2b7c-4cc6-b23d-bac002368c7f-kube-api-access-r86d9\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkv5k\" (UniqueName: \"kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k\") pod \"network-check-target-m5bhq\" (UID: \"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb\") " pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817381 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aa34fad-be27-460f-9462-24b73575e5b4-host\") pod \"node-ca-d5vcg\" (UID: \"7aa34fad-be27-460f-9462-24b73575e5b4\") " pod="openshift-image-registry/node-ca-d5vcg" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817404 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-os-release\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.817425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817427 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-run-multus-certs\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817459 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817484 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817509 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-registration-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817539 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-kubelet\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817567 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-run-openvswitch\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817593 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817617 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-ovnkube-config\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817656 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-var-lib-openvswitch\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817680 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-cni-bin\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-ovnkube-script-lib\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817729 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-cni-dir\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817753 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-hostroot\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.817820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-etc-kubernetes\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.818195 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.817874 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-etc-kubernetes\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.818287 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818262 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-run-systemd\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.818347 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818292 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-cni-netd\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.818347 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818262 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-run-netns\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.818347 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818341 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-system-cni-dir\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.818480 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818357 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.818480 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818387 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-var-lib-cni-bin\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.818480 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818434 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-var-lib-kubelet\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.818480 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-os-release\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.818480 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818462 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-var-lib-cni-multus\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.818703 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818484 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-conf-dir\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.818703 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818498 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.818703 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818536 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-node-log\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.818703 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818565 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-run-multus-certs\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.818703 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818576 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-log-socket\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.818703 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818640 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-device-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.818703 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818655 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aa34fad-be27-460f-9462-24b73575e5b4-serviceca\") pod \"node-ca-d5vcg\" (UID: \"7aa34fad-be27-460f-9462-24b73575e5b4\") " pod="openshift-image-registry/node-ca-d5vcg" Jul 07 10:27:23.819061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818759 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.819061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818809 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-run-ovn\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.819061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818847 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-systemd-units\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.819061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818858 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0397ccc-cccd-49b7-8bae-bab90ec8156a-cni-binary-copy\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.819061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818911 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-socket-dir-parent\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.819061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818950 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.819061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818970 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-socket-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.819061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818990 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.819061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.818991 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-run-k8s-cni-cncf-io\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.819061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819029 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.819061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819047 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-cnibin\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819088 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-sys-fs\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819110 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-cnibin\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819114 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-run-openvswitch\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819132 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-var-lib-openvswitch\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819180 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-slash\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819181 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-kubelet\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819218 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4576e808-2b7c-4cc6-b23d-bac002368c7f-registration-dir\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819219 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-env-overrides\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819239 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819131 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-system-cni-dir\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819272 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-host-cni-bin\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819295 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-cni-dir\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819341 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-etc-openvswitch\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819422 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-host-run-netns\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819467 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-ovnkube-config\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.819595 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819541 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aa34fad-be27-460f-9462-24b73575e5b4-host\") pod \"node-ca-d5vcg\" (UID: \"7aa34fad-be27-460f-9462-24b73575e5b4\") " pod="openshift-image-registry/node-ca-d5vcg" Jul 07 10:27:23.820330 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819612 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-ovnkube-script-lib\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.820330 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819623 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.820330 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819686 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c0397ccc-cccd-49b7-8bae-bab90ec8156a-hostroot\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.820330 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819689 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-os-release\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.820330 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.819943 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c0397ccc-cccd-49b7-8bae-bab90ec8156a-multus-daemon-config\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.822101 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.822078 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-ovn-node-metrics-cert\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.827397 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:23.827374 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 10:27:23.827397 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:23.827397 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 10:27:23.827548 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:23.827412 2566 projected.go:196] Error preparing data for projected volume kube-api-access-wkv5k for pod openshift-network-diagnostics/network-check-target-m5bhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:23.827548 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:23.827486 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k podName:aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb nodeName:}" failed. No retries permitted until 2026-07-07 10:27:24.32746851 +0000 UTC m=+3.100061546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wkv5k" (UniqueName: "kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k") pod "network-check-target-m5bhq" (UID: "aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:23.831783 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.831762 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4zgk\" (UniqueName: \"kubernetes.io/projected/c0397ccc-cccd-49b7-8bae-bab90ec8156a-kube-api-access-g4zgk\") pod \"multus-5x26k\" (UID: \"c0397ccc-cccd-49b7-8bae-bab90ec8156a\") " pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.831959 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.831936 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgzcm\" (UniqueName: \"kubernetes.io/projected/7aa34fad-be27-460f-9462-24b73575e5b4-kube-api-access-jgzcm\") pod \"node-ca-d5vcg\" (UID: \"7aa34fad-be27-460f-9462-24b73575e5b4\") " pod="openshift-image-registry/node-ca-d5vcg" Jul 07 10:27:23.832019 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.831999 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5x56\" (UniqueName: \"kubernetes.io/projected/712e4eb9-17d6-40d8-a3a1-4e34deaddb46-kube-api-access-c5x56\") pod \"multus-additional-cni-plugins-5lv72\" (UID: \"712e4eb9-17d6-40d8-a3a1-4e34deaddb46\") " pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.832947 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.832830 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfhnr\" (UniqueName: \"kubernetes.io/projected/6a2b5157-16f7-4f53-8fdd-b93f8a261aac-kube-api-access-pfhnr\") pod \"ovnkube-node-vjtwv\" (UID: \"6a2b5157-16f7-4f53-8fdd-b93f8a261aac\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.833453 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.833436 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r86d9\" (UniqueName: \"kubernetes.io/projected/4576e808-2b7c-4cc6-b23d-bac002368c7f-kube-api-access-r86d9\") pod \"aws-ebs-csi-driver-node-jg2vv\" (UID: \"4576e808-2b7c-4cc6-b23d-bac002368c7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:23.904460 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.904392 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5xshq" Jul 07 10:27:23.914263 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.914240 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" Jul 07 10:27:23.925994 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.925966 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w82cv" Jul 07 10:27:23.931559 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.931543 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:23.937956 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.937935 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d5vcg" Jul 07 10:27:23.947509 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.947488 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5lv72" Jul 07 10:27:23.954765 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.954748 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:23.962483 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.962464 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5x26k" Jul 07 10:27:23.969054 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:23.969032 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" Jul 07 10:27:24.221077 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:24.221010 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:24.221077 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:24.221047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:24.221275 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:24.221161 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:24.221275 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:24.221168 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:24.221275 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:24.221207 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs podName:3d6a8b5b-baaf-44ea-946e-90569b0de370 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:25.221194697 +0000 UTC m=+3.993787729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs") pod "network-metrics-daemon-sjkz4" (UID: "3d6a8b5b-baaf-44ea-946e-90569b0de370") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:24.221275 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:24.221219 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret podName:e1f3bd64-ddef-47d4-82bd-405034aac7b6 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:25.221213598 +0000 UTC m=+3.993806631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret") pod "global-pull-secret-syncer-4t7c8" (UID: "e1f3bd64-ddef-47d4-82bd-405034aac7b6") : object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:24.423404 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:24.423368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkv5k\" (UniqueName: \"kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k\") pod \"network-check-target-m5bhq\" (UID: \"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb\") " pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:24.423562 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:24.423508 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 10:27:24.423562 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:24.423534 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 10:27:24.423562 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:24.423546 2566 projected.go:196] Error preparing data for projected volume kube-api-access-wkv5k for pod openshift-network-diagnostics/network-check-target-m5bhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:24.423726 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:24.423610 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k podName:aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb nodeName:}" failed. No retries permitted until 2026-07-07 10:27:25.423591328 +0000 UTC m=+4.196184368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkv5k" (UniqueName: "kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k") pod "network-check-target-m5bhq" (UID: "aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:24.642672 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:24.642634 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 10:22:23 +0000 UTC" deadline="2028-02-10 16:19:58.496533463 +0000 UTC" Jul 07 10:27:24.642672 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:24.642663 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13997h52m33.853873903s" Jul 07 10:27:24.897340 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:24.897168 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4576e808_2b7c_4cc6_b23d_bac002368c7f.slice/crio-8fa90a8337947016cd1a77f14c26d52e8556df82b96cb23c793ad9f5a25869ac WatchSource:0}: Error finding container 8fa90a8337947016cd1a77f14c26d52e8556df82b96cb23c793ad9f5a25869ac: Status 404 returned error can't find the container with id 8fa90a8337947016cd1a77f14c26d52e8556df82b96cb23c793ad9f5a25869ac Jul 07 10:27:24.900228 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:24.900194 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2b5157_16f7_4f53_8fdd_b93f8a261aac.slice/crio-cadb6d35cb21f3fd505fdde7e3bb7018f6a4aff0df43cbebb7ef1fecc8352024 WatchSource:0}: Error finding container cadb6d35cb21f3fd505fdde7e3bb7018f6a4aff0df43cbebb7ef1fecc8352024: Status 404 returned error can't find the container with id cadb6d35cb21f3fd505fdde7e3bb7018f6a4aff0df43cbebb7ef1fecc8352024 Jul 07 10:27:24.903820 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:24.903799 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b1c54e_ae2d_4e19_a90c_0e4f8494e2a5.slice/crio-c8c89864850a92586f0637fb92060214f2def3d5876be8e12138ea92f901f8e2 WatchSource:0}: Error finding container c8c89864850a92586f0637fb92060214f2def3d5876be8e12138ea92f901f8e2: Status 404 returned error can't find the container with id c8c89864850a92586f0637fb92060214f2def3d5876be8e12138ea92f901f8e2 Jul 07 10:27:24.905576 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:24.905559 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa34fad_be27_460f_9462_24b73575e5b4.slice/crio-100a9693ab9862991f08e6ba426518ee16ff0f16ccbae359e9d7afc7776c9a39 WatchSource:0}: Error finding container 100a9693ab9862991f08e6ba426518ee16ff0f16ccbae359e9d7afc7776c9a39: Status 404 returned error can't find the container with id 100a9693ab9862991f08e6ba426518ee16ff0f16ccbae359e9d7afc7776c9a39 Jul 07 10:27:24.905829 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:24.905807 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be0643f_118f_44fb_ab9c_04b0a2bab952.slice/crio-536820d5500ec3b00f9b8f3bb1aa0f36d618cc1cdd3886eba70ba7cb6d323594 WatchSource:0}: Error finding container 536820d5500ec3b00f9b8f3bb1aa0f36d618cc1cdd3886eba70ba7cb6d323594: Status 404 returned error can't find the container with id 536820d5500ec3b00f9b8f3bb1aa0f36d618cc1cdd3886eba70ba7cb6d323594 Jul 07 10:27:24.907390 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:24.907283 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712e4eb9_17d6_40d8_a3a1_4e34deaddb46.slice/crio-8617ddcda5bb6c9f1422abf447bf9329370cd2ff2efc7ac4dbfb07082b09aa49 WatchSource:0}: Error finding container 8617ddcda5bb6c9f1422abf447bf9329370cd2ff2efc7ac4dbfb07082b09aa49: Status 404 returned error can't find the container with id 8617ddcda5bb6c9f1422abf447bf9329370cd2ff2efc7ac4dbfb07082b09aa49 Jul 07 10:27:24.907942 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:24.907699 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9379b713_f601_4993_9695_95d111564321.slice/crio-dd1921bb72eba1096e4978a86f6dea00ad753b369eda785a06db02bed179b0e9 WatchSource:0}: Error finding container dd1921bb72eba1096e4978a86f6dea00ad753b369eda785a06db02bed179b0e9: Status 404 returned error can't find the container with id dd1921bb72eba1096e4978a86f6dea00ad753b369eda785a06db02bed179b0e9 Jul 07 10:27:24.910531 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:24.910506 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0397ccc_cccd_49b7_8bae_bab90ec8156a.slice/crio-10f29995be07c886a1f7b19600f4119cdfdcced006b66a08242e405008bd0d2f WatchSource:0}: Error finding container 10f29995be07c886a1f7b19600f4119cdfdcced006b66a08242e405008bd0d2f: Status 404 returned error can't find the container with id 10f29995be07c886a1f7b19600f4119cdfdcced006b66a08242e405008bd0d2f Jul 07 10:27:24.912966 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:24.912828 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b7985f2_f553_4967_91f4_df2de480701e.slice/crio-01f7f8fd454a2898ef27617c335f592ca0cf628ecdad7558f25d29c51447b03a WatchSource:0}: Error finding container 01f7f8fd454a2898ef27617c335f592ca0cf628ecdad7558f25d29c51447b03a: Status 404 returned error can't find the container with id 01f7f8fd454a2898ef27617c335f592ca0cf628ecdad7558f25d29c51447b03a Jul 07 10:27:25.228762 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.228730 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:25.228905 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.228798 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:25.228905 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:25.228882 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:25.228905 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:25.228884 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:25.229028 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:25.228936 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret podName:e1f3bd64-ddef-47d4-82bd-405034aac7b6 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:27.228922322 +0000 UTC m=+6.001515355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret") pod "global-pull-secret-syncer-4t7c8" (UID: "e1f3bd64-ddef-47d4-82bd-405034aac7b6") : object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:25.229028 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:25.228949 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs podName:3d6a8b5b-baaf-44ea-946e-90569b0de370 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:27.228943284 +0000 UTC m=+6.001536318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs") pod "network-metrics-daemon-sjkz4" (UID: "3d6a8b5b-baaf-44ea-946e-90569b0de370") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:25.430765 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.430684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkv5k\" (UniqueName: \"kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k\") pod \"network-check-target-m5bhq\" (UID: \"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb\") " pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:25.430915 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:25.430839 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 10:27:25.430915 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:25.430858 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 10:27:25.430915 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:25.430871 2566 projected.go:196] Error preparing data for projected volume kube-api-access-wkv5k for pod openshift-network-diagnostics/network-check-target-m5bhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:25.431072 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:25.430932 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k podName:aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb nodeName:}" failed. No retries permitted until 2026-07-07 10:27:27.430911062 +0000 UTC m=+6.203504100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkv5k" (UniqueName: "kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k") pod "network-check-target-m5bhq" (UID: "aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:25.642814 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.642755 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 10:22:23 +0000 UTC" deadline="2028-04-15 09:11:58.716949814 +0000 UTC" Jul 07 10:27:25.642814 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.642790 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15550h44m33.074164774s" Jul 07 10:27:25.711956 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.710931 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:25.711956 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:25.711068 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:25.711956 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.711478 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:25.711956 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:25.711566 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:25.711956 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.711627 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:25.711956 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:25.711698 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:25.738409 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.738382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lv72" event={"ID":"712e4eb9-17d6-40d8-a3a1-4e34deaddb46","Type":"ContainerStarted","Data":"8617ddcda5bb6c9f1422abf447bf9329370cd2ff2efc7ac4dbfb07082b09aa49"} Jul 07 10:27:25.744814 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.744789 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5xshq" event={"ID":"c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5","Type":"ContainerStarted","Data":"c8c89864850a92586f0637fb92060214f2def3d5876be8e12138ea92f901f8e2"} Jul 07 10:27:25.763691 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.763659 2566 generic.go:356] "Generic (PLEG): container finished" podID="58dadbf1a87814ee7db1b588f93747d1" containerID="4a176da9ecd10548c48700aceb3bf6c182482a76fa3057a72025fb57c8597225" exitCode=0 Jul 07 10:27:25.763917 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.763864 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" event={"ID":"58dadbf1a87814ee7db1b588f93747d1","Type":"ContainerDied","Data":"4a176da9ecd10548c48700aceb3bf6c182482a76fa3057a72025fb57c8597225"} Jul 07 10:27:25.794666 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.794636 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5x26k" event={"ID":"c0397ccc-cccd-49b7-8bae-bab90ec8156a","Type":"ContainerStarted","Data":"10f29995be07c886a1f7b19600f4119cdfdcced006b66a08242e405008bd0d2f"} Jul 07 10:27:25.802652 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.802626 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w82cv" event={"ID":"0be0643f-118f-44fb-ab9c-04b0a2bab952","Type":"ContainerStarted","Data":"536820d5500ec3b00f9b8f3bb1aa0f36d618cc1cdd3886eba70ba7cb6d323594"} Jul 07 10:27:25.819731 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.819661 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d5vcg" event={"ID":"7aa34fad-be27-460f-9462-24b73575e5b4","Type":"ContainerStarted","Data":"100a9693ab9862991f08e6ba426518ee16ff0f16ccbae359e9d7afc7776c9a39"} Jul 07 10:27:25.822943 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.822850 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" event={"ID":"6a2b5157-16f7-4f53-8fdd-b93f8a261aac","Type":"ContainerStarted","Data":"cadb6d35cb21f3fd505fdde7e3bb7018f6a4aff0df43cbebb7ef1fecc8352024"} Jul 07 10:27:25.840180 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.840086 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" event={"ID":"4576e808-2b7c-4cc6-b23d-bac002368c7f","Type":"ContainerStarted","Data":"8fa90a8337947016cd1a77f14c26d52e8556df82b96cb23c793ad9f5a25869ac"} Jul 07 10:27:25.856590 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.856377 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" event={"ID":"90a4ce6b5344e1b6a330df4dc8cc3efd","Type":"ContainerStarted","Data":"d39db3d0821656111e9594a7b8b6cecde49eaf53a9a34c8cea99ebf2b2dc13fc"} Jul 07 10:27:25.877587 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.877551 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" event={"ID":"7b7985f2-f553-4967-91f4-df2de480701e","Type":"ContainerStarted","Data":"01f7f8fd454a2898ef27617c335f592ca0cf628ecdad7558f25d29c51447b03a"} Jul 07 10:27:25.893049 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:25.892405 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zn24z" event={"ID":"9379b713-f601-4993-9695-95d111564321","Type":"ContainerStarted","Data":"dd1921bb72eba1096e4978a86f6dea00ad753b369eda785a06db02bed179b0e9"} Jul 07 10:27:26.908634 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:26.908567 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" event={"ID":"58dadbf1a87814ee7db1b588f93747d1","Type":"ContainerStarted","Data":"6f11ea0df0c22dda669b81211e32821e41abc385b6a4abceaeee332729ecc8ae"} Jul 07 10:27:26.937784 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:26.936608 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-59.ec2.internal" podStartSLOduration=3.9365863 podStartE2EDuration="3.9365863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:27:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:27:25.873329909 +0000 UTC m=+4.645922965" watchObservedRunningTime="2026-07-07 10:27:26.9365863 +0000 UTC m=+5.709179353" Jul 07 10:27:26.937784 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:26.936971 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-59.ec2.internal" podStartSLOduration=3.936963592 podStartE2EDuration="3.936963592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:27:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:27:26.935204884 +0000 UTC m=+5.707797940" watchObservedRunningTime="2026-07-07 10:27:26.936963592 +0000 UTC m=+5.709556649" Jul 07 10:27:27.246528 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:27.246449 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:27.246680 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:27.246542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:27.246680 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:27.246668 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:27.246777 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:27.246728 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret podName:e1f3bd64-ddef-47d4-82bd-405034aac7b6 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:31.24671069 +0000 UTC m=+10.019303730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret") pod "global-pull-secret-syncer-4t7c8" (UID: "e1f3bd64-ddef-47d4-82bd-405034aac7b6") : object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:27.247126 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:27.247107 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:27.247222 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:27.247179 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs podName:3d6a8b5b-baaf-44ea-946e-90569b0de370 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:31.247163023 +0000 UTC m=+10.019756072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs") pod "network-metrics-daemon-sjkz4" (UID: "3d6a8b5b-baaf-44ea-946e-90569b0de370") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:27.448634 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:27.448512 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkv5k\" (UniqueName: \"kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k\") pod \"network-check-target-m5bhq\" (UID: \"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb\") " pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:27.448917 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:27.448649 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 10:27:27.448917 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:27.448667 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 10:27:27.448917 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:27.448678 2566 projected.go:196] Error preparing data for projected volume kube-api-access-wkv5k for pod openshift-network-diagnostics/network-check-target-m5bhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:27.448917 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:27.448734 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k podName:aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb nodeName:}" failed. No retries permitted until 2026-07-07 10:27:31.448717281 +0000 UTC m=+10.221310314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkv5k" (UniqueName: "kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k") pod "network-check-target-m5bhq" (UID: "aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:27.709288 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:27.709256 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:27.709482 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:27.709387 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:27.709776 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:27.709757 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:27.709864 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:27.709847 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:27.711833 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:27.711801 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:27.711990 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:27.711908 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:29.711064 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:29.711033 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:29.711540 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:29.711162 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:29.711540 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:29.711238 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:29.711540 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:29.711327 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:29.711540 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:29.711367 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:29.711540 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:29.711428 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:31.282605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:31.282281 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:31.282605 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:31.282379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:31.282605 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:31.282449 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:31.282605 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:31.282507 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret podName:e1f3bd64-ddef-47d4-82bd-405034aac7b6 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:39.282492001 +0000 UTC m=+18.055085061 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret") pod "global-pull-secret-syncer-4t7c8" (UID: "e1f3bd64-ddef-47d4-82bd-405034aac7b6") : object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:31.282605 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:31.282518 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:31.282605 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:31.282575 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs podName:3d6a8b5b-baaf-44ea-946e-90569b0de370 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:39.282555548 +0000 UTC m=+18.055148595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs") pod "network-metrics-daemon-sjkz4" (UID: "3d6a8b5b-baaf-44ea-946e-90569b0de370") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:31.483934 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:31.483894 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkv5k\" (UniqueName: \"kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k\") pod \"network-check-target-m5bhq\" (UID: \"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb\") " pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:31.484119 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:31.484017 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 10:27:31.484119 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:31.484034 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 10:27:31.484119 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:31.484063 2566 projected.go:196] Error preparing data for projected volume kube-api-access-wkv5k for pod openshift-network-diagnostics/network-check-target-m5bhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:31.484119 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:31.484113 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k podName:aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb nodeName:}" failed. No retries permitted until 2026-07-07 10:27:39.484100752 +0000 UTC m=+18.256693785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkv5k" (UniqueName: "kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k") pod "network-check-target-m5bhq" (UID: "aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:31.710314 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:31.710279 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:31.710529 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:31.710401 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:31.710529 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:31.710417 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:31.710700 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:31.710546 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:31.710700 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:31.710577 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:31.710700 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:31.710649 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:33.710525 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:33.710489 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:33.710989 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:33.710616 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:33.711064 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:33.711007 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:33.711138 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:33.711114 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:33.711286 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:33.711260 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:33.711380 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:33.711342 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:35.709036 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:35.709004 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:35.709036 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:35.709023 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:35.709036 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:35.709035 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:35.709517 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:35.709114 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:35.709517 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:35.709259 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:35.709517 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:35.709339 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:37.709640 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:37.709596 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:37.709640 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:37.709620 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:37.710215 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:37.709734 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:37.710215 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:37.709798 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:37.710215 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:37.709862 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:37.710215 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:37.709933 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:39.344991 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:39.344961 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:39.345511 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:39.345038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:39.345511 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:39.345106 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:39.345511 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:39.345122 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:39.345511 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:39.345181 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs podName:3d6a8b5b-baaf-44ea-946e-90569b0de370 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:55.345162591 +0000 UTC m=+34.117755637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs") pod "network-metrics-daemon-sjkz4" (UID: "3d6a8b5b-baaf-44ea-946e-90569b0de370") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:39.345511 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:39.345195 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret podName:e1f3bd64-ddef-47d4-82bd-405034aac7b6 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:55.345188855 +0000 UTC m=+34.117781888 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret") pod "global-pull-secret-syncer-4t7c8" (UID: "e1f3bd64-ddef-47d4-82bd-405034aac7b6") : object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:39.546261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:39.546213 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkv5k\" (UniqueName: \"kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k\") pod \"network-check-target-m5bhq\" (UID: \"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb\") " pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:39.546454 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:39.546425 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 10:27:39.546454 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:39.546449 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 10:27:39.546532 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:39.546460 2566 projected.go:196] Error preparing data for projected volume kube-api-access-wkv5k for pod openshift-network-diagnostics/network-check-target-m5bhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:39.546532 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:39.546521 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k podName:aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb nodeName:}" failed. No retries permitted until 2026-07-07 10:27:55.546505903 +0000 UTC m=+34.319098936 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkv5k" (UniqueName: "kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k") pod "network-check-target-m5bhq" (UID: "aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:39.710178 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:39.709546 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:39.710178 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:39.709675 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:39.710178 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:39.709558 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:39.710178 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:39.709751 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:39.710178 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:39.709546 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:39.710178 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:39.709800 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:41.710363 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:41.710312 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:41.710877 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:41.710463 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:41.710877 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:41.710478 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:41.710877 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:41.710554 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:41.710877 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:41.710594 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:41.710877 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:41.710682 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:43.708860 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:43.708818 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:43.708860 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:43.708853 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:43.709461 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:43.708939 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:43.709528 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:43.709475 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:43.709712 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:43.708950 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:43.711495 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:43.710289 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:43.946867 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:43.946658 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" event={"ID":"7b7985f2-f553-4967-91f4-df2de480701e","Type":"ContainerStarted","Data":"07226296658e88cef76647fee9ec8007cf9b851daea487598c5841e33d010894"} Jul 07 10:27:43.951791 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:43.951295 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zn24z" event={"ID":"9379b713-f601-4993-9695-95d111564321","Type":"ContainerStarted","Data":"d88d646b0dc3d1a29a912470e9e2defac906d3332f5497b771db33a6c5db03f5"} Jul 07 10:27:43.956487 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:43.956215 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5x26k" event={"ID":"c0397ccc-cccd-49b7-8bae-bab90ec8156a","Type":"ContainerStarted","Data":"1679005f46c423841533ccbbba55cc5530b67d0d1bd2ae01559b1d58472a29a2"} Jul 07 10:27:43.971471 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:43.971354 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5fhfr" podStartSLOduration=4.127126821 podStartE2EDuration="22.971332048s" totalImagesPullingTime="18.844205227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:27:43.970559859 +0000 UTC m=+22.743152926" watchObservedRunningTime="2026-07-07 10:27:43.971332048 +0000 UTC m=+22.743925103" Jul 07 10:27:43.990612 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:43.990564 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5x26k" podStartSLOduration=4.083967457 podStartE2EDuration="22.990548062s" totalImagesPullingTime="18.906580605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:27:43.98987724 +0000 UTC m=+22.762470296" watchObservedRunningTime="2026-07-07 10:27:43.990548062 +0000 UTC m=+22.763141117" Jul 07 10:27:44.935018 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.934842 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:44.935808 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.935423 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:44.959995 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.959966 2566 generic.go:356] "Generic (PLEG): container finished" podID="712e4eb9-17d6-40d8-a3a1-4e34deaddb46" containerID="db30fbcb7d679883b661be2c54a1da9f8afe2053c671777baecf71e97f72d32f" exitCode=0 Jul 07 10:27:44.960125 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.960043 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lv72" event={"ID":"712e4eb9-17d6-40d8-a3a1-4e34deaddb46","Type":"ContainerDied","Data":"db30fbcb7d679883b661be2c54a1da9f8afe2053c671777baecf71e97f72d32f"} Jul 07 10:27:44.961507 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.961484 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5xshq" event={"ID":"c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5","Type":"ContainerStarted","Data":"7b40f076f90e7e9c88f97c4f7e25ba44bf88eafcd90ab220546b15e55a8155d9"} Jul 07 10:27:44.962939 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.962918 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d5vcg" event={"ID":"7aa34fad-be27-460f-9462-24b73575e5b4","Type":"ContainerStarted","Data":"fc262fb70c796c3835ca7ebfd51321f88960c248ee9caf85a69b37cca3735087"} Jul 07 10:27:44.965626 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.965598 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" event={"ID":"6a2b5157-16f7-4f53-8fdd-b93f8a261aac","Type":"ContainerStarted","Data":"3a3fbde6a6e2ca07e420359e6f72f2d6319c46c0dc3923fcf41ad7585157edbe"} Jul 07 10:27:44.965717 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.965658 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" event={"ID":"6a2b5157-16f7-4f53-8fdd-b93f8a261aac","Type":"ContainerStarted","Data":"55ac4978ad9328d305938bf5a5983b41f64b59a9c7638a5eced50fb2504965bc"} Jul 07 10:27:44.965717 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.965691 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" event={"ID":"6a2b5157-16f7-4f53-8fdd-b93f8a261aac","Type":"ContainerStarted","Data":"ccb7280d53c90f72e8fd35dbf39221825c08f382f9e5392352090d0cca93bbc0"} Jul 07 10:27:44.965829 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.965751 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" event={"ID":"6a2b5157-16f7-4f53-8fdd-b93f8a261aac","Type":"ContainerStarted","Data":"3d6a660672ab6f63f4b519a4ea4d6849d6d570e22f9ddf92277a469bbe4d4d62"} Jul 07 10:27:44.965829 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.965792 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" event={"ID":"6a2b5157-16f7-4f53-8fdd-b93f8a261aac","Type":"ContainerStarted","Data":"72b3c49df28181d6c99483214cbc41c74220597c23645974f5e169e9b2929707"} Jul 07 10:27:44.965829 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.965820 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" event={"ID":"6a2b5157-16f7-4f53-8fdd-b93f8a261aac","Type":"ContainerStarted","Data":"47c965810050c6dda025a9b16b9456d80908863fe02caf074a34314fe4af1ead"} Jul 07 10:27:44.966986 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.966967 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" event={"ID":"4576e808-2b7c-4cc6-b23d-bac002368c7f","Type":"ContainerStarted","Data":"a588d14ccf83d8fad4ac4ef120eb19e63c29f3058942cd66f03c3f588da23a60"} Jul 07 10:27:44.968276 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.968240 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zn24z" podStartSLOduration=9.534027819 podStartE2EDuration="23.968228674s" totalImagesPullingTime="14.434200855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:27:44.008371214 +0000 UTC m=+22.780964270" watchObservedRunningTime="2026-07-07 10:27:44.968228674 +0000 UTC m=+23.740821728" Jul 07 10:27:44.997947 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:44.997909 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d5vcg" podStartSLOduration=5.148194333 podStartE2EDuration="23.997896438s" totalImagesPullingTime="18.849702105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:27:44.997841587 +0000 UTC m=+23.770434644" watchObservedRunningTime="2026-07-07 10:27:44.997896438 +0000 UTC m=+23.770489495" Jul 07 10:27:45.047888 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.047855 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5xshq" podStartSLOduration=5.199915966 podStartE2EDuration="24.047842593s" totalImagesPullingTime="18.847926627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:27:45.0192948 +0000 UTC m=+23.791887856" watchObservedRunningTime="2026-07-07 10:27:45.047842593 +0000 UTC m=+23.820435753" Jul 07 10:27:45.314198 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.314166 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 10:27:45.676169 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.675927 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T10:27:45.314183742Z","UUID":"c71f9c36-3a3a-4ae7-8c7d-cbe8ea7dd335","Handler":null,"Name":"","Endpoint":""} Jul 07 10:27:45.677594 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.677567 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 10:27:45.677719 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.677603 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 10:27:45.709176 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.709137 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:45.709353 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.709214 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:45.709353 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.709228 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:45.709353 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:45.709328 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:45.709512 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:45.709373 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:45.709512 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:45.709457 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:45.971479 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.971383 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w82cv" event={"ID":"0be0643f-118f-44fb-ab9c-04b0a2bab952","Type":"ContainerStarted","Data":"49ef47dc1e46b7d0ac4d14f594365dd41559f4d9f331b304c93f235225db376d"} Jul 07 10:27:45.973322 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.973300 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 10:27:45.973492 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.973336 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" event={"ID":"4576e808-2b7c-4cc6-b23d-bac002368c7f","Type":"ContainerStarted","Data":"ad84e496c68fe641957d7806c613d51d1747da90bb27fcf2cee3d6f1c987b998"} Jul 07 10:27:45.989576 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:45.989530 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w82cv" podStartSLOduration=6.142236859 podStartE2EDuration="24.989512592s" totalImagesPullingTime="18.847275733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:27:45.989028318 +0000 UTC m=+24.761621376" watchObservedRunningTime="2026-07-07 10:27:45.989512592 +0000 UTC m=+24.762105648" Jul 07 10:27:46.978922 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:46.978665 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" event={"ID":"4576e808-2b7c-4cc6-b23d-bac002368c7f","Type":"ContainerStarted","Data":"2aaab19fcbe77e88b3d60e6da76dea8ab62cce9d645bd220a963e09e7287dc32"} Jul 07 10:27:46.982887 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:46.982861 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" event={"ID":"6a2b5157-16f7-4f53-8fdd-b93f8a261aac","Type":"ContainerStarted","Data":"6acf27edd021873d284230dbeee8cdfa19596da6d146628c8e227adf5ceb1f11"} Jul 07 10:27:46.998429 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:46.998383 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jg2vv" podStartSLOduration=13.111612352 podStartE2EDuration="25.998368372s" totalImagesPullingTime="12.88675602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:27:46.997926582 +0000 UTC m=+25.770519637" watchObservedRunningTime="2026-07-07 10:27:46.998368372 +0000 UTC m=+25.770961428" Jul 07 10:27:47.709202 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:47.709161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:47.709429 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:47.709169 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:47.709429 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:47.709299 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:47.709429 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:47.709169 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:47.709429 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:47.709348 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:47.709429 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:47.709414 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:49.708885 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:49.708850 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:49.709547 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:49.708856 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:49.709547 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:49.708976 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:49.709547 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:49.708989 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:49.709547 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:49.709094 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:49.709547 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:49.709192 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:50.995450 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:50.995240 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" event={"ID":"6a2b5157-16f7-4f53-8fdd-b93f8a261aac","Type":"ContainerStarted","Data":"b51caa13375f420ded230d3aa9d0de3523893892fda6c323bde56a30f4033a3f"} Jul 07 10:27:50.996030 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:50.995545 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:50.996030 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:50.995586 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:50.997231 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:50.997200 2566 generic.go:356] "Generic (PLEG): container finished" podID="712e4eb9-17d6-40d8-a3a1-4e34deaddb46" containerID="fc3598299e3fbe50b893ce78e8fbbf749446feb52e1abaec8976f0c39a69f85c" exitCode=0 Jul 07 10:27:50.997332 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:50.997243 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lv72" event={"ID":"712e4eb9-17d6-40d8-a3a1-4e34deaddb46","Type":"ContainerDied","Data":"fc3598299e3fbe50b893ce78e8fbbf749446feb52e1abaec8976f0c39a69f85c"} Jul 07 10:27:51.012118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:51.012096 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:51.028187 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:51.028124 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" podStartSLOduration=11.102070371 podStartE2EDuration="30.028111423s" totalImagesPullingTime="18.926041052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:27:51.027734787 +0000 UTC m=+29.800327842" watchObservedRunningTime="2026-07-07 10:27:51.028111423 +0000 UTC m=+29.800704477" Jul 07 10:27:51.710290 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:51.710253 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:51.710533 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:51.710331 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:51.710533 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:51.710341 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:51.710533 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:51.710431 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:51.710533 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:51.710491 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:51.710713 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:51.710570 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:52.000297 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:52.000128 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:52.015223 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:52.015197 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:27:52.307426 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:52.307397 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:52.307709 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:52.307518 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 10:27:52.307966 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:52.307948 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zn24z" Jul 07 10:27:52.613231 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:52.612994 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sjkz4"] Jul 07 10:27:52.613387 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:52.613287 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:52.613451 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:52.613404 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:52.618689 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:52.618662 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4t7c8"] Jul 07 10:27:52.618835 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:52.618746 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:52.618908 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:52.618841 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:52.619248 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:52.619229 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m5bhq"] Jul 07 10:27:52.619317 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:52.619311 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:52.619387 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:52.619372 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:53.006656 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:53.006564 2566 generic.go:356] "Generic (PLEG): container finished" podID="712e4eb9-17d6-40d8-a3a1-4e34deaddb46" containerID="88ee12293eb7200be58edb1da3ac6d1183354d4dc19b212e4d8572faf9fa81bd" exitCode=0 Jul 07 10:27:53.006656 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:53.006614 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lv72" event={"ID":"712e4eb9-17d6-40d8-a3a1-4e34deaddb46","Type":"ContainerDied","Data":"88ee12293eb7200be58edb1da3ac6d1183354d4dc19b212e4d8572faf9fa81bd"} Jul 07 10:27:54.709329 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:54.709296 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:54.709917 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:54.709296 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:54.709917 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:54.709407 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjkz4" podUID="3d6a8b5b-baaf-44ea-946e-90569b0de370" Jul 07 10:27:54.709917 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:54.709296 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:54.709917 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:54.709480 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4t7c8" podUID="e1f3bd64-ddef-47d4-82bd-405034aac7b6" Jul 07 10:27:54.709917 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:54.709545 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m5bhq" podUID="aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb" Jul 07 10:27:55.015654 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:55.015574 2566 generic.go:356] "Generic (PLEG): container finished" podID="712e4eb9-17d6-40d8-a3a1-4e34deaddb46" containerID="6048202a24841e7522c72e036607e8f592e707d0bab0991004ef88c4b0ac3ab0" exitCode=0 Jul 07 10:27:55.015654 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:55.015625 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lv72" event={"ID":"712e4eb9-17d6-40d8-a3a1-4e34deaddb46","Type":"ContainerDied","Data":"6048202a24841e7522c72e036607e8f592e707d0bab0991004ef88c4b0ac3ab0"} Jul 07 10:27:55.365851 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:55.365817 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:55.366058 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:55.365861 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:55.366058 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:55.365954 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:55.366058 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:55.365973 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:55.366058 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:55.366003 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs podName:3d6a8b5b-baaf-44ea-946e-90569b0de370 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:27.365991282 +0000 UTC m=+66.138584314 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs") pod "network-metrics-daemon-sjkz4" (UID: "3d6a8b5b-baaf-44ea-946e-90569b0de370") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 10:27:55.366058 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:55.366034 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret podName:e1f3bd64-ddef-47d4-82bd-405034aac7b6 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:27.366017691 +0000 UTC m=+66.138610728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret") pod "global-pull-secret-syncer-4t7c8" (UID: "e1f3bd64-ddef-47d4-82bd-405034aac7b6") : object "kube-system"/"original-pull-secret" not registered Jul 07 10:27:55.566865 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:55.566826 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkv5k\" (UniqueName: \"kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k\") pod \"network-check-target-m5bhq\" (UID: \"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb\") " pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:55.567031 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:55.566981 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 10:27:55.567031 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:55.567002 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 10:27:55.567031 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:55.567012 2566 projected.go:196] Error preparing data for projected volume kube-api-access-wkv5k for pod openshift-network-diagnostics/network-check-target-m5bhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:55.567168 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:55.567059 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k podName:aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb nodeName:}" failed. No retries permitted until 2026-07-07 10:28:27.567044903 +0000 UTC m=+66.339637937 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkv5k" (UniqueName: "kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k") pod "network-check-target-m5bhq" (UID: "aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 10:27:56.547084 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.545903 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-59.ec2.internal" event="NodeReady" Jul 07 10:27:56.547084 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.546051 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 10:27:56.590628 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.590595 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dvvp6"] Jul 07 10:27:56.592542 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.592525 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.595355 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.595329 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 10:27:56.595486 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.595422 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wq5jm\"" Jul 07 10:27:56.595728 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.595703 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 10:27:56.596203 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.596187 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-86ndf"] Jul 07 10:27:56.599947 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.599933 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-86ndf" Jul 07 10:27:56.602465 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.602442 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mdcws\"" Jul 07 10:27:56.602550 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.602500 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 10:27:56.602550 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.602442 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 10:27:56.602671 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.602598 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 10:27:56.607348 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.607327 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dvvp6"] Jul 07 10:27:56.609061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.609038 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-86ndf"] Jul 07 10:27:56.675772 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.675744 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgdhp\" (UniqueName: \"kubernetes.io/projected/aa8416e1-ce47-4760-b121-924aa3b1d346-kube-api-access-xgdhp\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.675772 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.675775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.676071 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.675797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8416e1-ce47-4760-b121-924aa3b1d346-tmp-dir\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.676071 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.675827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/798adf2c-b8c3-4d94-bdf2-39d781d3420b-cert\") pod \"ingress-canary-86ndf\" (UID: \"798adf2c-b8c3-4d94-bdf2-39d781d3420b\") " pod="openshift-ingress-canary/ingress-canary-86ndf" Jul 07 10:27:56.676071 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.675856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfhq2\" (UniqueName: \"kubernetes.io/projected/798adf2c-b8c3-4d94-bdf2-39d781d3420b-kube-api-access-hfhq2\") pod \"ingress-canary-86ndf\" (UID: \"798adf2c-b8c3-4d94-bdf2-39d781d3420b\") " pod="openshift-ingress-canary/ingress-canary-86ndf" Jul 07 10:27:56.676071 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.675926 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa8416e1-ce47-4760-b121-924aa3b1d346-config-volume\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.709013 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.708987 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:27:56.709129 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.709070 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:27:56.709129 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.709095 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:27:56.712040 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.712018 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 10:27:56.712185 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.712168 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 10:27:56.712275 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.712250 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 10:27:56.712405 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.712321 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qdqsn\"" Jul 07 10:27:56.712405 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.712331 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 10:27:56.712520 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.712509 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-68x57\"" Jul 07 10:27:56.776410 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.776377 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa8416e1-ce47-4760-b121-924aa3b1d346-config-volume\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.776568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.776480 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgdhp\" (UniqueName: \"kubernetes.io/projected/aa8416e1-ce47-4760-b121-924aa3b1d346-kube-api-access-xgdhp\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.776568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.776513 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.776568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.776535 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8416e1-ce47-4760-b121-924aa3b1d346-tmp-dir\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.776568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.776569 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/798adf2c-b8c3-4d94-bdf2-39d781d3420b-cert\") pod \"ingress-canary-86ndf\" (UID: \"798adf2c-b8c3-4d94-bdf2-39d781d3420b\") " pod="openshift-ingress-canary/ingress-canary-86ndf" Jul 07 10:27:56.776754 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.776591 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfhq2\" (UniqueName: \"kubernetes.io/projected/798adf2c-b8c3-4d94-bdf2-39d781d3420b-kube-api-access-hfhq2\") pod \"ingress-canary-86ndf\" (UID: \"798adf2c-b8c3-4d94-bdf2-39d781d3420b\") " pod="openshift-ingress-canary/ingress-canary-86ndf" Jul 07 10:27:56.777229 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:56.777209 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 10:27:56.777331 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:56.777283 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls podName:aa8416e1-ce47-4760-b121-924aa3b1d346 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:57.277262591 +0000 UTC m=+36.049855624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls") pod "dns-default-dvvp6" (UID: "aa8416e1-ce47-4760-b121-924aa3b1d346") : secret "dns-default-metrics-tls" not found Jul 07 10:27:56.777395 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.777377 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa8416e1-ce47-4760-b121-924aa3b1d346-config-volume\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.777486 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.777458 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8416e1-ce47-4760-b121-924aa3b1d346-tmp-dir\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.782228 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.782211 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/798adf2c-b8c3-4d94-bdf2-39d781d3420b-cert\") pod \"ingress-canary-86ndf\" (UID: \"798adf2c-b8c3-4d94-bdf2-39d781d3420b\") " pod="openshift-ingress-canary/ingress-canary-86ndf" Jul 07 10:27:56.787132 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.787109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfhq2\" (UniqueName: \"kubernetes.io/projected/798adf2c-b8c3-4d94-bdf2-39d781d3420b-kube-api-access-hfhq2\") pod \"ingress-canary-86ndf\" (UID: \"798adf2c-b8c3-4d94-bdf2-39d781d3420b\") " pod="openshift-ingress-canary/ingress-canary-86ndf" Jul 07 10:27:56.787258 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.787237 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgdhp\" (UniqueName: \"kubernetes.io/projected/aa8416e1-ce47-4760-b121-924aa3b1d346-kube-api-access-xgdhp\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:56.910614 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:56.910530 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-86ndf" Jul 07 10:27:57.059392 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:57.059156 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-86ndf"] Jul 07 10:27:57.063681 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:27:57.063648 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798adf2c_b8c3_4d94_bdf2_39d781d3420b.slice/crio-ad6721391a28523f1b5007f35a96fb79b01f0a6b5f326b03d46c9e605c4c7ac4 WatchSource:0}: Error finding container ad6721391a28523f1b5007f35a96fb79b01f0a6b5f326b03d46c9e605c4c7ac4: Status 404 returned error can't find the container with id ad6721391a28523f1b5007f35a96fb79b01f0a6b5f326b03d46c9e605c4c7ac4 Jul 07 10:27:57.281254 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:57.281166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:57.281399 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:57.281310 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 10:27:57.281399 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:57.281381 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls podName:aa8416e1-ce47-4760-b121-924aa3b1d346 nodeName:}" failed. No retries permitted until 2026-07-07 10:27:58.28136112 +0000 UTC m=+37.053954154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls") pod "dns-default-dvvp6" (UID: "aa8416e1-ce47-4760-b121-924aa3b1d346") : secret "dns-default-metrics-tls" not found Jul 07 10:27:58.024896 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:58.024857 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-86ndf" event={"ID":"798adf2c-b8c3-4d94-bdf2-39d781d3420b","Type":"ContainerStarted","Data":"ad6721391a28523f1b5007f35a96fb79b01f0a6b5f326b03d46c9e605c4c7ac4"} Jul 07 10:27:58.287618 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:27:58.287529 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:27:58.287786 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:58.287705 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 10:27:58.287786 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:27:58.287781 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls podName:aa8416e1-ce47-4760-b121-924aa3b1d346 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:00.287760934 +0000 UTC m=+39.060353971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls") pod "dns-default-dvvp6" (UID: "aa8416e1-ce47-4760-b121-924aa3b1d346") : secret "dns-default-metrics-tls" not found Jul 07 10:28:00.302013 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:00.301972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:28:00.302449 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:00.302120 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 10:28:00.302449 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:00.302200 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls podName:aa8416e1-ce47-4760-b121-924aa3b1d346 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:04.30218367 +0000 UTC m=+43.074776704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls") pod "dns-default-dvvp6" (UID: "aa8416e1-ce47-4760-b121-924aa3b1d346") : secret "dns-default-metrics-tls" not found Jul 07 10:28:02.036922 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:02.036882 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-86ndf" event={"ID":"798adf2c-b8c3-4d94-bdf2-39d781d3420b","Type":"ContainerStarted","Data":"90e6905e897230f462db863908d194e9e445028b902f8fdb96d0fc6abbab2e1e"} Jul 07 10:28:02.039774 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:02.039743 2566 generic.go:356] "Generic (PLEG): container finished" podID="712e4eb9-17d6-40d8-a3a1-4e34deaddb46" containerID="16fe218cedc04896b620ff5e4f717038c40bf13dbeda9c5d26891cfa6c82eb83" exitCode=0 Jul 07 10:28:02.039899 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:02.039794 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lv72" event={"ID":"712e4eb9-17d6-40d8-a3a1-4e34deaddb46","Type":"ContainerDied","Data":"16fe218cedc04896b620ff5e4f717038c40bf13dbeda9c5d26891cfa6c82eb83"} Jul 07 10:28:02.056259 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:02.056199 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-86ndf" podStartSLOduration=1.81658965 podStartE2EDuration="6.056181439s" totalImagesPullingTime="4.239591789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:02.055397803 +0000 UTC m=+40.827990858" watchObservedRunningTime="2026-07-07 10:28:02.056181439 +0000 UTC m=+40.828774495" Jul 07 10:28:03.044934 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:03.044896 2566 generic.go:356] "Generic (PLEG): container finished" podID="712e4eb9-17d6-40d8-a3a1-4e34deaddb46" containerID="cd6c503f2298c754a71759a56e12d970691e44a6ae0e1b2569844162bc23d105" exitCode=0 Jul 07 10:28:03.045352 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:03.044977 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lv72" event={"ID":"712e4eb9-17d6-40d8-a3a1-4e34deaddb46","Type":"ContainerDied","Data":"cd6c503f2298c754a71759a56e12d970691e44a6ae0e1b2569844162bc23d105"} Jul 07 10:28:04.050775 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:04.050736 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lv72" event={"ID":"712e4eb9-17d6-40d8-a3a1-4e34deaddb46","Type":"ContainerStarted","Data":"ccc0a62f47a6cb9ad94b0b50d4e0b23af3515f95d52642e4aebe820f47dfb305"} Jul 07 10:28:04.077058 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:04.077002 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5lv72" podStartSLOduration=10.383127716 podStartE2EDuration="43.076983116s" totalImagesPullingTime="32.6938554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:04.07517667 +0000 UTC m=+42.847769721" watchObservedRunningTime="2026-07-07 10:28:04.076983116 +0000 UTC m=+42.849576171" Jul 07 10:28:04.330578 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:04.330475 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:28:04.330729 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:04.330623 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 10:28:04.330729 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:04.330689 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls podName:aa8416e1-ce47-4760-b121-924aa3b1d346 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:12.330672651 +0000 UTC m=+51.103265690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls") pod "dns-default-dvvp6" (UID: "aa8416e1-ce47-4760-b121-924aa3b1d346") : secret "dns-default-metrics-tls" not found Jul 07 10:28:04.982281 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:04.982246 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k"] Jul 07 10:28:05.008374 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.008344 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k"] Jul 07 10:28:05.008511 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.008434 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:05.010977 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.010953 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 10:28:05.011105 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.010979 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 10:28:05.011105 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.010978 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lptd2\"" Jul 07 10:28:05.011105 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.011066 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 10:28:05.013977 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.013957 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 10:28:05.083722 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.083692 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lvjn6"] Jul 07 10:28:05.104523 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.104499 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74947bff46-rs9lw"] Jul 07 10:28:05.104671 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.104639 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.107528 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.107509 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 10:28:05.107678 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.107510 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 10:28:05.107798 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.107782 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 10:28:05.107868 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.107820 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-prnpg\"" Jul 07 10:28:05.108817 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.108794 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 10:28:05.114552 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.114529 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 10:28:05.120411 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.120390 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lvjn6"] Jul 07 10:28:05.120526 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.120417 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74947bff46-rs9lw"] Jul 07 10:28:05.120526 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.120515 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.134539 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.124591 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 10:28:05.134539 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.124845 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 10:28:05.134539 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.125020 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 10:28:05.134539 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.125205 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tvxzc\"" Jul 07 10:28:05.136432 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.136406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4e941db7-7c0b-41d2-a2f7-9c86142ec435-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:05.136623 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.136604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:05.136843 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.136824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8lq5\" (UniqueName: \"kubernetes.io/projected/4e941db7-7c0b-41d2-a2f7-9c86142ec435-kube-api-access-r8lq5\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:05.137289 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.136566 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 10:28:05.237392 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237312 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4e941db7-7c0b-41d2-a2f7-9c86142ec435-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:05.237392 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237352 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:05.237617 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:05.237458 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:05.237617 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:05.237519 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls podName:4e941db7-7c0b-41d2-a2f7-9c86142ec435 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:05.737503524 +0000 UTC m=+44.510096557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9j7k" (UID: "4e941db7-7c0b-41d2-a2f7-9c86142ec435") : secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:05.237617 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237551 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8lq5\" (UniqueName: \"kubernetes.io/projected/4e941db7-7c0b-41d2-a2f7-9c86142ec435-kube-api-access-r8lq5\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:05.237617 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237600 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-bound-sa-token\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.237820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237649 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d6d25c2-a30c-4131-8a22-604414cd0f2f-config\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.237820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237681 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-trusted-ca\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.237820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237709 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d6d25c2-a30c-4131-8a22-604414cd0f2f-serving-cert\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.237820 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237799 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-image-registry-private-configuration\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.237967 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237859 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d6d25c2-a30c-4131-8a22-604414cd0f2f-trusted-ca\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.237967 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kpkp\" (UniqueName: \"kubernetes.io/projected/2d6d25c2-a30c-4131-8a22-604414cd0f2f-kube-api-access-4kpkp\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.237967 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237899 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.237967 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237913 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-certificates\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.237967 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237934 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-installation-pull-secrets\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.238173 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.237987 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3240e4a-fbec-452c-b218-35b21002a1d3-ca-trust-extracted\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.238173 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.238015 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th8xk\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-kube-api-access-th8xk\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.238244 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.238205 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4e941db7-7c0b-41d2-a2f7-9c86142ec435-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:05.249165 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.249118 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8lq5\" (UniqueName: \"kubernetes.io/projected/4e941db7-7c0b-41d2-a2f7-9c86142ec435-kube-api-access-r8lq5\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:05.338503 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338460 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-image-registry-private-configuration\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.338671 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338536 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d6d25c2-a30c-4131-8a22-604414cd0f2f-trusted-ca\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.338671 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338564 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kpkp\" (UniqueName: \"kubernetes.io/projected/2d6d25c2-a30c-4131-8a22-604414cd0f2f-kube-api-access-4kpkp\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.338671 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338586 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.338671 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338609 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-certificates\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.338671 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338630 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-installation-pull-secrets\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.338671 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338656 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3240e4a-fbec-452c-b218-35b21002a1d3-ca-trust-extracted\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.338968 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338680 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8xk\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-kube-api-access-th8xk\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.338968 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:05.338721 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 10:28:05.338968 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:05.338742 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74947bff46-rs9lw: secret "image-registry-tls" not found Jul 07 10:28:05.338968 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-bound-sa-token\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.338968 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338789 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d6d25c2-a30c-4131-8a22-604414cd0f2f-config\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.338968 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338817 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-trusted-ca\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.338968 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.338847 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d6d25c2-a30c-4131-8a22-604414cd0f2f-serving-cert\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.339333 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:05.339065 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls podName:a3240e4a-fbec-452c-b218-35b21002a1d3 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:05.83903617 +0000 UTC m=+44.611629202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls") pod "image-registry-74947bff46-rs9lw" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3") : secret "image-registry-tls" not found Jul 07 10:28:05.339399 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.339370 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-certificates\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.339399 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.339360 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3240e4a-fbec-452c-b218-35b21002a1d3-ca-trust-extracted\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.339711 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.339650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d6d25c2-a30c-4131-8a22-604414cd0f2f-config\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.339912 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.339885 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d6d25c2-a30c-4131-8a22-604414cd0f2f-trusted-ca\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.339967 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.339948 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-trusted-ca\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.341540 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.341520 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-installation-pull-secrets\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.341689 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.341672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d6d25c2-a30c-4131-8a22-604414cd0f2f-serving-cert\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.341748 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.341737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-image-registry-private-configuration\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.348200 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.348173 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kpkp\" (UniqueName: \"kubernetes.io/projected/2d6d25c2-a30c-4131-8a22-604414cd0f2f-kube-api-access-4kpkp\") pod \"console-operator-68b757fb67-lvjn6\" (UID: \"2d6d25c2-a30c-4131-8a22-604414cd0f2f\") " pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.348800 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.348782 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-bound-sa-token\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.349335 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.349315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th8xk\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-kube-api-access-th8xk\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.416810 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.416779 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:05.567454 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.567420 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lvjn6"] Jul 07 10:28:05.570489 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:05.570466 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6d25c2_a30c_4131_8a22_604414cd0f2f.slice/crio-1a280d75f6e55fad52a1195f8dec13e356fc6a06f212a5c524de768df3cb8b97 WatchSource:0}: Error finding container 1a280d75f6e55fad52a1195f8dec13e356fc6a06f212a5c524de768df3cb8b97: Status 404 returned error can't find the container with id 1a280d75f6e55fad52a1195f8dec13e356fc6a06f212a5c524de768df3cb8b97 Jul 07 10:28:05.741797 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.741724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:05.741929 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:05.741833 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:05.741929 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:05.741882 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls podName:4e941db7-7c0b-41d2-a2f7-9c86142ec435 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:06.741868603 +0000 UTC m=+45.514461636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9j7k" (UID: "4e941db7-7c0b-41d2-a2f7-9c86142ec435") : secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:05.842546 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:05.842510 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:05.842703 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:05.842630 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 10:28:05.842703 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:05.842641 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74947bff46-rs9lw: secret "image-registry-tls" not found Jul 07 10:28:05.842777 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:05.842709 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls podName:a3240e4a-fbec-452c-b218-35b21002a1d3 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:06.842686523 +0000 UTC m=+45.615279555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls") pod "image-registry-74947bff46-rs9lw" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3") : secret "image-registry-tls" not found Jul 07 10:28:06.056802 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:06.056756 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" event={"ID":"2d6d25c2-a30c-4131-8a22-604414cd0f2f","Type":"ContainerStarted","Data":"1a280d75f6e55fad52a1195f8dec13e356fc6a06f212a5c524de768df3cb8b97"} Jul 07 10:28:06.750682 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:06.750639 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:06.751080 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:06.750791 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:06.751080 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:06.750858 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls podName:4e941db7-7c0b-41d2-a2f7-9c86142ec435 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:08.750840839 +0000 UTC m=+47.523433878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9j7k" (UID: "4e941db7-7c0b-41d2-a2f7-9c86142ec435") : secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:06.851903 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:06.851867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:06.852103 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:06.852004 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 10:28:06.852103 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:06.852016 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74947bff46-rs9lw: secret "image-registry-tls" not found Jul 07 10:28:06.852103 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:06.852073 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls podName:a3240e4a-fbec-452c-b218-35b21002a1d3 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:08.852054742 +0000 UTC m=+47.624647780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls") pod "image-registry-74947bff46-rs9lw" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3") : secret "image-registry-tls" not found Jul 07 10:28:08.765720 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:08.765675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:08.766123 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:08.765828 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:08.766123 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:08.765898 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls podName:4e941db7-7c0b-41d2-a2f7-9c86142ec435 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:12.765881661 +0000 UTC m=+51.538474693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9j7k" (UID: "4e941db7-7c0b-41d2-a2f7-9c86142ec435") : secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:08.866524 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:08.866495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:08.866661 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:08.866643 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 10:28:08.866700 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:08.866663 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74947bff46-rs9lw: secret "image-registry-tls" not found Jul 07 10:28:08.866731 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:08.866715 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls podName:a3240e4a-fbec-452c-b218-35b21002a1d3 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:12.866700596 +0000 UTC m=+51.639293630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls") pod "image-registry-74947bff46-rs9lw" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3") : secret "image-registry-tls" not found Jul 07 10:28:09.065462 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:09.065430 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/0.log" Jul 07 10:28:09.065626 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:09.065469 2566 generic.go:356] "Generic (PLEG): container finished" podID="2d6d25c2-a30c-4131-8a22-604414cd0f2f" containerID="47723bf15896f81c054e22012a6fc6cc3123597b3e84329404cbb86f11c2fd06" exitCode=255 Jul 07 10:28:09.065626 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:09.065515 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" event={"ID":"2d6d25c2-a30c-4131-8a22-604414cd0f2f","Type":"ContainerDied","Data":"47723bf15896f81c054e22012a6fc6cc3123597b3e84329404cbb86f11c2fd06"} Jul 07 10:28:09.065752 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:09.065739 2566 scope.go:117] "RemoveContainer" containerID="47723bf15896f81c054e22012a6fc6cc3123597b3e84329404cbb86f11c2fd06" Jul 07 10:28:10.069945 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.069917 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:28:10.070390 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.070361 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/0.log" Jul 07 10:28:10.070427 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.070394 2566 generic.go:356] "Generic (PLEG): container finished" podID="2d6d25c2-a30c-4131-8a22-604414cd0f2f" containerID="180fa4ae5b4a93c75d4cae75cb6b32e9d29348c2ea79477bbb21b9736ad8435e" exitCode=255 Jul 07 10:28:10.070460 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.070436 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" event={"ID":"2d6d25c2-a30c-4131-8a22-604414cd0f2f","Type":"ContainerDied","Data":"180fa4ae5b4a93c75d4cae75cb6b32e9d29348c2ea79477bbb21b9736ad8435e"} Jul 07 10:28:10.070493 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.070480 2566 scope.go:117] "RemoveContainer" containerID="47723bf15896f81c054e22012a6fc6cc3123597b3e84329404cbb86f11c2fd06" Jul 07 10:28:10.070699 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.070682 2566 scope.go:117] "RemoveContainer" containerID="180fa4ae5b4a93c75d4cae75cb6b32e9d29348c2ea79477bbb21b9736ad8435e" Jul 07 10:28:10.070881 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:10.070859 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lvjn6_openshift-console-operator(2d6d25c2-a30c-4131-8a22-604414cd0f2f)\"" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" podUID="2d6d25c2-a30c-4131-8a22-604414cd0f2f" Jul 07 10:28:10.451480 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.451403 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5s6q6"] Jul 07 10:28:10.471120 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.471091 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.477249 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.477128 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5s6q6"] Jul 07 10:28:10.480418 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.480395 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wt2hz\"" Jul 07 10:28:10.480535 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.480476 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 10:28:10.480728 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.480705 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 10:28:10.480809 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.480794 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 10:28:10.480913 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.480901 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 10:28:10.579507 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.579474 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.579664 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.579535 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/346e82be-6d04-428f-b05a-aa73064a847f-data-volume\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.579664 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.579590 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwkwg\" (UniqueName: \"kubernetes.io/projected/346e82be-6d04-428f-b05a-aa73064a847f-kube-api-access-cwkwg\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.579664 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.579605 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/346e82be-6d04-428f-b05a-aa73064a847f-crio-socket\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.579664 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.579621 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.680485 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.680454 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwkwg\" (UniqueName: \"kubernetes.io/projected/346e82be-6d04-428f-b05a-aa73064a847f-kube-api-access-cwkwg\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.680485 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.680488 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/346e82be-6d04-428f-b05a-aa73064a847f-crio-socket\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.680656 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.680507 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.680656 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.680540 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.680656 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.680583 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/346e82be-6d04-428f-b05a-aa73064a847f-data-volume\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.680656 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:10.680632 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 10:28:10.680785 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:10.680682 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 10:28:10.680785 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:10.680715 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls podName:346e82be-6d04-428f-b05a-aa73064a847f nodeName:}" failed. No retries permitted until 2026-07-07 10:28:11.180694658 +0000 UTC m=+49.953287706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s6q6" (UID: "346e82be-6d04-428f-b05a-aa73064a847f") : secret "insights-runtime-extractor-tls" not found Jul 07 10:28:10.680785 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.680714 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/346e82be-6d04-428f-b05a-aa73064a847f-crio-socket\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.680785 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:10.680754 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm podName:346e82be-6d04-428f-b05a-aa73064a847f nodeName:}" failed. No retries permitted until 2026-07-07 10:28:11.180738498 +0000 UTC m=+49.953331531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5s6q6" (UID: "346e82be-6d04-428f-b05a-aa73064a847f") : configmap "kube-rbac-proxy" not found Jul 07 10:28:10.680921 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.680904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/346e82be-6d04-428f-b05a-aa73064a847f-data-volume\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:10.696778 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:10.696748 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwkwg\" (UniqueName: \"kubernetes.io/projected/346e82be-6d04-428f-b05a-aa73064a847f-kube-api-access-cwkwg\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:11.074521 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.074492 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:28:11.074911 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.074797 2566 scope.go:117] "RemoveContainer" containerID="180fa4ae5b4a93c75d4cae75cb6b32e9d29348c2ea79477bbb21b9736ad8435e" Jul 07 10:28:11.074969 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:11.074950 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lvjn6_openshift-console-operator(2d6d25c2-a30c-4131-8a22-604414cd0f2f)\"" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" podUID="2d6d25c2-a30c-4131-8a22-604414cd0f2f" Jul 07 10:28:11.184259 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.184200 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:11.184471 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.184286 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:11.184471 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:11.184335 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 10:28:11.184471 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:11.184374 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 10:28:11.184471 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:11.184409 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls podName:346e82be-6d04-428f-b05a-aa73064a847f nodeName:}" failed. No retries permitted until 2026-07-07 10:28:12.184388928 +0000 UTC m=+50.956981978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s6q6" (UID: "346e82be-6d04-428f-b05a-aa73064a847f") : secret "insights-runtime-extractor-tls" not found Jul 07 10:28:11.184471 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:11.184428 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm podName:346e82be-6d04-428f-b05a-aa73064a847f nodeName:}" failed. No retries permitted until 2026-07-07 10:28:12.184419531 +0000 UTC m=+50.957012564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5s6q6" (UID: "346e82be-6d04-428f-b05a-aa73064a847f") : configmap "kube-rbac-proxy" not found Jul 07 10:28:11.550522 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.550488 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb"] Jul 07 10:28:11.568046 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.568016 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb"] Jul 07 10:28:11.568198 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.568125 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb" Jul 07 10:28:11.570784 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.570766 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pkrpl\"" Jul 07 10:28:11.570920 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.570804 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 10:28:11.571044 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.571030 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 10:28:11.688624 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.688596 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmvn4\" (UniqueName: \"kubernetes.io/projected/6e219e0a-7f4d-4f59-b56a-4ad6dd9ff65d-kube-api-access-hmvn4\") pod \"migrator-d57d58cc9-g4fqb\" (UID: \"6e219e0a-7f4d-4f59-b56a-4ad6dd9ff65d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb" Jul 07 10:28:11.789819 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.789777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmvn4\" (UniqueName: \"kubernetes.io/projected/6e219e0a-7f4d-4f59-b56a-4ad6dd9ff65d-kube-api-access-hmvn4\") pod \"migrator-d57d58cc9-g4fqb\" (UID: \"6e219e0a-7f4d-4f59-b56a-4ad6dd9ff65d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb" Jul 07 10:28:11.799458 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.799429 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmvn4\" (UniqueName: \"kubernetes.io/projected/6e219e0a-7f4d-4f59-b56a-4ad6dd9ff65d-kube-api-access-hmvn4\") pod \"migrator-d57d58cc9-g4fqb\" (UID: \"6e219e0a-7f4d-4f59-b56a-4ad6dd9ff65d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb" Jul 07 10:28:11.876454 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:11.876378 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb" Jul 07 10:28:12.017478 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:12.017412 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb"] Jul 07 10:28:12.021438 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:12.021410 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e219e0a_7f4d_4f59_b56a_4ad6dd9ff65d.slice/crio-edf27f78fb85b42d9fd7d3108d7726f7c08fbebdfe1f5fe317b50457a646e3aa WatchSource:0}: Error finding container edf27f78fb85b42d9fd7d3108d7726f7c08fbebdfe1f5fe317b50457a646e3aa: Status 404 returned error can't find the container with id edf27f78fb85b42d9fd7d3108d7726f7c08fbebdfe1f5fe317b50457a646e3aa Jul 07 10:28:12.078366 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:12.078333 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb" event={"ID":"6e219e0a-7f4d-4f59-b56a-4ad6dd9ff65d","Type":"ContainerStarted","Data":"edf27f78fb85b42d9fd7d3108d7726f7c08fbebdfe1f5fe317b50457a646e3aa"} Jul 07 10:28:12.159856 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:12.159789 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5xshq_c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5/dns-node-resolver/0.log" Jul 07 10:28:12.194133 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:12.194106 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:12.194228 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:12.194207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:12.194266 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:12.194227 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 10:28:12.194298 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:12.194284 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm podName:346e82be-6d04-428f-b05a-aa73064a847f nodeName:}" failed. No retries permitted until 2026-07-07 10:28:14.194268783 +0000 UTC m=+52.966861816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5s6q6" (UID: "346e82be-6d04-428f-b05a-aa73064a847f") : configmap "kube-rbac-proxy" not found Jul 07 10:28:12.194338 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:12.194319 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 10:28:12.194376 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:12.194365 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls podName:346e82be-6d04-428f-b05a-aa73064a847f nodeName:}" failed. No retries permitted until 2026-07-07 10:28:14.194352447 +0000 UTC m=+52.966945484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s6q6" (UID: "346e82be-6d04-428f-b05a-aa73064a847f") : secret "insights-runtime-extractor-tls" not found Jul 07 10:28:12.396131 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:12.396096 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:28:12.396313 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:12.396251 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 10:28:12.396353 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:12.396315 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls podName:aa8416e1-ce47-4760-b121-924aa3b1d346 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:28.396299372 +0000 UTC m=+67.168892407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls") pod "dns-default-dvvp6" (UID: "aa8416e1-ce47-4760-b121-924aa3b1d346") : secret "dns-default-metrics-tls" not found Jul 07 10:28:12.799729 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:12.799690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:12.799905 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:12.799836 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:12.799905 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:12.799900 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls podName:4e941db7-7c0b-41d2-a2f7-9c86142ec435 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:20.79988565 +0000 UTC m=+59.572478682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9j7k" (UID: "4e941db7-7c0b-41d2-a2f7-9c86142ec435") : secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:12.900858 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:12.900826 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:12.901005 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:12.900940 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 10:28:12.901005 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:12.900953 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74947bff46-rs9lw: secret "image-registry-tls" not found Jul 07 10:28:12.901005 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:12.901002 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls podName:a3240e4a-fbec-452c-b218-35b21002a1d3 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:20.900985618 +0000 UTC m=+59.673578654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls") pod "image-registry-74947bff46-rs9lw" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3") : secret "image-registry-tls" not found Jul 07 10:28:13.161029 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:13.160953 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d5vcg_7aa34fad-be27-460f-9462-24b73575e5b4/node-ca/0.log" Jul 07 10:28:13.960574 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:13.960545 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-86ndf_798adf2c-b8c3-4d94-bdf2-39d781d3420b/serve-healthcheck-canary/0.log" Jul 07 10:28:14.215713 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:14.215651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:14.216022 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:14.215713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:14.216022 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:14.215769 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 10:28:14.216022 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:14.215814 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 10:28:14.216022 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:14.215842 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm podName:346e82be-6d04-428f-b05a-aa73064a847f nodeName:}" failed. No retries permitted until 2026-07-07 10:28:18.215825963 +0000 UTC m=+56.988418996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5s6q6" (UID: "346e82be-6d04-428f-b05a-aa73064a847f") : configmap "kube-rbac-proxy" not found Jul 07 10:28:14.216022 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:14.215860 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls podName:346e82be-6d04-428f-b05a-aa73064a847f nodeName:}" failed. No retries permitted until 2026-07-07 10:28:18.215848394 +0000 UTC m=+56.988441427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s6q6" (UID: "346e82be-6d04-428f-b05a-aa73064a847f") : secret "insights-runtime-extractor-tls" not found Jul 07 10:28:15.087901 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:15.087857 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb" event={"ID":"6e219e0a-7f4d-4f59-b56a-4ad6dd9ff65d","Type":"ContainerStarted","Data":"7cb69e4ea50f50a3c7731e29ea93074d7d96be821aa2a7d5378df958bb484949"} Jul 07 10:28:15.088084 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:15.087913 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb" event={"ID":"6e219e0a-7f4d-4f59-b56a-4ad6dd9ff65d","Type":"ContainerStarted","Data":"d5de7f72e31b1242653e916b1b803958aa26db63d760299ea8b1337923dc1810"} Jul 07 10:28:15.108567 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:15.108522 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-g4fqb" podStartSLOduration=1.9931788080000001 podStartE2EDuration="4.108505455s" totalImagesPullingTime="2.115326647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:15.108351445 +0000 UTC m=+53.880944497" watchObservedRunningTime="2026-07-07 10:28:15.108505455 +0000 UTC m=+53.881098511" Jul 07 10:28:15.417828 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:15.417741 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:15.417828 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:15.417797 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:15.418240 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:15.418122 2566 scope.go:117] "RemoveContainer" containerID="180fa4ae5b4a93c75d4cae75cb6b32e9d29348c2ea79477bbb21b9736ad8435e" Jul 07 10:28:15.418308 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:15.418290 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lvjn6_openshift-console-operator(2d6d25c2-a30c-4131-8a22-604414cd0f2f)\"" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" podUID="2d6d25c2-a30c-4131-8a22-604414cd0f2f" Jul 07 10:28:18.247327 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:18.247279 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:18.247850 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:18.247383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:18.247850 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:18.247424 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 10:28:18.247850 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:18.247511 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm podName:346e82be-6d04-428f-b05a-aa73064a847f nodeName:}" failed. No retries permitted until 2026-07-07 10:28:26.247488817 +0000 UTC m=+65.020081852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5s6q6" (UID: "346e82be-6d04-428f-b05a-aa73064a847f") : configmap "kube-rbac-proxy" not found Jul 07 10:28:18.247850 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:18.247529 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 10:28:18.247850 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:18.247567 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls podName:346e82be-6d04-428f-b05a-aa73064a847f nodeName:}" failed. No retries permitted until 2026-07-07 10:28:26.247555602 +0000 UTC m=+65.020148635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s6q6" (UID: "346e82be-6d04-428f-b05a-aa73064a847f") : secret "insights-runtime-extractor-tls" not found Jul 07 10:28:20.868701 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:20.868646 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:20.869101 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:20.868809 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:20.869101 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:20.868880 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls podName:4e941db7-7c0b-41d2-a2f7-9c86142ec435 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:36.868862138 +0000 UTC m=+75.641455171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-l9j7k" (UID: "4e941db7-7c0b-41d2-a2f7-9c86142ec435") : secret "cluster-monitoring-operator-tls" not found Jul 07 10:28:20.969721 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:20.969684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:20.972154 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:20.972126 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls\") pod \"image-registry-74947bff46-rs9lw\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:21.036880 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:21.036845 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:21.168873 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:21.168785 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74947bff46-rs9lw"] Jul 07 10:28:21.172933 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:21.172908 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3240e4a_fbec_452c_b218_35b21002a1d3.slice/crio-886de094d83961a98c15028a941b7f385ee83521e3c408c1b491769b2dfcb1a3 WatchSource:0}: Error finding container 886de094d83961a98c15028a941b7f385ee83521e3c408c1b491769b2dfcb1a3: Status 404 returned error can't find the container with id 886de094d83961a98c15028a941b7f385ee83521e3c408c1b491769b2dfcb1a3 Jul 07 10:28:22.106386 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:22.106344 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" event={"ID":"a3240e4a-fbec-452c-b218-35b21002a1d3","Type":"ContainerStarted","Data":"b34099b29e6ff92a8772d0580a367a7db7f7c48c2b8d8438299eff8382f82c18"} Jul 07 10:28:22.106759 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:22.106406 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" event={"ID":"a3240e4a-fbec-452c-b218-35b21002a1d3","Type":"ContainerStarted","Data":"886de094d83961a98c15028a941b7f385ee83521e3c408c1b491769b2dfcb1a3"} Jul 07 10:28:22.106759 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:22.106450 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:24.022247 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:24.022219 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjtwv" Jul 07 10:28:24.051353 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:24.051293 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" podStartSLOduration=19.051269719 podStartE2EDuration="19.051269719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:28:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:22.135334403 +0000 UTC m=+60.907927469" watchObservedRunningTime="2026-07-07 10:28:24.051269719 +0000 UTC m=+62.823862752" Jul 07 10:28:26.311203 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:26.311164 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:26.311611 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:26.311246 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:26.311611 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:26.311296 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 10:28:26.311611 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:26.311369 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls podName:346e82be-6d04-428f-b05a-aa73064a847f nodeName:}" failed. No retries permitted until 2026-07-07 10:28:42.31135447 +0000 UTC m=+81.083947503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5s6q6" (UID: "346e82be-6d04-428f-b05a-aa73064a847f") : secret "insights-runtime-extractor-tls" not found Jul 07 10:28:26.311720 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:26.311677 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/346e82be-6d04-428f-b05a-aa73064a847f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:27.418437 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.418385 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:28:27.418902 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.418456 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:28:27.422324 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.422305 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 10:28:27.423521 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.423506 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 10:28:27.431227 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.431205 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1f3bd64-ddef-47d4-82bd-405034aac7b6-original-pull-secret\") pod \"global-pull-secret-syncer-4t7c8\" (UID: \"e1f3bd64-ddef-47d4-82bd-405034aac7b6\") " pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:28:27.431320 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.431264 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6a8b5b-baaf-44ea-946e-90569b0de370-metrics-certs\") pod \"network-metrics-daemon-sjkz4\" (UID: \"3d6a8b5b-baaf-44ea-946e-90569b0de370\") " pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:28:27.618995 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.618965 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4t7c8" Jul 07 10:28:27.619193 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.619099 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkv5k\" (UniqueName: \"kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k\") pod \"network-check-target-m5bhq\" (UID: \"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb\") " pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:28:27.624475 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.624458 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 10:28:27.633527 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.633504 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 10:28:27.633643 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.633622 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-68x57\"" Jul 07 10:28:27.641176 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.641136 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjkz4" Jul 07 10:28:27.642533 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.642508 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkv5k\" (UniqueName: \"kubernetes.io/projected/aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb-kube-api-access-wkv5k\") pod \"network-check-target-m5bhq\" (UID: \"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb\") " pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:28:27.757665 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.757637 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4t7c8"] Jul 07 10:28:27.760453 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:27.760428 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f3bd64_ddef_47d4_82bd_405034aac7b6.slice/crio-8ee043a801aeb926e34fc20f509990b3a955e6a658055a8d128428321cd45ee8 WatchSource:0}: Error finding container 8ee043a801aeb926e34fc20f509990b3a955e6a658055a8d128428321cd45ee8: Status 404 returned error can't find the container with id 8ee043a801aeb926e34fc20f509990b3a955e6a658055a8d128428321cd45ee8 Jul 07 10:28:27.778797 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.778776 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sjkz4"] Jul 07 10:28:27.781063 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:27.781042 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6a8b5b_baaf_44ea_946e_90569b0de370.slice/crio-d43384b99954e67775d66dd110c0c3b95cf9bb5693bc1dcf9e0e6b82566431d2 WatchSource:0}: Error finding container d43384b99954e67775d66dd110c0c3b95cf9bb5693bc1dcf9e0e6b82566431d2: Status 404 returned error can't find the container with id d43384b99954e67775d66dd110c0c3b95cf9bb5693bc1dcf9e0e6b82566431d2 Jul 07 10:28:27.927716 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.927647 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qdqsn\"" Jul 07 10:28:27.935173 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:27.935129 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:28:28.062379 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:28.062357 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m5bhq"] Jul 07 10:28:28.064736 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:28.064710 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb05ea0_0d50_4dc2_a846_d20fe8fd09bb.slice/crio-8e12ba101e4ab16c7741dd4e91de46ec8f936c2e45cfef46580d44b3aa4b55ce WatchSource:0}: Error finding container 8e12ba101e4ab16c7741dd4e91de46ec8f936c2e45cfef46580d44b3aa4b55ce: Status 404 returned error can't find the container with id 8e12ba101e4ab16c7741dd4e91de46ec8f936c2e45cfef46580d44b3aa4b55ce Jul 07 10:28:28.121504 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:28.121470 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m5bhq" event={"ID":"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb","Type":"ContainerStarted","Data":"8e12ba101e4ab16c7741dd4e91de46ec8f936c2e45cfef46580d44b3aa4b55ce"} Jul 07 10:28:28.122600 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:28.122571 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sjkz4" event={"ID":"3d6a8b5b-baaf-44ea-946e-90569b0de370","Type":"ContainerStarted","Data":"d43384b99954e67775d66dd110c0c3b95cf9bb5693bc1dcf9e0e6b82566431d2"} Jul 07 10:28:28.123614 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:28.123587 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4t7c8" event={"ID":"e1f3bd64-ddef-47d4-82bd-405034aac7b6","Type":"ContainerStarted","Data":"8ee043a801aeb926e34fc20f509990b3a955e6a658055a8d128428321cd45ee8"} Jul 07 10:28:28.424457 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:28.424415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:28:28.427102 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:28.427076 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa8416e1-ce47-4760-b121-924aa3b1d346-metrics-tls\") pod \"dns-default-dvvp6\" (UID: \"aa8416e1-ce47-4760-b121-924aa3b1d346\") " pod="openshift-dns/dns-default-dvvp6" Jul 07 10:28:28.705057 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:28.704974 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wq5jm\"" Jul 07 10:28:28.709724 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:28.709374 2566 scope.go:117] "RemoveContainer" containerID="180fa4ae5b4a93c75d4cae75cb6b32e9d29348c2ea79477bbb21b9736ad8435e" Jul 07 10:28:28.712336 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:28.712164 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dvvp6" Jul 07 10:28:28.915912 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:28.915883 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dvvp6"] Jul 07 10:28:29.117898 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:29.117861 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8416e1_ce47_4760_b121_924aa3b1d346.slice/crio-9bd880781e0f52c8925f1dcadc5cb024b917a544366a751b7cd4e22497bd5719 WatchSource:0}: Error finding container 9bd880781e0f52c8925f1dcadc5cb024b917a544366a751b7cd4e22497bd5719: Status 404 returned error can't find the container with id 9bd880781e0f52c8925f1dcadc5cb024b917a544366a751b7cd4e22497bd5719 Jul 07 10:28:29.129206 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:29.129171 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dvvp6" event={"ID":"aa8416e1-ce47-4760-b121-924aa3b1d346","Type":"ContainerStarted","Data":"9bd880781e0f52c8925f1dcadc5cb024b917a544366a751b7cd4e22497bd5719"} Jul 07 10:28:29.131904 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:29.131882 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:28:29.132006 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:29.131959 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" event={"ID":"2d6d25c2-a30c-4131-8a22-604414cd0f2f","Type":"ContainerStarted","Data":"19b36af36c4c7e755814b74e0f959df21530ba61cb601a30dea3408e48d49b4a"} Jul 07 10:28:29.132330 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:29.132309 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:29.349572 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:29.349542 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" Jul 07 10:28:29.373321 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:29.373265 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-lvjn6" podStartSLOduration=21.671233337 podStartE2EDuration="24.373242156s" totalImagesPullingTime="2.702008819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:29.174317379 +0000 UTC m=+67.946910436" watchObservedRunningTime="2026-07-07 10:28:29.373242156 +0000 UTC m=+68.145835213" Jul 07 10:28:30.138775 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:30.138731 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sjkz4" event={"ID":"3d6a8b5b-baaf-44ea-946e-90569b0de370","Type":"ContainerStarted","Data":"5083502013a8e1ab5bac1ecec766744d27c486e5ea1be2b444bf90e6331f4727"} Jul 07 10:28:30.138775 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:30.138781 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sjkz4" event={"ID":"3d6a8b5b-baaf-44ea-946e-90569b0de370","Type":"ContainerStarted","Data":"d33c55a7edbcfcfcdd3989856fd1693f4097819ce753231d14d9e3223a94a03a"} Jul 07 10:28:30.172370 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:30.171588 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sjkz4" podStartSLOduration=67.8081911 podStartE2EDuration="1m9.171566536s" totalImagesPullingTime="1.363375436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:30.169093984 +0000 UTC m=+68.941687041" watchObservedRunningTime="2026-07-07 10:28:30.171566536 +0000 UTC m=+68.944159592" Jul 07 10:28:31.144767 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:31.144712 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dvvp6" event={"ID":"aa8416e1-ce47-4760-b121-924aa3b1d346","Type":"ContainerStarted","Data":"8008a2766c4976ada49385b817657401217e17d974bb369806ce7962c7d0c920"} Jul 07 10:28:34.156939 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:34.156898 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4t7c8" event={"ID":"e1f3bd64-ddef-47d4-82bd-405034aac7b6","Type":"ContainerStarted","Data":"c3f51f63b4733a909eb68931a430bb6045eb41a44cc72d3ba3ba09fe7673c609"} Jul 07 10:28:34.158746 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:34.158720 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dvvp6" event={"ID":"aa8416e1-ce47-4760-b121-924aa3b1d346","Type":"ContainerStarted","Data":"75296f5ad34120db5fb1d2634492360b4a316b87a75d1f4fbd0718244a9614e9"} Jul 07 10:28:34.158891 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:34.158851 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dvvp6" Jul 07 10:28:34.160040 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:34.160021 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m5bhq" event={"ID":"aeb05ea0-0d50-4dc2-a846-d20fe8fd09bb","Type":"ContainerStarted","Data":"7bb0029d218230290231c8db6b7818c74d9c46635345888a2cd4de5f1e621899"} Jul 07 10:28:34.160165 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:34.160139 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:28:34.207656 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:34.207577 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4t7c8" podStartSLOduration=67.601342673 podStartE2EDuration="1m13.20755932s" totalImagesPullingTime="5.606216647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:34.206043999 +0000 UTC m=+72.978637055" watchObservedRunningTime="2026-07-07 10:28:34.20755932 +0000 UTC m=+72.980152374" Jul 07 10:28:34.249300 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:34.249234 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dvvp6" podStartSLOduration=36.419079674 podStartE2EDuration="38.249218052s" totalImagesPullingTime="1.830138378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:34.247854987 +0000 UTC m=+73.020448042" watchObservedRunningTime="2026-07-07 10:28:34.249218052 +0000 UTC m=+73.021811106" Jul 07 10:28:34.326015 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:34.325959 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m5bhq" podStartSLOduration=68.031096874 podStartE2EDuration="1m13.325940707s" totalImagesPullingTime="5.294843833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:34.321665252 +0000 UTC m=+73.094258306" watchObservedRunningTime="2026-07-07 10:28:34.325940707 +0000 UTC m=+73.098533761" Jul 07 10:28:34.395300 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:34.395270 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74947bff46-rs9lw"] Jul 07 10:28:36.882246 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:36.882200 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:36.884780 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:36.884754 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e941db7-7c0b-41d2-a2f7-9c86142ec435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-l9j7k\" (UID: \"4e941db7-7c0b-41d2-a2f7-9c86142ec435\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:37.121093 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:37.121059 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lptd2\"" Jul 07 10:28:37.128656 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:37.128635 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" Jul 07 10:28:37.280543 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:37.280509 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k"] Jul 07 10:28:37.283306 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:37.283286 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e941db7_7c0b_41d2_a2f7_9c86142ec435.slice/crio-ad6f72d02360ae3475867b66ba2840e57566b044b9c6912415682fbfac332519 WatchSource:0}: Error finding container ad6f72d02360ae3475867b66ba2840e57566b044b9c6912415682fbfac332519: Status 404 returned error can't find the container with id ad6f72d02360ae3475867b66ba2840e57566b044b9c6912415682fbfac332519 Jul 07 10:28:38.177430 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:38.177389 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" event={"ID":"4e941db7-7c0b-41d2-a2f7-9c86142ec435","Type":"ContainerStarted","Data":"ad6f72d02360ae3475867b66ba2840e57566b044b9c6912415682fbfac332519"} Jul 07 10:28:40.161028 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.160998 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f"] Jul 07 10:28:40.163123 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.163102 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f" Jul 07 10:28:40.166491 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.166471 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gbhn8\"" Jul 07 10:28:40.166888 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.166874 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 10:28:40.181180 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.181139 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f"] Jul 07 10:28:40.186765 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.186726 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" event={"ID":"4e941db7-7c0b-41d2-a2f7-9c86142ec435","Type":"ContainerStarted","Data":"fe88508b3978e754589a76c568d14575f0a19fdb829399cf90cc080532642228"} Jul 07 10:28:40.204840 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.204808 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f27ae057-e108-42f8-912b-55f76dee40fb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-hk95f\" (UID: \"f27ae057-e108-42f8-912b-55f76dee40fb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f" Jul 07 10:28:40.305996 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.305964 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f27ae057-e108-42f8-912b-55f76dee40fb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-hk95f\" (UID: \"f27ae057-e108-42f8-912b-55f76dee40fb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f" Jul 07 10:28:40.308402 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.308371 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f27ae057-e108-42f8-912b-55f76dee40fb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-hk95f\" (UID: \"f27ae057-e108-42f8-912b-55f76dee40fb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f" Jul 07 10:28:40.473227 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.473112 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f" Jul 07 10:28:40.596892 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.596827 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-l9j7k" podStartSLOduration=34.269309562 podStartE2EDuration="36.59680782s" totalImagesPullingTime="2.327498258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:40.22149405 +0000 UTC m=+78.994087104" watchObservedRunningTime="2026-07-07 10:28:40.59680782 +0000 UTC m=+79.369400881" Jul 07 10:28:40.597524 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:40.597509 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f"] Jul 07 10:28:40.600396 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:40.600371 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27ae057_e108_42f8_912b_55f76dee40fb.slice/crio-7e286a95b3c5300b91fb6269c12734a62c3b693bc350ebd913d1c21de75970cd WatchSource:0}: Error finding container 7e286a95b3c5300b91fb6269c12734a62c3b693bc350ebd913d1c21de75970cd: Status 404 returned error can't find the container with id 7e286a95b3c5300b91fb6269c12734a62c3b693bc350ebd913d1c21de75970cd Jul 07 10:28:41.165140 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:41.165112 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dvvp6" Jul 07 10:28:41.190510 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:41.190476 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f" event={"ID":"f27ae057-e108-42f8-912b-55f76dee40fb","Type":"ContainerStarted","Data":"7e286a95b3c5300b91fb6269c12734a62c3b693bc350ebd913d1c21de75970cd"} Jul 07 10:28:42.195412 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:42.195331 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f" event={"ID":"f27ae057-e108-42f8-912b-55f76dee40fb","Type":"ContainerStarted","Data":"0bb8dda81520bf230af202b726d52f83580c53f3831f90f1de9d35aac15c3d54"} Jul 07 10:28:42.195777 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:42.195548 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f" Jul 07 10:28:42.200162 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:42.200119 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f" Jul 07 10:28:42.214234 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:42.214193 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-hk95f" podStartSLOduration=1.006488089 podStartE2EDuration="2.214180329s" totalImagesPullingTime="1.20769224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:42.213729365 +0000 UTC m=+80.986322422" watchObservedRunningTime="2026-07-07 10:28:42.214180329 +0000 UTC m=+80.986773383" Jul 07 10:28:42.320282 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:42.320258 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:42.322573 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:42.322547 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/346e82be-6d04-428f-b05a-aa73064a847f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5s6q6\" (UID: \"346e82be-6d04-428f-b05a-aa73064a847f\") " pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:42.583094 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:42.583060 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wt2hz\"" Jul 07 10:28:42.590759 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:42.590728 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5s6q6" Jul 07 10:28:42.752170 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:42.752119 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5s6q6"] Jul 07 10:28:42.755157 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:42.755119 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346e82be_6d04_428f_b05a_aa73064a847f.slice/crio-9a4567a9f7e67154a8db045e40766501692671f5b4e97ceceff4548573db911d WatchSource:0}: Error finding container 9a4567a9f7e67154a8db045e40766501692671f5b4e97ceceff4548573db911d: Status 404 returned error can't find the container with id 9a4567a9f7e67154a8db045e40766501692671f5b4e97ceceff4548573db911d Jul 07 10:28:43.200624 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:43.200582 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5s6q6" event={"ID":"346e82be-6d04-428f-b05a-aa73064a847f","Type":"ContainerStarted","Data":"9a4567a9f7e67154a8db045e40766501692671f5b4e97ceceff4548573db911d"} Jul 07 10:28:44.401771 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:44.401738 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:28:47.216676 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:47.216642 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5s6q6" event={"ID":"346e82be-6d04-428f-b05a-aa73064a847f","Type":"ContainerStarted","Data":"7fed0e4392d21e7fa068fc0daa22c6303bb3a8c5a7d336b3f3e9dd73c3616ca4"} Jul 07 10:28:47.217059 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:47.216725 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5s6q6" event={"ID":"346e82be-6d04-428f-b05a-aa73064a847f","Type":"ContainerStarted","Data":"7ff62f73e0819843452abc329bc12c3a7b0e5e1160d70eb36bfc46c12c698401"} Jul 07 10:28:50.229505 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.229461 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5s6q6" event={"ID":"346e82be-6d04-428f-b05a-aa73064a847f","Type":"ContainerStarted","Data":"dd948eabc7f99c3c6e51d226a4db5ac0dc79e279f8bd301e4a5df1f5d0ec7e60"} Jul 07 10:28:50.261527 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.261480 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5s6q6" podStartSLOduration=33.578520275 podStartE2EDuration="40.261465903s" totalImagesPullingTime="6.682945628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 10:28:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:50.260427856 +0000 UTC m=+89.033020911" watchObservedRunningTime="2026-07-07 10:28:50.261465903 +0000 UTC m=+89.034058957" Jul 07 10:28:50.811219 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.811188 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-frn8p"] Jul 07 10:28:50.814380 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.814360 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.820628 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.820609 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 10:28:50.820711 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.820652 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 10:28:50.821291 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.821268 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lfkb5\"" Jul 07 10:28:50.821385 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.821312 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 10:28:50.821385 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.821268 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 10:28:50.897050 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.897017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-textfile\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.897267 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.897058 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p29mw\" (UniqueName: \"kubernetes.io/projected/639f09af-f0bb-4340-942c-dfc5b6aa8279-kube-api-access-p29mw\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.897267 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.897084 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-tls\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.897267 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.897202 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/639f09af-f0bb-4340-942c-dfc5b6aa8279-metrics-client-ca\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.897267 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.897247 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-accelerators-collector-config\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.897446 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.897293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.897446 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.897328 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/639f09af-f0bb-4340-942c-dfc5b6aa8279-root\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.897446 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.897365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-wtmp\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.897446 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.897390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/639f09af-f0bb-4340-942c-dfc5b6aa8279-sys\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.998627 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998582 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/639f09af-f0bb-4340-942c-dfc5b6aa8279-metrics-client-ca\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.998804 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998636 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-accelerators-collector-config\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.998804 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998660 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.998804 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998683 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/639f09af-f0bb-4340-942c-dfc5b6aa8279-root\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.998804 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998708 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-wtmp\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.998804 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/639f09af-f0bb-4340-942c-dfc5b6aa8279-sys\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.998804 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-textfile\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.998804 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998779 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/639f09af-f0bb-4340-942c-dfc5b6aa8279-root\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.998804 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998801 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p29mw\" (UniqueName: \"kubernetes.io/projected/639f09af-f0bb-4340-942c-dfc5b6aa8279-kube-api-access-p29mw\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.999238 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998826 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-tls\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.999238 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998841 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/639f09af-f0bb-4340-942c-dfc5b6aa8279-sys\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.999238 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.998871 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-wtmp\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.999238 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:50.998924 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 10:28:50.999238 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:28:50.998992 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-tls podName:639f09af-f0bb-4340-942c-dfc5b6aa8279 nodeName:}" failed. No retries permitted until 2026-07-07 10:28:51.498971463 +0000 UTC m=+90.271564496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-tls") pod "node-exporter-frn8p" (UID: "639f09af-f0bb-4340-942c-dfc5b6aa8279") : secret "node-exporter-tls" not found Jul 07 10:28:50.999238 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.999167 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-textfile\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.999238 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.999227 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/639f09af-f0bb-4340-942c-dfc5b6aa8279-metrics-client-ca\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:50.999238 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:50.999231 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-accelerators-collector-config\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:51.001164 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:51.001128 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:51.024108 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:51.024083 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p29mw\" (UniqueName: \"kubernetes.io/projected/639f09af-f0bb-4340-942c-dfc5b6aa8279-kube-api-access-p29mw\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:51.503903 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:51.503859 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-tls\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:51.506325 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:51.506302 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/639f09af-f0bb-4340-942c-dfc5b6aa8279-node-exporter-tls\") pod \"node-exporter-frn8p\" (UID: \"639f09af-f0bb-4340-942c-dfc5b6aa8279\") " pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:51.723354 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:51.723323 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-frn8p" Jul 07 10:28:51.734881 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:51.734841 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639f09af_f0bb_4340_942c_dfc5b6aa8279.slice/crio-89487ccbb3116a1186be34c054d8184e842fdf7c5ad5ae0ee6f07f23fd0bd070 WatchSource:0}: Error finding container 89487ccbb3116a1186be34c054d8184e842fdf7c5ad5ae0ee6f07f23fd0bd070: Status 404 returned error can't find the container with id 89487ccbb3116a1186be34c054d8184e842fdf7c5ad5ae0ee6f07f23fd0bd070 Jul 07 10:28:52.237125 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:52.237089 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frn8p" event={"ID":"639f09af-f0bb-4340-942c-dfc5b6aa8279","Type":"ContainerStarted","Data":"89487ccbb3116a1186be34c054d8184e842fdf7c5ad5ae0ee6f07f23fd0bd070"} Jul 07 10:28:53.242643 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:53.242566 2566 generic.go:356] "Generic (PLEG): container finished" podID="639f09af-f0bb-4340-942c-dfc5b6aa8279" containerID="e240c9fe08d211fb26b81c646d57e42e5d20cd1421e12de574f2319a6fcf990f" exitCode=0 Jul 07 10:28:53.242643 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:53.242633 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frn8p" event={"ID":"639f09af-f0bb-4340-942c-dfc5b6aa8279","Type":"ContainerDied","Data":"e240c9fe08d211fb26b81c646d57e42e5d20cd1421e12de574f2319a6fcf990f"} Jul 07 10:28:54.030208 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.030177 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-696d7b868b-pjvpm"] Jul 07 10:28:54.033560 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.033539 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.041322 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.040918 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 10:28:54.041322 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.040999 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 10:28:54.041322 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.041017 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 10:28:54.041322 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.041185 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7ifbn1mf0ufrd\"" Jul 07 10:28:54.041586 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.041483 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 10:28:54.044517 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.041859 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 10:28:54.044972 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.044955 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7t68x\"" Jul 07 10:28:54.114736 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.114710 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-696d7b868b-pjvpm"] Jul 07 10:28:54.124770 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.124741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/460cf075-80b8-49ee-8121-8a1a492c3e08-metrics-client-ca\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.124770 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.124770 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vwb7\" (UniqueName: \"kubernetes.io/projected/460cf075-80b8-49ee-8121-8a1a492c3e08-kube-api-access-5vwb7\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.124925 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.124788 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-grpc-tls\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.124925 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.124864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.124925 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.124904 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.125019 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.124935 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-tls\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.125019 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.124962 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.125019 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.125001 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.226089 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.226058 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.226271 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.226100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-tls\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.226271 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.226129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.226344 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.226317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.226379 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.226356 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/460cf075-80b8-49ee-8121-8a1a492c3e08-metrics-client-ca\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.226423 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.226384 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vwb7\" (UniqueName: \"kubernetes.io/projected/460cf075-80b8-49ee-8121-8a1a492c3e08-kube-api-access-5vwb7\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.226423 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.226407 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-grpc-tls\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.226530 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.226465 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.227373 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.227345 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/460cf075-80b8-49ee-8121-8a1a492c3e08-metrics-client-ca\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.229269 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.229223 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.229398 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.229312 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.229464 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.229437 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.229519 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.229487 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.229519 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.229509 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-thanos-querier-tls\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.229848 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.229826 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/460cf075-80b8-49ee-8121-8a1a492c3e08-secret-grpc-tls\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.240978 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.240954 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vwb7\" (UniqueName: \"kubernetes.io/projected/460cf075-80b8-49ee-8121-8a1a492c3e08-kube-api-access-5vwb7\") pod \"thanos-querier-696d7b868b-pjvpm\" (UID: \"460cf075-80b8-49ee-8121-8a1a492c3e08\") " pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.248372 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.248344 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frn8p" event={"ID":"639f09af-f0bb-4340-942c-dfc5b6aa8279","Type":"ContainerStarted","Data":"f27eab0685e18f565337e757e51a90ad88678893b22eea5574e3ac8413af28e3"} Jul 07 10:28:54.248720 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.248402 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frn8p" event={"ID":"639f09af-f0bb-4340-942c-dfc5b6aa8279","Type":"ContainerStarted","Data":"a4766e0b00d9df155d85c418b0bfe9146a24071a52937cb9c9fdb46ebe91649b"} Jul 07 10:28:54.310927 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.310877 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-frn8p" podStartSLOduration=3.129749556 podStartE2EDuration="4.310861919s" totalImagesPullingTime="1.108227363s" totalInitContainerRuntime="72.885ms" isStatefulPod=true podCreationTimestamp="2026-07-07 10:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:54.292904299 +0000 UTC m=+93.065497355" watchObservedRunningTime="2026-07-07 10:28:54.310861919 +0000 UTC m=+93.083454973" Jul 07 10:28:54.346308 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.346280 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:54.533679 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:54.533648 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-696d7b868b-pjvpm"] Jul 07 10:28:54.536603 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:54.536579 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460cf075_80b8_49ee_8121_8a1a492c3e08.slice/crio-510527dc8a4a8e0937298d252a2702a8ef4d696f2c45a71ef8796cbd10eefe97 WatchSource:0}: Error finding container 510527dc8a4a8e0937298d252a2702a8ef4d696f2c45a71ef8796cbd10eefe97: Status 404 returned error can't find the container with id 510527dc8a4a8e0937298d252a2702a8ef4d696f2c45a71ef8796cbd10eefe97 Jul 07 10:28:55.253073 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.253037 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" event={"ID":"460cf075-80b8-49ee-8121-8a1a492c3e08","Type":"ContainerStarted","Data":"510527dc8a4a8e0937298d252a2702a8ef4d696f2c45a71ef8796cbd10eefe97"} Jul 07 10:28:55.545954 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.545917 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t"] Jul 07 10:28:55.549267 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.549246 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" Jul 07 10:28:55.561814 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.561792 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jgx5b\"" Jul 07 10:28:55.561940 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.561818 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 10:28:55.586847 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.586816 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t"] Jul 07 10:28:55.638194 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.638155 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2k7x\" (UniqueName: \"kubernetes.io/projected/44ec3e16-153d-4347-8ea0-dedec549e7db-kube-api-access-l2k7x\") pod \"monitoring-plugin-d5dcff7cf-2r65t\" (UID: \"44ec3e16-153d-4347-8ea0-dedec549e7db\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" Jul 07 10:28:55.638351 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.638329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44ec3e16-153d-4347-8ea0-dedec549e7db-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-2r65t\" (UID: \"44ec3e16-153d-4347-8ea0-dedec549e7db\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" Jul 07 10:28:55.739444 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.739405 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44ec3e16-153d-4347-8ea0-dedec549e7db-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-2r65t\" (UID: \"44ec3e16-153d-4347-8ea0-dedec549e7db\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" Jul 07 10:28:55.739610 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.739471 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2k7x\" (UniqueName: \"kubernetes.io/projected/44ec3e16-153d-4347-8ea0-dedec549e7db-kube-api-access-l2k7x\") pod \"monitoring-plugin-d5dcff7cf-2r65t\" (UID: \"44ec3e16-153d-4347-8ea0-dedec549e7db\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" Jul 07 10:28:55.742628 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.742600 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44ec3e16-153d-4347-8ea0-dedec549e7db-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-2r65t\" (UID: \"44ec3e16-153d-4347-8ea0-dedec549e7db\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" Jul 07 10:28:55.760879 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.760842 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2k7x\" (UniqueName: \"kubernetes.io/projected/44ec3e16-153d-4347-8ea0-dedec549e7db-kube-api-access-l2k7x\") pod \"monitoring-plugin-d5dcff7cf-2r65t\" (UID: \"44ec3e16-153d-4347-8ea0-dedec549e7db\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" Jul 07 10:28:55.860870 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:55.860804 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" Jul 07 10:28:56.014117 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.014082 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t"] Jul 07 10:28:56.017435 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:56.017407 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ec3e16_153d_4347_8ea0_dedec549e7db.slice/crio-97afa7ab5c834ee79463ddd44b4ec9802ad1b2a46766481cc12c9f52e41f40e9 WatchSource:0}: Error finding container 97afa7ab5c834ee79463ddd44b4ec9802ad1b2a46766481cc12c9f52e41f40e9: Status 404 returned error can't find the container with id 97afa7ab5c834ee79463ddd44b4ec9802ad1b2a46766481cc12c9f52e41f40e9 Jul 07 10:28:56.258736 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.258669 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" event={"ID":"44ec3e16-153d-4347-8ea0-dedec549e7db","Type":"ContainerStarted","Data":"97afa7ab5c834ee79463ddd44b4ec9802ad1b2a46766481cc12c9f52e41f40e9"} Jul 07 10:28:56.602009 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.601977 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86cdb8c998-jggrd"] Jul 07 10:28:56.605618 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.605594 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.612422 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.612390 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 10:28:56.612422 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.612421 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 10:28:56.615509 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.615488 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 10:28:56.615691 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.615529 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 10:28:56.615691 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.615553 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 10:28:56.615691 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.615553 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 10:28:56.616924 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.616906 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d4kbr\"" Jul 07 10:28:56.617162 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.617129 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 10:28:56.631775 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.631752 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 10:28:56.637481 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.637453 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86cdb8c998-jggrd"] Jul 07 10:28:56.747779 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.747736 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-trusted-ca-bundle\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.747972 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.747797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzfnn\" (UniqueName: \"kubernetes.io/projected/8f163779-ab7b-4535-8802-2d1df1fdddf6-kube-api-access-mzfnn\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.747972 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.747836 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-config\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.747972 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.747882 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-oauth-serving-cert\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.747972 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.747908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-serving-cert\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.748182 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.748000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-oauth-config\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.748182 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.748017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-service-ca\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.853060 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.850301 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzfnn\" (UniqueName: \"kubernetes.io/projected/8f163779-ab7b-4535-8802-2d1df1fdddf6-kube-api-access-mzfnn\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.853060 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.850359 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-config\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.853060 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.850412 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-oauth-serving-cert\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.853060 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.850440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-serving-cert\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.853060 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.850509 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-oauth-config\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.853060 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.850537 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-service-ca\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.853060 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.850587 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-trusted-ca-bundle\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.853060 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.851908 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-trusted-ca-bundle\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.853060 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.852802 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-config\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.853569 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.853540 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-oauth-serving-cert\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.854180 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.854134 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-service-ca\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.856209 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.856189 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-oauth-config\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.856294 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.856271 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-serving-cert\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.865319 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.865301 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzfnn\" (UniqueName: \"kubernetes.io/projected/8f163779-ab7b-4535-8802-2d1df1fdddf6-kube-api-access-mzfnn\") pod \"console-86cdb8c998-jggrd\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:56.917208 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:56.917160 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:28:57.089384 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:57.088292 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86cdb8c998-jggrd"] Jul 07 10:28:57.091276 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:57.091246 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f163779_ab7b_4535_8802_2d1df1fdddf6.slice/crio-e299168d6dd5d99c13fcfceb85200aabe05cf3856254d01a598dcb6290724585 WatchSource:0}: Error finding container e299168d6dd5d99c13fcfceb85200aabe05cf3856254d01a598dcb6290724585: Status 404 returned error can't find the container with id e299168d6dd5d99c13fcfceb85200aabe05cf3856254d01a598dcb6290724585 Jul 07 10:28:57.264739 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:57.264664 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" event={"ID":"460cf075-80b8-49ee-8121-8a1a492c3e08","Type":"ContainerStarted","Data":"8f96a6f25cbfdf55cc415bfa9058505830ecd4ceee3a358e0d232be1c65619c4"} Jul 07 10:28:57.264739 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:57.264726 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" event={"ID":"460cf075-80b8-49ee-8121-8a1a492c3e08","Type":"ContainerStarted","Data":"4d8777645375e7f9aff835648fd461c212123eec696ad06cb9a8fb96c9178b3c"} Jul 07 10:28:57.265192 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:57.264752 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" event={"ID":"460cf075-80b8-49ee-8121-8a1a492c3e08","Type":"ContainerStarted","Data":"fd56cefa17bcbcda001755250712b612e954c87752c75483b01474320d502b60"} Jul 07 10:28:57.265802 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:57.265778 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cdb8c998-jggrd" event={"ID":"8f163779-ab7b-4535-8802-2d1df1fdddf6","Type":"ContainerStarted","Data":"e299168d6dd5d99c13fcfceb85200aabe05cf3856254d01a598dcb6290724585"} Jul 07 10:28:58.099896 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.099763 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 10:28:58.104234 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.104209 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.108880 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.108843 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 10:28:58.109443 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.109270 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vjdj2\"" Jul 07 10:28:58.109627 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.109608 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 10:28:58.109705 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.109634 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 10:28:58.109759 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.109614 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 10:28:58.110715 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.110542 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 10:28:58.110715 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.110593 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 10:28:58.110715 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.110600 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 10:28:58.110912 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.110840 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 10:28:58.116655 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.116634 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 10:28:58.117685 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.117658 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 10:28:58.117771 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.117756 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dpf2l54r2mg8b\"" Jul 07 10:28:58.118004 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.117990 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 10:28:58.118326 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.118303 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 10:28:58.118816 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.118799 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 10:28:58.120457 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.120415 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 10:28:58.123016 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.122949 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 10:28:58.250497 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.250461 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 10:28:58.262977 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.262937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263172 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.262980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263172 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263172 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263028 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263172 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263172 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263172 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263450 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263193 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263450 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263450 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263361 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263450 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263400 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263450 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263650 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263463 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263650 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263650 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263571 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263778 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263778 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263778 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263778 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263754 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.263966 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.263798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7pzs\" (UniqueName: \"kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-kube-api-access-v7pzs\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.272327 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.272299 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" event={"ID":"44ec3e16-153d-4347-8ea0-dedec549e7db","Type":"ContainerStarted","Data":"843777fc65b629c4ad6ec6c5883ced4c04a2bf06e778719a4328c29d94082ac4"} Jul 07 10:28:58.272738 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.272497 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" Jul 07 10:28:58.279095 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.279070 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" Jul 07 10:28:58.302261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.302195 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2r65t" podStartSLOduration=1.506153996 podStartE2EDuration="3.3021737s" totalImagesPullingTime="1.796019704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:28:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:58.30186083 +0000 UTC m=+97.074453886" watchObservedRunningTime="2026-07-07 10:28:58.3021737 +0000 UTC m=+97.074766756" Jul 07 10:28:58.364708 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.364682 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.364839 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.364713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.364839 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.364754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.364839 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.364777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.364839 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.364796 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.364839 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.364814 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365108 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.364832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365599 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365646 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365678 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7pzs\" (UniqueName: \"kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-kube-api-access-v7pzs\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365811 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365842 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365895 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.365999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.365962 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.369217 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.369187 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.369818 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.369794 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.370276 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.370239 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.370417 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.370278 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.370728 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.370620 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.370728 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.370627 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.371302 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.371277 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.372924 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.372018 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.374892 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.374075 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.374892 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.374555 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.374892 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.374780 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.377412 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.375917 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.377412 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.376684 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.377696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.377674 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.382332 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.378225 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.382332 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.378377 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.382332 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.381322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.382548 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.382477 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.383491 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.383193 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.383491 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.383240 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.387693 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.387668 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7pzs\" (UniqueName: \"kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-kube-api-access-v7pzs\") pod \"prometheus-k8s-0\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.416118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.416080 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:28:58.594757 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:58.594727 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 10:28:58.597201 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:28:58.597171 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea34457_85bb_47f7_a3e8_6a76b895d9fc.slice/crio-a6432a4ad10bf27ad68b68988a9ce2a1a1119ff0d515ba606ea61d63170fe4cd WatchSource:0}: Error finding container a6432a4ad10bf27ad68b68988a9ce2a1a1119ff0d515ba606ea61d63170fe4cd: Status 404 returned error can't find the container with id a6432a4ad10bf27ad68b68988a9ce2a1a1119ff0d515ba606ea61d63170fe4cd Jul 07 10:28:59.282236 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:59.282199 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" event={"ID":"460cf075-80b8-49ee-8121-8a1a492c3e08","Type":"ContainerStarted","Data":"8576e707037dd986e684c97e2a4b1823dd07b1d951de5b46f96eb0812f82d62d"} Jul 07 10:28:59.282702 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:59.282289 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" event={"ID":"460cf075-80b8-49ee-8121-8a1a492c3e08","Type":"ContainerStarted","Data":"84e49282e509bbd4e19bb21b88824ba23562cf9084b6623e3a71a0a1538df672"} Jul 07 10:28:59.282702 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:59.282337 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" event={"ID":"460cf075-80b8-49ee-8121-8a1a492c3e08","Type":"ContainerStarted","Data":"5a44a212cab202e8310475ffef6c4a39aa40d47452a4337ad7bf0e3c586c2c88"} Jul 07 10:28:59.282702 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:59.282529 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:28:59.283970 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:59.283943 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerStarted","Data":"a6432a4ad10bf27ad68b68988a9ce2a1a1119ff0d515ba606ea61d63170fe4cd"} Jul 07 10:28:59.314926 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:59.314876 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" podStartSLOduration=2.751553328 podStartE2EDuration="6.314859651s" totalImagesPullingTime="3.563306323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:28:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:28:59.312457361 +0000 UTC m=+98.085050417" watchObservedRunningTime="2026-07-07 10:28:59.314859651 +0000 UTC m=+98.087452724" Jul 07 10:28:59.415202 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:28:59.415134 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" podUID="a3240e4a-fbec-452c-b218-35b21002a1d3" containerName="registry" containerID="cri-o://b34099b29e6ff92a8772d0580a367a7db7f7c48c2b8d8438299eff8382f82c18" gracePeriod=30 Jul 07 10:29:00.290022 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.289991 2566 generic.go:356] "Generic (PLEG): container finished" podID="a3240e4a-fbec-452c-b218-35b21002a1d3" containerID="b34099b29e6ff92a8772d0580a367a7db7f7c48c2b8d8438299eff8382f82c18" exitCode=0 Jul 07 10:29:00.290499 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.290195 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" event={"ID":"a3240e4a-fbec-452c-b218-35b21002a1d3","Type":"ContainerDied","Data":"b34099b29e6ff92a8772d0580a367a7db7f7c48c2b8d8438299eff8382f82c18"} Jul 07 10:29:00.449870 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.449848 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:29:00.590357 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.590318 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-certificates\") pod \"a3240e4a-fbec-452c-b218-35b21002a1d3\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " Jul 07 10:29:00.590491 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.590383 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-trusted-ca\") pod \"a3240e4a-fbec-452c-b218-35b21002a1d3\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " Jul 07 10:29:00.590491 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.590406 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls\") pod \"a3240e4a-fbec-452c-b218-35b21002a1d3\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " Jul 07 10:29:00.590491 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.590424 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-bound-sa-token\") pod \"a3240e4a-fbec-452c-b218-35b21002a1d3\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " Jul 07 10:29:00.590491 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.590447 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-installation-pull-secrets\") pod \"a3240e4a-fbec-452c-b218-35b21002a1d3\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " Jul 07 10:29:00.590626 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.590513 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-image-registry-private-configuration\") pod \"a3240e4a-fbec-452c-b218-35b21002a1d3\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " Jul 07 10:29:00.590626 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.590554 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th8xk\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-kube-api-access-th8xk\") pod \"a3240e4a-fbec-452c-b218-35b21002a1d3\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " Jul 07 10:29:00.590626 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.590615 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3240e4a-fbec-452c-b218-35b21002a1d3-ca-trust-extracted\") pod \"a3240e4a-fbec-452c-b218-35b21002a1d3\" (UID: \"a3240e4a-fbec-452c-b218-35b21002a1d3\") " Jul 07 10:29:00.590723 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.590697 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a3240e4a-fbec-452c-b218-35b21002a1d3" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:29:00.590850 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.590820 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a3240e4a-fbec-452c-b218-35b21002a1d3" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:29:00.590975 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.590882 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-certificates\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:29:00.593711 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.593680 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a3240e4a-fbec-452c-b218-35b21002a1d3" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:29:00.593809 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.593703 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a3240e4a-fbec-452c-b218-35b21002a1d3" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:29:00.593809 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.593788 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-kube-api-access-th8xk" (OuterVolumeSpecName: "kube-api-access-th8xk") pod "a3240e4a-fbec-452c-b218-35b21002a1d3" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3"). InnerVolumeSpecName "kube-api-access-th8xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:29:00.594000 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.593977 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a3240e4a-fbec-452c-b218-35b21002a1d3" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:29:00.594311 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.594224 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a3240e4a-fbec-452c-b218-35b21002a1d3" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:29:00.600235 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.600213 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3240e4a-fbec-452c-b218-35b21002a1d3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a3240e4a-fbec-452c-b218-35b21002a1d3" (UID: "a3240e4a-fbec-452c-b218-35b21002a1d3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 10:29:00.691615 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.691547 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3240e4a-fbec-452c-b218-35b21002a1d3-trusted-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:29:00.691615 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.691570 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-registry-tls\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:29:00.691615 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.691579 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-bound-sa-token\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:29:00.691615 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.691588 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-installation-pull-secrets\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:29:00.691615 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.691596 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3240e4a-fbec-452c-b218-35b21002a1d3-image-registry-private-configuration\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:29:00.691615 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.691605 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th8xk\" (UniqueName: \"kubernetes.io/projected/a3240e4a-fbec-452c-b218-35b21002a1d3-kube-api-access-th8xk\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:29:00.691615 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:00.691613 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3240e4a-fbec-452c-b218-35b21002a1d3-ca-trust-extracted\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:29:01.295211 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:01.295181 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" Jul 07 10:29:01.295211 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:01.295207 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74947bff46-rs9lw" event={"ID":"a3240e4a-fbec-452c-b218-35b21002a1d3","Type":"ContainerDied","Data":"886de094d83961a98c15028a941b7f385ee83521e3c408c1b491769b2dfcb1a3"} Jul 07 10:29:01.295734 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:01.295268 2566 scope.go:117] "RemoveContainer" containerID="b34099b29e6ff92a8772d0580a367a7db7f7c48c2b8d8438299eff8382f82c18" Jul 07 10:29:01.297015 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:01.296987 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cdb8c998-jggrd" event={"ID":"8f163779-ab7b-4535-8802-2d1df1fdddf6","Type":"ContainerStarted","Data":"33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542"} Jul 07 10:29:01.298677 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:01.298648 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerID="5a3f2e446d2c7794bf66881b17234646b7daeae4d17924b7764e5b1576895d58" exitCode=0 Jul 07 10:29:01.298766 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:01.298730 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerDied","Data":"5a3f2e446d2c7794bf66881b17234646b7daeae4d17924b7764e5b1576895d58"} Jul 07 10:29:01.330717 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:01.330676 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86cdb8c998-jggrd" podStartSLOduration=1.958443868 podStartE2EDuration="5.330656868s" totalImagesPullingTime="3.372213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:29:01.330339101 +0000 UTC m=+100.102932150" watchObservedRunningTime="2026-07-07 10:29:01.330656868 +0000 UTC m=+100.103249923" Jul 07 10:29:01.394086 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:01.394055 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74947bff46-rs9lw"] Jul 07 10:29:01.398346 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:01.398323 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74947bff46-rs9lw"] Jul 07 10:29:01.713342 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:01.713266 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3240e4a-fbec-452c-b218-35b21002a1d3" path="/var/lib/kubelet/pods/a3240e4a-fbec-452c-b218-35b21002a1d3/volumes" Jul 07 10:29:05.166390 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:05.166256 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m5bhq" Jul 07 10:29:05.296359 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:05.296337 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-696d7b868b-pjvpm" Jul 07 10:29:05.320026 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:05.319996 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerStarted","Data":"02205187644f3e853edd64d5b464ac8fc50452aec3a8e3603db1b91f9f5f990c"} Jul 07 10:29:05.320182 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:05.320056 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerStarted","Data":"7b609d6b55fe9532c6e622beaf7322bb536fc92ef4afb4c0982c16a6182f06b3"} Jul 07 10:29:05.320182 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:05.320082 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerStarted","Data":"9d602ca5af3859b73280deb060f5b18c77a2595a311bcc4632802cbfd9611fd5"} Jul 07 10:29:06.327832 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:06.327801 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerStarted","Data":"d7111a38a3c5b9cb49187d936ba17f7a08ac3e9aaa8817802e5657746c6df0a0"} Jul 07 10:29:06.328408 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:06.327861 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerStarted","Data":"b3529e1fbf13c78c66033a2ce8414e60eb00b47ba10f638e1b857f21e0f3347c"} Jul 07 10:29:06.328408 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:06.327888 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerStarted","Data":"fbae50426a0761e33af468b55a865060442376574393b080529420ed63686378"} Jul 07 10:29:06.360519 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:06.360403 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.89819916 podStartE2EDuration="8.360381454s" totalImagesPullingTime="5.440090891s" totalInitContainerRuntime="22.091403ms" isStatefulPod=false podCreationTimestamp="2026-07-07 10:28:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:29:06.359206063 +0000 UTC m=+105.131799118" watchObservedRunningTime="2026-07-07 10:29:06.360381454 +0000 UTC m=+105.132974511" Jul 07 10:29:06.918352 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:06.918311 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:29:06.918546 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:06.918410 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:29:06.923031 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:06.923010 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:29:07.337611 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:07.337574 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:29:08.416467 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:08.416435 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:29:58.417338 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:58.417285 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:29:58.437238 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:58.437212 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:29:58.535169 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:29:58.535128 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:16.385891 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.385808 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 10:30:16.386400 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.386100 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="prometheus" containerID="cri-o://9d602ca5af3859b73280deb060f5b18c77a2595a311bcc4632802cbfd9611fd5" gracePeriod=600 Jul 07 10:30:16.386400 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.386172 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d7111a38a3c5b9cb49187d936ba17f7a08ac3e9aaa8817802e5657746c6df0a0" gracePeriod=600 Jul 07 10:30:16.386400 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.386202 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy-web" containerID="cri-o://fbae50426a0761e33af468b55a865060442376574393b080529420ed63686378" gracePeriod=600 Jul 07 10:30:16.386400 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.386211 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="thanos-sidecar" containerID="cri-o://02205187644f3e853edd64d5b464ac8fc50452aec3a8e3603db1b91f9f5f990c" gracePeriod=600 Jul 07 10:30:16.386400 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.386218 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="config-reloader" containerID="cri-o://7b609d6b55fe9532c6e622beaf7322bb536fc92ef4afb4c0982c16a6182f06b3" gracePeriod=600 Jul 07 10:30:16.386400 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.386139 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy" containerID="cri-o://b3529e1fbf13c78c66033a2ce8414e60eb00b47ba10f638e1b857f21e0f3347c" gracePeriod=600 Jul 07 10:30:16.593560 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593530 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerID="d7111a38a3c5b9cb49187d936ba17f7a08ac3e9aaa8817802e5657746c6df0a0" exitCode=0 Jul 07 10:30:16.593560 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593555 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerID="b3529e1fbf13c78c66033a2ce8414e60eb00b47ba10f638e1b857f21e0f3347c" exitCode=0 Jul 07 10:30:16.593560 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593564 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerID="fbae50426a0761e33af468b55a865060442376574393b080529420ed63686378" exitCode=0 Jul 07 10:30:16.593560 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593573 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerID="02205187644f3e853edd64d5b464ac8fc50452aec3a8e3603db1b91f9f5f990c" exitCode=0 Jul 07 10:30:16.593816 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593580 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerID="7b609d6b55fe9532c6e622beaf7322bb536fc92ef4afb4c0982c16a6182f06b3" exitCode=0 Jul 07 10:30:16.593816 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593587 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerID="9d602ca5af3859b73280deb060f5b18c77a2595a311bcc4632802cbfd9611fd5" exitCode=0 Jul 07 10:30:16.593816 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593611 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerDied","Data":"d7111a38a3c5b9cb49187d936ba17f7a08ac3e9aaa8817802e5657746c6df0a0"} Jul 07 10:30:16.593816 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593700 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerDied","Data":"b3529e1fbf13c78c66033a2ce8414e60eb00b47ba10f638e1b857f21e0f3347c"} Jul 07 10:30:16.593816 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593726 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerDied","Data":"fbae50426a0761e33af468b55a865060442376574393b080529420ed63686378"} Jul 07 10:30:16.593816 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593751 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerDied","Data":"02205187644f3e853edd64d5b464ac8fc50452aec3a8e3603db1b91f9f5f990c"} Jul 07 10:30:16.593816 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593775 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerDied","Data":"7b609d6b55fe9532c6e622beaf7322bb536fc92ef4afb4c0982c16a6182f06b3"} Jul 07 10:30:16.593816 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.593799 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerDied","Data":"9d602ca5af3859b73280deb060f5b18c77a2595a311bcc4632802cbfd9611fd5"} Jul 07 10:30:16.639959 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.639905 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:16.807003 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.806966 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config-out\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807003 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807003 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807021 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-tls\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807045 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-kube-rbac-proxy\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807063 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807096 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-thanos-prometheus-http-client-file\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807122 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-kubelet-serving-ca-bundle\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807172 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807202 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-2\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807230 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-web-config\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807248 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-trusted-ca-bundle\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807272 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-metrics-client-certs\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807763 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807294 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-db\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807763 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807313 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-grpc-tls\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807763 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807330 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-1\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807763 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807357 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-0\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807763 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807383 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-metrics-client-ca\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807763 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807425 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-serving-certs-ca-bundle\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807763 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807456 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-tls-assets\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.807763 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807480 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7pzs\" (UniqueName: \"kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-kube-api-access-v7pzs\") pod \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\" (UID: \"5ea34457-85bb-47f7-a3e8-6a76b895d9fc\") " Jul 07 10:30:16.808176 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.807808 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:30:16.808641 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.808600 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:30:16.808763 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.808673 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:30:16.809036 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.809007 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:30:16.809451 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.809423 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:30:16.809986 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.809958 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:30:16.810758 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.810661 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:30:16.810883 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.810858 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config-out" (OuterVolumeSpecName: "config-out") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 10:30:16.810945 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.810858 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:30:16.810996 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.810950 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-kube-api-access-v7pzs" (OuterVolumeSpecName: "kube-api-access-v7pzs") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "kube-api-access-v7pzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:30:16.811092 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.811060 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:30:16.811599 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.811571 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 10:30:16.811942 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.811918 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:30:16.812375 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.812262 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:30:16.812375 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.812294 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config" (OuterVolumeSpecName: "config") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:30:16.812614 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.812565 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:30:16.812675 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.812653 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:30:16.812735 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.812685 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:30:16.813669 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.813643 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:30:16.822023 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.822003 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-web-config" (OuterVolumeSpecName: "web-config") pod "5ea34457-85bb-47f7-a3e8-6a76b895d9fc" (UID: "5ea34457-85bb-47f7-a3e8-6a76b895d9fc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:30:16.908648 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908563 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-web-config\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908648 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908596 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908648 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908609 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-metrics-client-certs\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908648 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908618 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-db\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908648 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908627 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-grpc-tls\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908648 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908635 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908648 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908643 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908648 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908651 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-metrics-client-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908659 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908668 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-tls-assets\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908678 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7pzs\" (UniqueName: \"kubernetes.io/projected/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-kube-api-access-v7pzs\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908687 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config-out\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908695 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908703 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908712 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-kube-rbac-proxy\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908720 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-config\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908729 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908738 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908747 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:16.908992 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:16.908756 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ea34457-85bb-47f7-a3e8-6a76b895d9fc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:17.599809 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.599771 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ea34457-85bb-47f7-a3e8-6a76b895d9fc","Type":"ContainerDied","Data":"a6432a4ad10bf27ad68b68988a9ce2a1a1119ff0d515ba606ea61d63170fe4cd"} Jul 07 10:30:17.600200 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.599835 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.600200 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.599868 2566 scope.go:117] "RemoveContainer" containerID="d7111a38a3c5b9cb49187d936ba17f7a08ac3e9aaa8817802e5657746c6df0a0" Jul 07 10:30:17.607677 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.607536 2566 scope.go:117] "RemoveContainer" containerID="b3529e1fbf13c78c66033a2ce8414e60eb00b47ba10f638e1b857f21e0f3347c" Jul 07 10:30:17.614457 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.614441 2566 scope.go:117] "RemoveContainer" containerID="fbae50426a0761e33af468b55a865060442376574393b080529420ed63686378" Jul 07 10:30:17.620763 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.620746 2566 scope.go:117] "RemoveContainer" containerID="02205187644f3e853edd64d5b464ac8fc50452aec3a8e3603db1b91f9f5f990c" Jul 07 10:30:17.627348 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.627318 2566 scope.go:117] "RemoveContainer" containerID="7b609d6b55fe9532c6e622beaf7322bb536fc92ef4afb4c0982c16a6182f06b3" Jul 07 10:30:17.628343 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.628321 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 10:30:17.634783 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.634652 2566 scope.go:117] "RemoveContainer" containerID="9d602ca5af3859b73280deb060f5b18c77a2595a311bcc4632802cbfd9611fd5" Jul 07 10:30:17.636028 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.636008 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 10:30:17.641558 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.641544 2566 scope.go:117] "RemoveContainer" containerID="5a3f2e446d2c7794bf66881b17234646b7daeae4d17924b7764e5b1576895d58" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.674631 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675197 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy-thanos" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675214 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy-thanos" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675237 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3240e4a-fbec-452c-b218-35b21002a1d3" containerName="registry" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675246 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3240e4a-fbec-452c-b218-35b21002a1d3" containerName="registry" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675260 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="prometheus" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675268 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="prometheus" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675287 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="config-reloader" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675296 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="config-reloader" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675315 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy-web" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675323 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy-web" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675338 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="init-config-reloader" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675348 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="init-config-reloader" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675362 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675371 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675383 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="thanos-sidecar" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675392 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="thanos-sidecar" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675504 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="thanos-sidecar" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675520 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy-thanos" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675529 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="prometheus" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675539 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy-web" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675554 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3240e4a-fbec-452c-b218-35b21002a1d3" containerName="registry" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675562 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="config-reloader" Jul 07 10:30:17.677421 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.675570 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" containerName="kube-rbac-proxy" Jul 07 10:30:17.681183 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.681164 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.687669 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.687652 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 10:30:17.689081 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.689066 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 10:30:17.689358 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.689340 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 10:30:17.689418 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.689356 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 10:30:17.689581 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.689569 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dpf2l54r2mg8b\"" Jul 07 10:30:17.689656 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.689639 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 10:30:17.689715 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.689644 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vjdj2\"" Jul 07 10:30:17.689781 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.689710 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 10:30:17.689859 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.689843 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 10:30:17.689991 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.689976 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 10:30:17.690060 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.690020 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 10:30:17.690116 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.690103 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 10:30:17.690218 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.690205 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 10:30:17.690293 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.690278 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 10:30:17.690465 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.690452 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 10:30:17.695138 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.695123 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 10:30:17.700412 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.700397 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 10:30:17.707670 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.707648 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 10:30:17.714390 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.714366 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ea34457-85bb-47f7-a3e8-6a76b895d9fc" path="/var/lib/kubelet/pods/5ea34457-85bb-47f7-a3e8-6a76b895d9fc/volumes" Jul 07 10:30:17.814365 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814365 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814371 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814620 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814399 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814620 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814423 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-config\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814620 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814440 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814620 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814459 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/005d2248-7cf6-40cb-9f7a-6ab652059668-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814620 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814477 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814620 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814535 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814940 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2vzw\" (UniqueName: \"kubernetes.io/projected/005d2248-7cf6-40cb-9f7a-6ab652059668-kube-api-access-r2vzw\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814940 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814673 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/005d2248-7cf6-40cb-9f7a-6ab652059668-config-out\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814940 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814725 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814940 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814940 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814802 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814940 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814940 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814940 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.814940 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814930 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-web-config\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.815394 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814975 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.815394 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.814999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.815394 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.815030 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.915666 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.915616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.915666 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.915672 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-web-config\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.915906 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.915698 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.915906 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.915721 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.915906 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.915747 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.915906 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.915780 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916109 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.915920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916109 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.915967 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916109 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.915998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-config\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916109 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916024 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916109 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/005d2248-7cf6-40cb-9f7a-6ab652059668-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916109 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916109 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916103 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916498 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916130 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2vzw\" (UniqueName: \"kubernetes.io/projected/005d2248-7cf6-40cb-9f7a-6ab652059668-kube-api-access-r2vzw\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916498 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916184 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/005d2248-7cf6-40cb-9f7a-6ab652059668-config-out\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916498 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916216 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916498 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916498 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916498 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916498 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916498 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916383 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.916498 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916469 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.917058 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.916946 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.918838 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.918731 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.918838 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.918791 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.919060 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.918965 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.920189 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.919404 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.920189 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.919793 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.920189 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.919800 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.920189 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.920105 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/005d2248-7cf6-40cb-9f7a-6ab652059668-config-out\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.920444 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.920208 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-web-config\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.920543 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.920521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.921261 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.921238 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/005d2248-7cf6-40cb-9f7a-6ab652059668-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.921341 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.921287 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.921543 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.921519 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-config\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.921903 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.921879 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/005d2248-7cf6-40cb-9f7a-6ab652059668-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.921973 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.921908 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.922539 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.922520 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.922840 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.922821 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/005d2248-7cf6-40cb-9f7a-6ab652059668-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.927655 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.927593 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2vzw\" (UniqueName: \"kubernetes.io/projected/005d2248-7cf6-40cb-9f7a-6ab652059668-kube-api-access-r2vzw\") pod \"prometheus-k8s-0\" (UID: \"005d2248-7cf6-40cb-9f7a-6ab652059668\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:17.989703 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:17.989667 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:18.132545 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:18.132507 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 10:30:18.135559 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:30:18.135532 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005d2248_7cf6_40cb_9f7a_6ab652059668.slice/crio-3749fa1f7103f70a292af6508dde04f72c5f28eb81930e298ee9f7c72d293c84 WatchSource:0}: Error finding container 3749fa1f7103f70a292af6508dde04f72c5f28eb81930e298ee9f7c72d293c84: Status 404 returned error can't find the container with id 3749fa1f7103f70a292af6508dde04f72c5f28eb81930e298ee9f7c72d293c84 Jul 07 10:30:18.605305 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:18.605269 2566 generic.go:356] "Generic (PLEG): container finished" podID="005d2248-7cf6-40cb-9f7a-6ab652059668" containerID="986a20f6c62a4b85be14bb5db1eda76733dfee523ec92684829f38792462da19" exitCode=0 Jul 07 10:30:18.605733 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:18.605352 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"005d2248-7cf6-40cb-9f7a-6ab652059668","Type":"ContainerDied","Data":"986a20f6c62a4b85be14bb5db1eda76733dfee523ec92684829f38792462da19"} Jul 07 10:30:18.605733 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:18.605417 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"005d2248-7cf6-40cb-9f7a-6ab652059668","Type":"ContainerStarted","Data":"3749fa1f7103f70a292af6508dde04f72c5f28eb81930e298ee9f7c72d293c84"} Jul 07 10:30:19.613748 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:19.613711 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"005d2248-7cf6-40cb-9f7a-6ab652059668","Type":"ContainerStarted","Data":"eed11dea1d5c8fab67d099195f0a0647c7183bff006c44afff566299868d6c9d"} Jul 07 10:30:19.614139 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:19.613805 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"005d2248-7cf6-40cb-9f7a-6ab652059668","Type":"ContainerStarted","Data":"a41398507bf1dee588a9bdf1871118206b5315215dadba3b75aaadba099c6084"} Jul 07 10:30:19.614139 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:19.613837 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"005d2248-7cf6-40cb-9f7a-6ab652059668","Type":"ContainerStarted","Data":"d7987c4f13af7f5b11d9e8cb836c87fb43d679ebc84da810a2a75c520270cea2"} Jul 07 10:30:19.614139 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:19.613862 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"005d2248-7cf6-40cb-9f7a-6ab652059668","Type":"ContainerStarted","Data":"0ed4b058167f82e89ec075618c72bb93afc8f72993cc3eee264b5ce9090576bb"} Jul 07 10:30:19.614139 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:19.613885 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"005d2248-7cf6-40cb-9f7a-6ab652059668","Type":"ContainerStarted","Data":"749984de5013f3c750b3f412b41dde54f8e47887847d5bfe048e7e8eca7d1dc6"} Jul 07 10:30:19.614139 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:19.613908 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"005d2248-7cf6-40cb-9f7a-6ab652059668","Type":"ContainerStarted","Data":"0ccd8328d25f752cae570fa710fb81403c9122daef646671ae04494441bb7749"} Jul 07 10:30:19.649394 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:19.649328 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.63003239 podStartE2EDuration="2.649312119s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.279729ms" isStatefulPod=false podCreationTimestamp="2026-07-07 10:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:30:19.64768436 +0000 UTC m=+178.420277416" watchObservedRunningTime="2026-07-07 10:30:19.649312119 +0000 UTC m=+178.421905174" Jul 07 10:30:22.990544 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:22.990493 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:30:30.731809 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:30.731771 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86cdb8c998-jggrd"] Jul 07 10:30:55.752857 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:55.752792 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86cdb8c998-jggrd" podUID="8f163779-ab7b-4535-8802-2d1df1fdddf6" containerName="console" containerID="cri-o://33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542" gracePeriod=15 Jul 07 10:30:55.995815 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:55.995783 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:30:56.112207 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.112130 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-trusted-ca-bundle\") pod \"8f163779-ab7b-4535-8802-2d1df1fdddf6\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " Jul 07 10:30:56.112207 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.112205 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-serving-cert\") pod \"8f163779-ab7b-4535-8802-2d1df1fdddf6\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " Jul 07 10:30:56.112466 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.112248 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-config\") pod \"8f163779-ab7b-4535-8802-2d1df1fdddf6\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " Jul 07 10:30:56.112466 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.112276 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-oauth-serving-cert\") pod \"8f163779-ab7b-4535-8802-2d1df1fdddf6\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " Jul 07 10:30:56.112466 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.112323 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-oauth-config\") pod \"8f163779-ab7b-4535-8802-2d1df1fdddf6\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " Jul 07 10:30:56.112466 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.112346 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-service-ca\") pod \"8f163779-ab7b-4535-8802-2d1df1fdddf6\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " Jul 07 10:30:56.112466 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.112388 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzfnn\" (UniqueName: \"kubernetes.io/projected/8f163779-ab7b-4535-8802-2d1df1fdddf6-kube-api-access-mzfnn\") pod \"8f163779-ab7b-4535-8802-2d1df1fdddf6\" (UID: \"8f163779-ab7b-4535-8802-2d1df1fdddf6\") " Jul 07 10:30:56.112749 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.112697 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-config" (OuterVolumeSpecName: "console-config") pod "8f163779-ab7b-4535-8802-2d1df1fdddf6" (UID: "8f163779-ab7b-4535-8802-2d1df1fdddf6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:30:56.112749 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.112727 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8f163779-ab7b-4535-8802-2d1df1fdddf6" (UID: "8f163779-ab7b-4535-8802-2d1df1fdddf6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:30:56.112749 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.112611 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8f163779-ab7b-4535-8802-2d1df1fdddf6" (UID: "8f163779-ab7b-4535-8802-2d1df1fdddf6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:30:56.112996 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.112816 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-service-ca" (OuterVolumeSpecName: "service-ca") pod "8f163779-ab7b-4535-8802-2d1df1fdddf6" (UID: "8f163779-ab7b-4535-8802-2d1df1fdddf6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:30:56.114745 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.114705 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8f163779-ab7b-4535-8802-2d1df1fdddf6" (UID: "8f163779-ab7b-4535-8802-2d1df1fdddf6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:30:56.114847 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.114763 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f163779-ab7b-4535-8802-2d1df1fdddf6-kube-api-access-mzfnn" (OuterVolumeSpecName: "kube-api-access-mzfnn") pod "8f163779-ab7b-4535-8802-2d1df1fdddf6" (UID: "8f163779-ab7b-4535-8802-2d1df1fdddf6"). InnerVolumeSpecName "kube-api-access-mzfnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:30:56.114847 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.114761 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8f163779-ab7b-4535-8802-2d1df1fdddf6" (UID: "8f163779-ab7b-4535-8802-2d1df1fdddf6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:30:56.212970 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.212932 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:56.212970 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.212966 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzfnn\" (UniqueName: \"kubernetes.io/projected/8f163779-ab7b-4535-8802-2d1df1fdddf6-kube-api-access-mzfnn\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:56.212970 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.212975 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-trusted-ca-bundle\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:56.213239 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.212988 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-serving-cert\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:56.213239 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.212996 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-config\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:56.213239 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.213005 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f163779-ab7b-4535-8802-2d1df1fdddf6-oauth-serving-cert\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:56.213239 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.213012 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f163779-ab7b-4535-8802-2d1df1fdddf6-console-oauth-config\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:30:56.753676 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.753639 2566 generic.go:356] "Generic (PLEG): container finished" podID="8f163779-ab7b-4535-8802-2d1df1fdddf6" containerID="33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542" exitCode=0 Jul 07 10:30:56.754071 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.753705 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cdb8c998-jggrd" Jul 07 10:30:56.754071 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.753727 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cdb8c998-jggrd" event={"ID":"8f163779-ab7b-4535-8802-2d1df1fdddf6","Type":"ContainerDied","Data":"33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542"} Jul 07 10:30:56.754071 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.753780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cdb8c998-jggrd" event={"ID":"8f163779-ab7b-4535-8802-2d1df1fdddf6","Type":"ContainerDied","Data":"e299168d6dd5d99c13fcfceb85200aabe05cf3856254d01a598dcb6290724585"} Jul 07 10:30:56.754071 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.753799 2566 scope.go:117] "RemoveContainer" containerID="33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542" Jul 07 10:30:56.762653 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.762632 2566 scope.go:117] "RemoveContainer" containerID="33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542" Jul 07 10:30:56.762953 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:30:56.762934 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542\": container with ID starting with 33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542 not found: ID does not exist" containerID="33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542" Jul 07 10:30:56.763021 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.762962 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542"} err="failed to get container status \"33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542\": rpc error: code = NotFound desc = could not find container \"33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542\": container with ID starting with 33ca638f87047844f3f324102cd7149c7886431c30df62bd974ad28646e21542 not found: ID does not exist" Jul 07 10:30:56.775815 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.775781 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86cdb8c998-jggrd"] Jul 07 10:30:56.778973 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:56.778945 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86cdb8c998-jggrd"] Jul 07 10:30:57.714170 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:30:57.714115 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f163779-ab7b-4535-8802-2d1df1fdddf6" path="/var/lib/kubelet/pods/8f163779-ab7b-4535-8802-2d1df1fdddf6/volumes" Jul 07 10:31:17.990731 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:31:17.990687 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:31:18.007597 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:31:18.007567 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:31:18.852430 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:31:18.852405 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 10:32:21.605155 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:21.605104 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:32:21.615063 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:21.615033 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 10:32:21.615063 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:21.615064 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:32:51.856969 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:51.856939 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl"] Jul 07 10:32:51.859311 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:51.857240 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f163779-ab7b-4535-8802-2d1df1fdddf6" containerName="console" Jul 07 10:32:51.859311 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:51.857252 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f163779-ab7b-4535-8802-2d1df1fdddf6" containerName="console" Jul 07 10:32:51.859311 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:51.857301 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f163779-ab7b-4535-8802-2d1df1fdddf6" containerName="console" Jul 07 10:32:51.860137 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:51.860122 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl" Jul 07 10:32:51.863113 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:51.863090 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 10:32:51.863244 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:51.863094 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5kxgs\"" Jul 07 10:32:51.863244 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:51.863127 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 10:32:51.868306 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:51.868286 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl"] Jul 07 10:32:51.928967 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:51.928935 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce4224de-1aac-4aa1-9b58-93619783df13-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xrcdl\" (UID: \"ce4224de-1aac-4aa1-9b58-93619783df13\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl" Jul 07 10:32:51.929442 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:51.929000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh7wv\" (UniqueName: \"kubernetes.io/projected/ce4224de-1aac-4aa1-9b58-93619783df13-kube-api-access-wh7wv\") pod \"cert-manager-cainjector-559cdd8c87-xrcdl\" (UID: \"ce4224de-1aac-4aa1-9b58-93619783df13\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl" Jul 07 10:32:52.030649 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:52.030619 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce4224de-1aac-4aa1-9b58-93619783df13-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xrcdl\" (UID: \"ce4224de-1aac-4aa1-9b58-93619783df13\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl" Jul 07 10:32:52.030802 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:52.030678 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh7wv\" (UniqueName: \"kubernetes.io/projected/ce4224de-1aac-4aa1-9b58-93619783df13-kube-api-access-wh7wv\") pod \"cert-manager-cainjector-559cdd8c87-xrcdl\" (UID: \"ce4224de-1aac-4aa1-9b58-93619783df13\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl" Jul 07 10:32:52.040267 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:52.040235 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce4224de-1aac-4aa1-9b58-93619783df13-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xrcdl\" (UID: \"ce4224de-1aac-4aa1-9b58-93619783df13\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl" Jul 07 10:32:52.040388 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:52.040336 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh7wv\" (UniqueName: \"kubernetes.io/projected/ce4224de-1aac-4aa1-9b58-93619783df13-kube-api-access-wh7wv\") pod \"cert-manager-cainjector-559cdd8c87-xrcdl\" (UID: \"ce4224de-1aac-4aa1-9b58-93619783df13\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl" Jul 07 10:32:52.183281 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:52.183198 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl" Jul 07 10:32:52.319562 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:52.319534 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl"] Jul 07 10:32:52.323683 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:32:52.323656 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce4224de_1aac_4aa1_9b58_93619783df13.slice/crio-2532f11d84d7638a5af36b4ac5404a46d82a733fc0d1a0c6e14aaea57cf2f327 WatchSource:0}: Error finding container 2532f11d84d7638a5af36b4ac5404a46d82a733fc0d1a0c6e14aaea57cf2f327: Status 404 returned error can't find the container with id 2532f11d84d7638a5af36b4ac5404a46d82a733fc0d1a0c6e14aaea57cf2f327 Jul 07 10:32:52.325771 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:52.325752 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 10:32:53.192203 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:53.192134 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl" event={"ID":"ce4224de-1aac-4aa1-9b58-93619783df13","Type":"ContainerStarted","Data":"2532f11d84d7638a5af36b4ac5404a46d82a733fc0d1a0c6e14aaea57cf2f327"} Jul 07 10:32:56.206848 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:56.206814 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl" event={"ID":"ce4224de-1aac-4aa1-9b58-93619783df13","Type":"ContainerStarted","Data":"3b2bd12b33686d3ea2ae1c0546bb64cb45ee0677329453e86d16ef8e305b9950"} Jul 07 10:32:56.241369 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:32:56.241312 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrcdl" podStartSLOduration=2.296312119 podStartE2EDuration="5.241292242s" totalImagesPullingTime="2.944980123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:32:56.238473488 +0000 UTC m=+335.011066542" watchObservedRunningTime="2026-07-07 10:32:56.241292242 +0000 UTC m=+335.013885296" Jul 07 10:33:01.670983 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:01.670948 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6ln5k"] Jul 07 10:33:01.674234 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:01.674218 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6ln5k" Jul 07 10:33:01.677058 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:01.677036 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nfxgs\"" Jul 07 10:33:01.684582 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:01.684561 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6ln5k"] Jul 07 10:33:01.713976 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:01.713951 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee223a31-380b-4439-a823-a20109367ac7-bound-sa-token\") pod \"cert-manager-55b4d954d5-6ln5k\" (UID: \"ee223a31-380b-4439-a823-a20109367ac7\") " pod="cert-manager/cert-manager-55b4d954d5-6ln5k" Jul 07 10:33:01.714096 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:01.713987 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kds7h\" (UniqueName: \"kubernetes.io/projected/ee223a31-380b-4439-a823-a20109367ac7-kube-api-access-kds7h\") pod \"cert-manager-55b4d954d5-6ln5k\" (UID: \"ee223a31-380b-4439-a823-a20109367ac7\") " pod="cert-manager/cert-manager-55b4d954d5-6ln5k" Jul 07 10:33:01.814708 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:01.814684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee223a31-380b-4439-a823-a20109367ac7-bound-sa-token\") pod \"cert-manager-55b4d954d5-6ln5k\" (UID: \"ee223a31-380b-4439-a823-a20109367ac7\") " pod="cert-manager/cert-manager-55b4d954d5-6ln5k" Jul 07 10:33:01.814892 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:01.814723 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kds7h\" (UniqueName: \"kubernetes.io/projected/ee223a31-380b-4439-a823-a20109367ac7-kube-api-access-kds7h\") pod \"cert-manager-55b4d954d5-6ln5k\" (UID: \"ee223a31-380b-4439-a823-a20109367ac7\") " pod="cert-manager/cert-manager-55b4d954d5-6ln5k" Jul 07 10:33:01.826295 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:01.826267 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee223a31-380b-4439-a823-a20109367ac7-bound-sa-token\") pod \"cert-manager-55b4d954d5-6ln5k\" (UID: \"ee223a31-380b-4439-a823-a20109367ac7\") " pod="cert-manager/cert-manager-55b4d954d5-6ln5k" Jul 07 10:33:01.826450 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:01.826432 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kds7h\" (UniqueName: \"kubernetes.io/projected/ee223a31-380b-4439-a823-a20109367ac7-kube-api-access-kds7h\") pod \"cert-manager-55b4d954d5-6ln5k\" (UID: \"ee223a31-380b-4439-a823-a20109367ac7\") " pod="cert-manager/cert-manager-55b4d954d5-6ln5k" Jul 07 10:33:01.983484 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:01.983399 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6ln5k" Jul 07 10:33:02.113678 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:02.113647 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6ln5k"] Jul 07 10:33:02.116692 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:33:02.116664 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee223a31_380b_4439_a823_a20109367ac7.slice/crio-e42b7621576669586f282d096b9a7b20a7a24c4c30bedfc0475126c9a8088d47 WatchSource:0}: Error finding container e42b7621576669586f282d096b9a7b20a7a24c4c30bedfc0475126c9a8088d47: Status 404 returned error can't find the container with id e42b7621576669586f282d096b9a7b20a7a24c4c30bedfc0475126c9a8088d47 Jul 07 10:33:02.229323 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:02.229293 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6ln5k" event={"ID":"ee223a31-380b-4439-a823-a20109367ac7","Type":"ContainerStarted","Data":"db46043d33527cf9876d97029b7ea5e14579ddb583dc4cdc8afe89714d7cf46e"} Jul 07 10:33:02.229323 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:02.229332 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6ln5k" event={"ID":"ee223a31-380b-4439-a823-a20109367ac7","Type":"ContainerStarted","Data":"e42b7621576669586f282d096b9a7b20a7a24c4c30bedfc0475126c9a8088d47"} Jul 07 10:33:02.250731 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:02.250641 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6ln5k" podStartSLOduration=1.250627972 podStartE2EDuration="1.250627972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:33:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:33:02.248863437 +0000 UTC m=+341.021456492" watchObservedRunningTime="2026-07-07 10:33:02.250627972 +0000 UTC m=+341.023221026" Jul 07 10:33:22.319077 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.319005 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg"] Jul 07 10:33:22.322836 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.322819 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.326546 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.326528 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 10:33:22.326546 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.326539 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 10:33:22.326838 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.326826 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 10:33:22.327181 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.327166 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 10:33:22.327408 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.327392 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9dx5k\"" Jul 07 10:33:22.377398 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.377364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46cab4c-308f-46b6-97cb-580a8f56cdfc-webhook-cert\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.377564 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.377414 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b46cab4c-308f-46b6-97cb-580a8f56cdfc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.377564 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.377445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55gfm\" (UniqueName: \"kubernetes.io/projected/b46cab4c-308f-46b6-97cb-580a8f56cdfc-kube-api-access-55gfm\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.377564 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.377478 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b46cab4c-308f-46b6-97cb-580a8f56cdfc-manifests\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.377564 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.377540 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b46cab4c-308f-46b6-97cb-580a8f56cdfc-tmp\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.381890 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.381863 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg"] Jul 07 10:33:22.477891 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.477862 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46cab4c-308f-46b6-97cb-580a8f56cdfc-webhook-cert\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.478059 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.477899 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b46cab4c-308f-46b6-97cb-580a8f56cdfc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.478059 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.477919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55gfm\" (UniqueName: \"kubernetes.io/projected/b46cab4c-308f-46b6-97cb-580a8f56cdfc-kube-api-access-55gfm\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.478059 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.477948 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b46cab4c-308f-46b6-97cb-580a8f56cdfc-manifests\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.478059 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.477987 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b46cab4c-308f-46b6-97cb-580a8f56cdfc-tmp\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.478452 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.478423 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b46cab4c-308f-46b6-97cb-580a8f56cdfc-manifests\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.480253 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.480232 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b46cab4c-308f-46b6-97cb-580a8f56cdfc-tmp\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.480458 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.480441 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b46cab4c-308f-46b6-97cb-580a8f56cdfc-webhook-cert\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.480575 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.480557 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b46cab4c-308f-46b6-97cb-580a8f56cdfc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.499766 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.499738 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55gfm\" (UniqueName: \"kubernetes.io/projected/b46cab4c-308f-46b6-97cb-580a8f56cdfc-kube-api-access-55gfm\") pod \"opendatahub-operator-controller-manager-586fcf4d5b-vvjjg\" (UID: \"b46cab4c-308f-46b6-97cb-580a8f56cdfc\") " pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.632882 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.632797 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:22.793249 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:22.793208 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg"] Jul 07 10:33:22.797016 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:33:22.796986 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46cab4c_308f_46b6_97cb_580a8f56cdfc.slice/crio-33dea800af7dfdb954b3d0321043a259686bd2ad6333b4c971f8ad52e6c950b2 WatchSource:0}: Error finding container 33dea800af7dfdb954b3d0321043a259686bd2ad6333b4c971f8ad52e6c950b2: Status 404 returned error can't find the container with id 33dea800af7dfdb954b3d0321043a259686bd2ad6333b4c971f8ad52e6c950b2 Jul 07 10:33:23.309310 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:23.309276 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" event={"ID":"b46cab4c-308f-46b6-97cb-580a8f56cdfc","Type":"ContainerStarted","Data":"33dea800af7dfdb954b3d0321043a259686bd2ad6333b4c971f8ad52e6c950b2"} Jul 07 10:33:26.323582 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:26.323545 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" event={"ID":"b46cab4c-308f-46b6-97cb-580a8f56cdfc","Type":"ContainerStarted","Data":"cb18042d77406652ff60e470e103ca62d9557ba2b18c84687fe7bbba3a35d183"} Jul 07 10:33:27.328924 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:27.328886 2566 generic.go:356] "Generic (PLEG): container finished" podID="b46cab4c-308f-46b6-97cb-580a8f56cdfc" containerID="cb18042d77406652ff60e470e103ca62d9557ba2b18c84687fe7bbba3a35d183" exitCode=0 Jul 07 10:33:27.329335 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:27.328964 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" event={"ID":"b46cab4c-308f-46b6-97cb-580a8f56cdfc","Type":"ContainerDied","Data":"cb18042d77406652ff60e470e103ca62d9557ba2b18c84687fe7bbba3a35d183"} Jul 07 10:33:28.335638 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:28.335598 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" event={"ID":"b46cab4c-308f-46b6-97cb-580a8f56cdfc","Type":"ContainerStarted","Data":"109cbf6560189d2abad2c4ad1d070148573c79d7c63a0c574043012ca912d2c1"} Jul 07 10:33:28.336175 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:28.335722 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:28.361951 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:28.361890 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" podStartSLOduration=1.914078518 podStartE2EDuration="6.361867477s" totalImagesPullingTime="3.430036328s" totalInitContainerRuntime="1.017752631s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:33:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:33:28.358795112 +0000 UTC m=+367.131388171" watchObservedRunningTime="2026-07-07 10:33:28.361867477 +0000 UTC m=+367.134460533" Jul 07 10:33:39.341398 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:39.341367 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-586fcf4d5b-vvjjg" Jul 07 10:33:43.885535 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:43.885504 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n8bdc"] Jul 07 10:33:43.889243 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:43.889219 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" Jul 07 10:33:43.892653 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:43.892627 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-x5zsn\"" Jul 07 10:33:43.892976 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:43.892944 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 10:33:43.943186 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:43.943136 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n8bdc"] Jul 07 10:33:44.059465 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:44.059429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4982133-c9aa-42b1-a48e-f8c5ee204f27-tls-certs\") pod \"model-serving-api-54d89bd5fc-n8bdc\" (UID: \"c4982133-c9aa-42b1-a48e-f8c5ee204f27\") " pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" Jul 07 10:33:44.059630 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:44.059504 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmb4x\" (UniqueName: \"kubernetes.io/projected/c4982133-c9aa-42b1-a48e-f8c5ee204f27-kube-api-access-bmb4x\") pod \"model-serving-api-54d89bd5fc-n8bdc\" (UID: \"c4982133-c9aa-42b1-a48e-f8c5ee204f27\") " pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" Jul 07 10:33:44.161487 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:44.160446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4982133-c9aa-42b1-a48e-f8c5ee204f27-tls-certs\") pod \"model-serving-api-54d89bd5fc-n8bdc\" (UID: \"c4982133-c9aa-42b1-a48e-f8c5ee204f27\") " pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" Jul 07 10:33:44.161487 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:44.160599 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmb4x\" (UniqueName: \"kubernetes.io/projected/c4982133-c9aa-42b1-a48e-f8c5ee204f27-kube-api-access-bmb4x\") pod \"model-serving-api-54d89bd5fc-n8bdc\" (UID: \"c4982133-c9aa-42b1-a48e-f8c5ee204f27\") " pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" Jul 07 10:33:44.166527 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:44.166495 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4982133-c9aa-42b1-a48e-f8c5ee204f27-tls-certs\") pod \"model-serving-api-54d89bd5fc-n8bdc\" (UID: \"c4982133-c9aa-42b1-a48e-f8c5ee204f27\") " pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" Jul 07 10:33:44.177690 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:44.177655 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmb4x\" (UniqueName: \"kubernetes.io/projected/c4982133-c9aa-42b1-a48e-f8c5ee204f27-kube-api-access-bmb4x\") pod \"model-serving-api-54d89bd5fc-n8bdc\" (UID: \"c4982133-c9aa-42b1-a48e-f8c5ee204f27\") " pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" Jul 07 10:33:44.199935 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:44.199901 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" Jul 07 10:33:44.352317 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:44.352287 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n8bdc"] Jul 07 10:33:44.355758 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:33:44.355733 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4982133_c9aa_42b1_a48e_f8c5ee204f27.slice/crio-c4c0b31cdf28763895b31f97f60850a5e10b6b49f993f4f8ece82b4dd8bf9a30 WatchSource:0}: Error finding container c4c0b31cdf28763895b31f97f60850a5e10b6b49f993f4f8ece82b4dd8bf9a30: Status 404 returned error can't find the container with id c4c0b31cdf28763895b31f97f60850a5e10b6b49f993f4f8ece82b4dd8bf9a30 Jul 07 10:33:44.395771 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:44.395744 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" event={"ID":"c4982133-c9aa-42b1-a48e-f8c5ee204f27","Type":"ContainerStarted","Data":"c4c0b31cdf28763895b31f97f60850a5e10b6b49f993f4f8ece82b4dd8bf9a30"} Jul 07 10:33:47.412937 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:47.412893 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" event={"ID":"c4982133-c9aa-42b1-a48e-f8c5ee204f27","Type":"ContainerStarted","Data":"f6ee5fb377798c958b4e08ac5d8b992fe04232589fa6c18aeab1f85b76fdf00a"} Jul 07 10:33:47.413606 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:47.412984 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" Jul 07 10:33:47.436494 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:47.436438 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" podStartSLOduration=2.139984639 podStartE2EDuration="4.436422213s" totalImagesPullingTime="2.296437574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:33:47.434408933 +0000 UTC m=+386.207001997" watchObservedRunningTime="2026-07-07 10:33:47.436422213 +0000 UTC m=+386.209015267" Jul 07 10:33:49.792989 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.792956 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q"] Jul 07 10:33:49.796205 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.796189 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:49.801126 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.801066 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lgdmg\"" Jul 07 10:33:49.801126 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.801100 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 10:33:49.801339 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.801069 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 10:33:49.801339 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.801226 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 10:33:49.801566 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.801549 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 10:33:49.807042 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.807025 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 10:33:49.812792 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.812765 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q"] Jul 07 10:33:49.918378 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.918324 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlnfq\" (UniqueName: \"kubernetes.io/projected/b81902a9-14c8-4e3e-831f-9228c883c1b9-kube-api-access-nlnfq\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:49.918378 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.918382 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b81902a9-14c8-4e3e-831f-9228c883c1b9-cert\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:49.918628 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.918468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b81902a9-14c8-4e3e-831f-9228c883c1b9-metrics-cert\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:49.918628 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:49.918530 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b81902a9-14c8-4e3e-831f-9228c883c1b9-manager-config\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:50.019480 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.019446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b81902a9-14c8-4e3e-831f-9228c883c1b9-metrics-cert\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:50.019633 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.019498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b81902a9-14c8-4e3e-831f-9228c883c1b9-manager-config\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:50.019633 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.019519 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlnfq\" (UniqueName: \"kubernetes.io/projected/b81902a9-14c8-4e3e-831f-9228c883c1b9-kube-api-access-nlnfq\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:50.019633 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.019546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b81902a9-14c8-4e3e-831f-9228c883c1b9-cert\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:50.020223 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.020138 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b81902a9-14c8-4e3e-831f-9228c883c1b9-manager-config\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:50.022006 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.021982 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b81902a9-14c8-4e3e-831f-9228c883c1b9-metrics-cert\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:50.022159 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.022127 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b81902a9-14c8-4e3e-831f-9228c883c1b9-cert\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:50.056676 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.056614 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlnfq\" (UniqueName: \"kubernetes.io/projected/b81902a9-14c8-4e3e-831f-9228c883c1b9-kube-api-access-nlnfq\") pod \"lws-controller-manager-59649ddfff-b9x2q\" (UID: \"b81902a9-14c8-4e3e-831f-9228c883c1b9\") " pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:50.104696 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.104664 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:50.316126 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:33:50.316088 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81902a9_14c8_4e3e_831f_9228c883c1b9.slice/crio-9d8e99b4fffdf18a17da047c0ebb9945a402cc5703cfa9aec3736493369cdd2f WatchSource:0}: Error finding container 9d8e99b4fffdf18a17da047c0ebb9945a402cc5703cfa9aec3736493369cdd2f: Status 404 returned error can't find the container with id 9d8e99b4fffdf18a17da047c0ebb9945a402cc5703cfa9aec3736493369cdd2f Jul 07 10:33:50.318528 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.318497 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q"] Jul 07 10:33:50.426026 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.425995 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" event={"ID":"b81902a9-14c8-4e3e-831f-9228c883c1b9","Type":"ContainerStarted","Data":"9d8e99b4fffdf18a17da047c0ebb9945a402cc5703cfa9aec3736493369cdd2f"} Jul 07 10:33:50.803525 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.803496 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp"] Jul 07 10:33:50.807766 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.807749 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.811689 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.811667 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 10:33:50.811816 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.811715 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 10:33:50.812881 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.812857 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 10:33:50.813017 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.812915 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 10:33:50.813017 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.812942 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 10:33:50.813176 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.813122 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jcgdm\"" Jul 07 10:33:50.813698 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.813682 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 10:33:50.824457 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.824431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.824561 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.824462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.824561 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.824479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.824561 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.824522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7283885-f05c-4996-b58e-0e0821d70ab8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.824690 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.824573 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.824690 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.824601 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8bmn\" (UniqueName: \"kubernetes.io/projected/c7283885-f05c-4996-b58e-0e0821d70ab8-kube-api-access-g8bmn\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.824690 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.824621 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c7283885-f05c-4996-b58e-0e0821d70ab8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.923551 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.923517 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp"] Jul 07 10:33:50.925546 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.925506 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8bmn\" (UniqueName: \"kubernetes.io/projected/c7283885-f05c-4996-b58e-0e0821d70ab8-kube-api-access-g8bmn\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.925783 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.925551 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c7283885-f05c-4996-b58e-0e0821d70ab8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.925783 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.925613 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.925783 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.925644 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.925783 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.925672 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.925783 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.925717 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7283885-f05c-4996-b58e-0e0821d70ab8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.925783 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.925754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.926826 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.926781 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.929160 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.929094 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.929629 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.929587 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c7283885-f05c-4996-b58e-0e0821d70ab8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.930396 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.930369 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.931002 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.930959 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7283885-f05c-4996-b58e-0e0821d70ab8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.946027 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.945993 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7283885-f05c-4996-b58e-0e0821d70ab8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:50.947600 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:50.947575 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8bmn\" (UniqueName: \"kubernetes.io/projected/c7283885-f05c-4996-b58e-0e0821d70ab8-kube-api-access-g8bmn\") pod \"istiod-openshift-gateway-94bb8fbfd-zxssp\" (UID: \"c7283885-f05c-4996-b58e-0e0821d70ab8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:51.117474 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:51.117391 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:51.307270 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:51.307248 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp"] Jul 07 10:33:51.310861 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:33:51.310831 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7283885_f05c_4996_b58e_0e0821d70ab8.slice/crio-ac72045063e5503c713f538f6dc8129abc69298e25deffdd59693caf994944fe WatchSource:0}: Error finding container ac72045063e5503c713f538f6dc8129abc69298e25deffdd59693caf994944fe: Status 404 returned error can't find the container with id ac72045063e5503c713f538f6dc8129abc69298e25deffdd59693caf994944fe Jul 07 10:33:51.432863 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:51.432782 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" event={"ID":"c7283885-f05c-4996-b58e-0e0821d70ab8","Type":"ContainerStarted","Data":"ac72045063e5503c713f538f6dc8129abc69298e25deffdd59693caf994944fe"} Jul 07 10:33:53.445455 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:53.445413 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" event={"ID":"b81902a9-14c8-4e3e-831f-9228c883c1b9","Type":"ContainerStarted","Data":"fb70009f7d9ff0420d0069bf552ecc57f73b85c41a0fce4a2f97e12b7684d798"} Jul 07 10:33:53.445939 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:53.445589 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:33:53.480870 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:53.480812 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" podStartSLOduration=2.122803851 podStartE2EDuration="4.480791111s" totalImagesPullingTime="2.35798726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:33:53.477834713 +0000 UTC m=+392.250427769" watchObservedRunningTime="2026-07-07 10:33:53.480791111 +0000 UTC m=+392.253384166" Jul 07 10:33:54.108993 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:54.108942 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 10:33:54.109116 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:54.109035 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 10:33:54.452274 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:54.452175 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" event={"ID":"c7283885-f05c-4996-b58e-0e0821d70ab8","Type":"ContainerStarted","Data":"43186993bcd9f202bcf168ebf5b1bb62e9f75ddf323066483f161e80ebc6cdbe"} Jul 07 10:33:54.452737 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:54.452275 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:54.537883 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:54.537836 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" podStartSLOduration=1.7428785549999999 podStartE2EDuration="4.537818784s" totalImagesPullingTime="2.794940229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:33:54.53736471 +0000 UTC m=+393.309957765" watchObservedRunningTime="2026-07-07 10:33:54.537818784 +0000 UTC m=+393.310411839" Jul 07 10:33:55.459243 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:55.459212 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zxssp" Jul 07 10:33:58.420736 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:33:58.420691 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-n8bdc" Jul 07 10:34:04.454600 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:34:04.454569 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59649ddfff-b9x2q" Jul 07 10:35:48.398831 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.398794 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh"] Jul 07 10:35:48.401119 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.401103 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:35:48.404199 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.404178 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 10:35:48.404324 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.404223 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mx77n\"" Jul 07 10:35:48.404324 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.404307 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 10:35:48.422051 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.422025 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh"] Jul 07 10:35:48.511849 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.511811 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-965tn\" (UniqueName: \"kubernetes.io/projected/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-kube-api-access-965tn\") pod \"kuadrant-operator-controller-manager-86878c769f-z8xrh\" (UID: \"0b01524e-c0dd-44d3-8bbb-33c4fc99939e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:35:48.512026 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.511866 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z8xrh\" (UID: \"0b01524e-c0dd-44d3-8bbb-33c4fc99939e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:35:48.612708 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.612667 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-965tn\" (UniqueName: \"kubernetes.io/projected/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-kube-api-access-965tn\") pod \"kuadrant-operator-controller-manager-86878c769f-z8xrh\" (UID: \"0b01524e-c0dd-44d3-8bbb-33c4fc99939e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:35:48.612870 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.612734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z8xrh\" (UID: \"0b01524e-c0dd-44d3-8bbb-33c4fc99939e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:35:48.613192 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.613170 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z8xrh\" (UID: \"0b01524e-c0dd-44d3-8bbb-33c4fc99939e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:35:48.626953 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.626930 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-965tn\" (UniqueName: \"kubernetes.io/projected/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-kube-api-access-965tn\") pod \"kuadrant-operator-controller-manager-86878c769f-z8xrh\" (UID: \"0b01524e-c0dd-44d3-8bbb-33c4fc99939e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:35:48.711772 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.711679 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:35:48.851949 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.851917 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh"] Jul 07 10:35:48.853253 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:35:48.853227 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b01524e_c0dd_44d3_8bbb_33c4fc99939e.slice/crio-d4d82ac334d86602c27e65b97dde754e5032212dce39a91930acbcdb8657475d WatchSource:0}: Error finding container d4d82ac334d86602c27e65b97dde754e5032212dce39a91930acbcdb8657475d: Status 404 returned error can't find the container with id d4d82ac334d86602c27e65b97dde754e5032212dce39a91930acbcdb8657475d Jul 07 10:35:48.924039 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:48.924006 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" event={"ID":"0b01524e-c0dd-44d3-8bbb-33c4fc99939e","Type":"ContainerStarted","Data":"d4d82ac334d86602c27e65b97dde754e5032212dce39a91930acbcdb8657475d"} Jul 07 10:35:53.951672 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:53.951634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" event={"ID":"0b01524e-c0dd-44d3-8bbb-33c4fc99939e","Type":"ContainerStarted","Data":"07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414"} Jul 07 10:35:53.952168 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:53.951805 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:35:53.975668 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:35:53.975625 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" podStartSLOduration=1.039241467 podStartE2EDuration="5.975608389s" totalImagesPullingTime="4.936366922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:35:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:35:53.973011653 +0000 UTC m=+512.745604710" watchObservedRunningTime="2026-07-07 10:35:53.975608389 +0000 UTC m=+512.748201444" Jul 07 10:36:04.958508 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:36:04.958471 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:36:59.940767 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:36:59.940736 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56979f55b7-pzg22"] Jul 07 10:36:59.943009 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:36:59.942992 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:00.006705 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.006676 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nvnr\" (UniqueName: \"kubernetes.io/projected/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-kube-api-access-7nvnr\") pod \"maas-controller-56979f55b7-pzg22\" (UID: \"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb\") " pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:00.006823 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.006718 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-webhook-cert\") pod \"maas-controller-56979f55b7-pzg22\" (UID: \"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb\") " pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:00.015188 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.015138 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 10:37:00.068548 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.068527 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 10:37:00.069011 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.068994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ctqxp\"" Jul 07 10:37:00.107534 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.107495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nvnr\" (UniqueName: \"kubernetes.io/projected/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-kube-api-access-7nvnr\") pod \"maas-controller-56979f55b7-pzg22\" (UID: \"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb\") " pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:00.107693 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.107546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-webhook-cert\") pod \"maas-controller-56979f55b7-pzg22\" (UID: \"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb\") " pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:00.111976 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.110274 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-webhook-cert\") pod \"maas-controller-56979f55b7-pzg22\" (UID: \"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb\") " pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:00.121377 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.121354 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56979f55b7-pzg22"] Jul 07 10:37:00.214709 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.214640 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nvnr\" (UniqueName: \"kubernetes.io/projected/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-kube-api-access-7nvnr\") pod \"maas-controller-56979f55b7-pzg22\" (UID: \"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb\") " pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:00.253128 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.253097 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:00.528764 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:37:00.528725 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8aaa0dd_1f41_4b9a_a92c_e720f4f8e6cb.slice/crio-5ffd3b3eb4cf1a4d68ed0b7c02125c6ee1fc99063278f75dfc46a72147353379 WatchSource:0}: Error finding container 5ffd3b3eb4cf1a4d68ed0b7c02125c6ee1fc99063278f75dfc46a72147353379: Status 404 returned error can't find the container with id 5ffd3b3eb4cf1a4d68ed0b7c02125c6ee1fc99063278f75dfc46a72147353379 Jul 07 10:37:00.529354 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:00.529332 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56979f55b7-pzg22"] Jul 07 10:37:01.246689 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:01.246652 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56979f55b7-pzg22" event={"ID":"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb","Type":"ContainerStarted","Data":"5ffd3b3eb4cf1a4d68ed0b7c02125c6ee1fc99063278f75dfc46a72147353379"} Jul 07 10:37:03.257587 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:03.257550 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56979f55b7-pzg22" event={"ID":"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb","Type":"ContainerStarted","Data":"8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef"} Jul 07 10:37:03.258006 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:03.257686 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:03.365106 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:03.365046 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56979f55b7-pzg22" podStartSLOduration=2.344936714 podStartE2EDuration="4.365022563s" totalImagesPullingTime="2.020085849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:37:03.364439552 +0000 UTC m=+582.137032609" watchObservedRunningTime="2026-07-07 10:37:03.365022563 +0000 UTC m=+582.137615610" Jul 07 10:37:14.269662 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:14.269626 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:14.823559 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:14.823519 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56979f55b7-pzg22"] Jul 07 10:37:14.823753 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:14.823729 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-56979f55b7-pzg22" podUID="c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb" containerName="manager" containerID="cri-o://8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef" gracePeriod=30 Jul 07 10:37:15.059853 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.059830 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:15.134752 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.134661 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-webhook-cert\") pod \"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb\" (UID: \"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb\") " Jul 07 10:37:15.134752 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.134744 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nvnr\" (UniqueName: \"kubernetes.io/projected/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-kube-api-access-7nvnr\") pod \"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb\" (UID: \"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb\") " Jul 07 10:37:15.136919 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.136891 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb" (UID: "c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:37:15.137021 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.136918 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-kube-api-access-7nvnr" (OuterVolumeSpecName: "kube-api-access-7nvnr") pod "c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb" (UID: "c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb"). InnerVolumeSpecName "kube-api-access-7nvnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:37:15.236379 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.236339 2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-webhook-cert\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:37:15.236379 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.236374 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nvnr\" (UniqueName: \"kubernetes.io/projected/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb-kube-api-access-7nvnr\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:37:15.316121 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.316089 2566 generic.go:356] "Generic (PLEG): container finished" podID="c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb" containerID="8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef" exitCode=0 Jul 07 10:37:15.316533 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.316130 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56979f55b7-pzg22" Jul 07 10:37:15.316533 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.316173 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56979f55b7-pzg22" event={"ID":"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb","Type":"ContainerDied","Data":"8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef"} Jul 07 10:37:15.316533 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.316221 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56979f55b7-pzg22" event={"ID":"c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb","Type":"ContainerDied","Data":"5ffd3b3eb4cf1a4d68ed0b7c02125c6ee1fc99063278f75dfc46a72147353379"} Jul 07 10:37:15.316533 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.316246 2566 scope.go:117] "RemoveContainer" containerID="8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef" Jul 07 10:37:15.324710 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.324694 2566 scope.go:117] "RemoveContainer" containerID="8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef" Jul 07 10:37:15.325008 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:37:15.324989 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef\": container with ID starting with 8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef not found: ID does not exist" containerID="8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef" Jul 07 10:37:15.325062 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.325015 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef"} err="failed to get container status \"8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef\": rpc error: code = NotFound desc = could not find container \"8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef\": container with ID starting with 8c17f4553a26a4f90ed6cd0e703fc59204fd506d2b3ab11087d9f0a267d002ef not found: ID does not exist" Jul 07 10:37:15.338643 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.338620 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56979f55b7-pzg22"] Jul 07 10:37:15.343474 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.343453 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56979f55b7-pzg22"] Jul 07 10:37:15.714102 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:15.714069 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb" path="/var/lib/kubelet/pods/c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb/volumes" Jul 07 10:37:21.638573 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:21.638538 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:37:21.642350 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:21.642323 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:37:33.944602 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:33.944570 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-jd6m4"] Jul 07 10:37:33.945019 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:33.944879 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb" containerName="manager" Jul 07 10:37:33.945019 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:33.944892 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb" containerName="manager" Jul 07 10:37:33.945019 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:33.944953 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8aaa0dd-1f41-4b9a-a92c-e720f4f8e6cb" containerName="manager" Jul 07 10:37:33.949186 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:33.949170 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" Jul 07 10:37:33.953490 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:33.953469 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rd2tb\"" Jul 07 10:37:33.953715 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:33.953693 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 10:37:33.973519 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:33.973487 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-jd6m4"] Jul 07 10:37:34.100322 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:34.100288 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/844ae801-2c15-43ba-b478-e35e2cc911c6-plugins-config-volume\") pod \"payload-processing-58f86c7798-jd6m4\" (UID: \"844ae801-2c15-43ba-b478-e35e2cc911c6\") " pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" Jul 07 10:37:34.100322 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:34.100320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxkxx\" (UniqueName: \"kubernetes.io/projected/844ae801-2c15-43ba-b478-e35e2cc911c6-kube-api-access-cxkxx\") pod \"payload-processing-58f86c7798-jd6m4\" (UID: \"844ae801-2c15-43ba-b478-e35e2cc911c6\") " pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" Jul 07 10:37:34.201182 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:34.201054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/844ae801-2c15-43ba-b478-e35e2cc911c6-plugins-config-volume\") pod \"payload-processing-58f86c7798-jd6m4\" (UID: \"844ae801-2c15-43ba-b478-e35e2cc911c6\") " pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" Jul 07 10:37:34.201182 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:34.201095 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxkxx\" (UniqueName: \"kubernetes.io/projected/844ae801-2c15-43ba-b478-e35e2cc911c6-kube-api-access-cxkxx\") pod \"payload-processing-58f86c7798-jd6m4\" (UID: \"844ae801-2c15-43ba-b478-e35e2cc911c6\") " pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" Jul 07 10:37:34.201871 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:34.201851 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/844ae801-2c15-43ba-b478-e35e2cc911c6-plugins-config-volume\") pod \"payload-processing-58f86c7798-jd6m4\" (UID: \"844ae801-2c15-43ba-b478-e35e2cc911c6\") " pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" Jul 07 10:37:34.214097 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:34.214059 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxkxx\" (UniqueName: \"kubernetes.io/projected/844ae801-2c15-43ba-b478-e35e2cc911c6-kube-api-access-cxkxx\") pod \"payload-processing-58f86c7798-jd6m4\" (UID: \"844ae801-2c15-43ba-b478-e35e2cc911c6\") " pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" Jul 07 10:37:34.259959 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:34.259927 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" Jul 07 10:37:34.398452 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:34.398430 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-jd6m4"] Jul 07 10:37:34.400557 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:37:34.400524 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844ae801_2c15_43ba_b478_e35e2cc911c6.slice/crio-3ebe5b1feee4226fbcacf1efb1349bdffa55c8af1fa2ccb1a59c41ff2241aa39 WatchSource:0}: Error finding container 3ebe5b1feee4226fbcacf1efb1349bdffa55c8af1fa2ccb1a59c41ff2241aa39: Status 404 returned error can't find the container with id 3ebe5b1feee4226fbcacf1efb1349bdffa55c8af1fa2ccb1a59c41ff2241aa39 Jul 07 10:37:35.409573 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:35.409531 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" event={"ID":"844ae801-2c15-43ba-b478-e35e2cc911c6","Type":"ContainerStarted","Data":"3ebe5b1feee4226fbcacf1efb1349bdffa55c8af1fa2ccb1a59c41ff2241aa39"} Jul 07 10:37:36.415504 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:36.415460 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" event={"ID":"844ae801-2c15-43ba-b478-e35e2cc911c6","Type":"ContainerStarted","Data":"4db4725c0bddd35d960dea91b1a3c2262026beeca4cb3bbbb18ed0e18cd6bcd1"} Jul 07 10:37:36.415958 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:36.415549 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" Jul 07 10:37:36.440484 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:36.440425 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" podStartSLOduration=1.9571595670000002 podStartE2EDuration="3.440406428s" totalImagesPullingTime="1.483246861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:37:36.438654009 +0000 UTC m=+615.211247066" watchObservedRunningTime="2026-07-07 10:37:36.440406428 +0000 UTC m=+615.212999525" Jul 07 10:37:47.421374 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:37:47.421296 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-jd6m4" Jul 07 10:38:03.985110 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:03.985069 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s"] Jul 07 10:38:03.988504 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:03.988484 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:03.995088 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:03.995050 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 10:38:03.995265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:03.995112 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6qgk6\"" Jul 07 10:38:03.995683 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:03.995374 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 10:38:03.995741 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:03.995704 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 10:38:04.010409 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.010378 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s"] Jul 07 10:38:04.047952 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.047913 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0adee05-36b9-4af1-8954-584020b665dc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.048173 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.048058 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.048173 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.048101 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v872j\" (UniqueName: \"kubernetes.io/projected/f0adee05-36b9-4af1-8954-584020b665dc-kube-api-access-v872j\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.048173 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.048139 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.048414 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.048213 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.048414 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.048248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.149316 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.149282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.149316 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.149322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.149578 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.149430 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0adee05-36b9-4af1-8954-584020b665dc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.149578 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.149486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.149578 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.149516 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v872j\" (UniqueName: \"kubernetes.io/projected/f0adee05-36b9-4af1-8954-584020b665dc-kube-api-access-v872j\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.149578 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.149542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.149850 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.149827 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.149933 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.149851 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.149933 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.149888 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.151782 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.151764 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0adee05-36b9-4af1-8954-584020b665dc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.152188 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.152169 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0adee05-36b9-4af1-8954-584020b665dc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.172753 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.172712 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v872j\" (UniqueName: \"kubernetes.io/projected/f0adee05-36b9-4af1-8954-584020b665dc-kube-api-access-v872j\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sw68s\" (UID: \"f0adee05-36b9-4af1-8954-584020b665dc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.299671 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.299633 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:04.432610 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.432580 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s"] Jul 07 10:38:04.436199 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:38:04.436167 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0adee05_36b9_4af1_8954_584020b665dc.slice/crio-c3e0eb91c486e5f817c59578bc67325bddb0fb151277446f0ffaef92e6c0771e WatchSource:0}: Error finding container c3e0eb91c486e5f817c59578bc67325bddb0fb151277446f0ffaef92e6c0771e: Status 404 returned error can't find the container with id c3e0eb91c486e5f817c59578bc67325bddb0fb151277446f0ffaef92e6c0771e Jul 07 10:38:04.437534 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.437516 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 10:38:04.539729 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:04.539696 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" event={"ID":"f0adee05-36b9-4af1-8954-584020b665dc","Type":"ContainerStarted","Data":"c3e0eb91c486e5f817c59578bc67325bddb0fb151277446f0ffaef92e6c0771e"} Jul 07 10:38:05.546494 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:05.546466 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" event={"ID":"f0adee05-36b9-4af1-8954-584020b665dc","Type":"ContainerStarted","Data":"aba15c4cfab4bb209335ed91dc424d18d4bf77df7608434da7dcb3c199222614"} Jul 07 10:38:05.574465 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:05.574408 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" podStartSLOduration=1.546682224 podStartE2EDuration="2.574392656s" totalImagesPullingTime="1.027710432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:38:05.57237092 +0000 UTC m=+644.344963979" watchObservedRunningTime="2026-07-07 10:38:05.574392656 +0000 UTC m=+644.346985711" Jul 07 10:38:14.300468 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:14.300428 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:14.300895 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:14.300496 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:14.313431 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:14.313408 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:14.597780 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:14.597693 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sw68s" Jul 07 10:38:16.779866 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.779822 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l"] Jul 07 10:38:16.783402 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.783379 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.786865 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.786848 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 07 10:38:16.798597 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.798574 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l"] Jul 07 10:38:16.863797 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.863768 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.863954 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.863833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6nl8\" (UniqueName: \"kubernetes.io/projected/91aa3626-a3d0-4af4-baad-2911857124d7-kube-api-access-t6nl8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.863954 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.863905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.863954 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.863936 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.864069 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.863969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.864069 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.864016 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91aa3626-a3d0-4af4-baad-2911857124d7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.965120 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.965083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.965120 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.965126 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.965379 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.965191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.965379 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.965218 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91aa3626-a3d0-4af4-baad-2911857124d7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.965379 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.965263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.965379 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.965324 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6nl8\" (UniqueName: \"kubernetes.io/projected/91aa3626-a3d0-4af4-baad-2911857124d7-kube-api-access-t6nl8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.965608 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.965581 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.965744 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.965647 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.965744 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.965692 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.967676 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.967650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91aa3626-a3d0-4af4-baad-2911857124d7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.967899 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.967878 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91aa3626-a3d0-4af4-baad-2911857124d7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:16.976274 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:16.976252 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6nl8\" (UniqueName: \"kubernetes.io/projected/91aa3626-a3d0-4af4-baad-2911857124d7-kube-api-access-t6nl8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gp4l\" (UID: \"91aa3626-a3d0-4af4-baad-2911857124d7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:17.093120 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:17.093093 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:17.236113 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:17.236070 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l"] Jul 07 10:38:17.239391 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:38:17.239359 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91aa3626_a3d0_4af4_baad_2911857124d7.slice/crio-b6dfcae9534c4f29b4c19a1f7fb2c75dcd9ea9d4cf267fc5057483e9088c5dd9 WatchSource:0}: Error finding container b6dfcae9534c4f29b4c19a1f7fb2c75dcd9ea9d4cf267fc5057483e9088c5dd9: Status 404 returned error can't find the container with id b6dfcae9534c4f29b4c19a1f7fb2c75dcd9ea9d4cf267fc5057483e9088c5dd9 Jul 07 10:38:17.601292 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:17.601259 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" event={"ID":"91aa3626-a3d0-4af4-baad-2911857124d7","Type":"ContainerStarted","Data":"9e967daa90f38dbf56bd8c3588ff6ef0443d3ec4180b60c7af4bf15a5d293929"} Jul 07 10:38:17.601477 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:17.601309 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" event={"ID":"91aa3626-a3d0-4af4-baad-2911857124d7","Type":"ContainerStarted","Data":"b6dfcae9534c4f29b4c19a1f7fb2c75dcd9ea9d4cf267fc5057483e9088c5dd9"} Jul 07 10:38:17.625767 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:17.625721 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" podStartSLOduration=1.424316005 podStartE2EDuration="1.625703208s" totalImagesPullingTime="201.387203ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:38:17.623063519 +0000 UTC m=+656.395656574" watchObservedRunningTime="2026-07-07 10:38:17.625703208 +0000 UTC m=+656.398296263" Jul 07 10:38:27.094269 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:27.094227 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:27.094767 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:27.094330 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:27.106695 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:27.106669 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:38:27.657988 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:38:27.657959 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gp4l" Jul 07 10:42:21.667054 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:42:21.666978 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:42:21.670747 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:42:21.670721 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:45:00.153871 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:00.153835 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723685-5nnw6"] Jul 07 10:45:00.157392 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:00.157376 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" Jul 07 10:45:00.160812 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:00.160791 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qlm6h\"" Jul 07 10:45:00.175800 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:00.175778 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723685-5nnw6"] Jul 07 10:45:00.268451 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:00.268411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6szsx\" (UniqueName: \"kubernetes.io/projected/717f8bba-08a8-496f-a4a2-86341d864711-kube-api-access-6szsx\") pod \"maas-api-key-cleanup-29723685-5nnw6\" (UID: \"717f8bba-08a8-496f-a4a2-86341d864711\") " pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" Jul 07 10:45:00.369489 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:00.369431 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6szsx\" (UniqueName: \"kubernetes.io/projected/717f8bba-08a8-496f-a4a2-86341d864711-kube-api-access-6szsx\") pod \"maas-api-key-cleanup-29723685-5nnw6\" (UID: \"717f8bba-08a8-496f-a4a2-86341d864711\") " pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" Jul 07 10:45:00.379536 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:00.379508 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6szsx\" (UniqueName: \"kubernetes.io/projected/717f8bba-08a8-496f-a4a2-86341d864711-kube-api-access-6szsx\") pod \"maas-api-key-cleanup-29723685-5nnw6\" (UID: \"717f8bba-08a8-496f-a4a2-86341d864711\") " pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" Jul 07 10:45:00.468115 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:00.468031 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" Jul 07 10:45:00.603930 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:00.603902 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723685-5nnw6"] Jul 07 10:45:00.605707 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:45:00.605675 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717f8bba_08a8_496f_a4a2_86341d864711.slice/crio-aa7b236e7536aa56cb8625e736cd12c13ff3e08c3a8671a360c0539b51064067 WatchSource:0}: Error finding container aa7b236e7536aa56cb8625e736cd12c13ff3e08c3a8671a360c0539b51064067: Status 404 returned error can't find the container with id aa7b236e7536aa56cb8625e736cd12c13ff3e08c3a8671a360c0539b51064067 Jul 07 10:45:00.607658 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:00.607641 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 10:45:01.440097 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:01.440065 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" event={"ID":"717f8bba-08a8-496f-a4a2-86341d864711","Type":"ContainerStarted","Data":"aa7b236e7536aa56cb8625e736cd12c13ff3e08c3a8671a360c0539b51064067"} Jul 07 10:45:03.451960 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:03.451925 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" event={"ID":"717f8bba-08a8-496f-a4a2-86341d864711","Type":"ContainerStarted","Data":"c5115c4e85a4f90a8c5fcc0f8efbff849ed9b03840993658667e1ec84c8f5235"} Jul 07 10:45:03.473425 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:03.473374 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" podStartSLOduration=1.410847234 podStartE2EDuration="3.473357878s" totalImagesPullingTime="2.062510644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:45:03.470791604 +0000 UTC m=+1062.243384659" watchObservedRunningTime="2026-07-07 10:45:03.473357878 +0000 UTC m=+1062.245950933" Jul 07 10:45:04.458269 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:04.458234 2566 generic.go:356] "Generic (PLEG): container finished" podID="717f8bba-08a8-496f-a4a2-86341d864711" containerID="c5115c4e85a4f90a8c5fcc0f8efbff849ed9b03840993658667e1ec84c8f5235" exitCode=0 Jul 07 10:45:04.458648 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:04.458319 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" event={"ID":"717f8bba-08a8-496f-a4a2-86341d864711","Type":"ContainerDied","Data":"c5115c4e85a4f90a8c5fcc0f8efbff849ed9b03840993658667e1ec84c8f5235"} Jul 07 10:45:05.591704 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:05.591672 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" Jul 07 10:45:05.718804 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:05.718733 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6szsx\" (UniqueName: \"kubernetes.io/projected/717f8bba-08a8-496f-a4a2-86341d864711-kube-api-access-6szsx\") pod \"717f8bba-08a8-496f-a4a2-86341d864711\" (UID: \"717f8bba-08a8-496f-a4a2-86341d864711\") " Jul 07 10:45:05.720896 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:05.720864 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717f8bba-08a8-496f-a4a2-86341d864711-kube-api-access-6szsx" (OuterVolumeSpecName: "kube-api-access-6szsx") pod "717f8bba-08a8-496f-a4a2-86341d864711" (UID: "717f8bba-08a8-496f-a4a2-86341d864711"). InnerVolumeSpecName "kube-api-access-6szsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:45:05.820176 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:05.820127 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6szsx\" (UniqueName: \"kubernetes.io/projected/717f8bba-08a8-496f-a4a2-86341d864711-kube-api-access-6szsx\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:45:06.470355 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:06.470320 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" event={"ID":"717f8bba-08a8-496f-a4a2-86341d864711","Type":"ContainerDied","Data":"aa7b236e7536aa56cb8625e736cd12c13ff3e08c3a8671a360c0539b51064067"} Jul 07 10:45:06.470355 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:06.470361 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723685-5nnw6" Jul 07 10:45:06.470568 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:06.470369 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa7b236e7536aa56cb8625e736cd12c13ff3e08c3a8671a360c0539b51064067" Jul 07 10:45:30.416265 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.416183 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-778bd455c8-kqf45"] Jul 07 10:45:30.416642 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.416546 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717f8bba-08a8-496f-a4a2-86341d864711" containerName="cleanup" Jul 07 10:45:30.416642 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.416559 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="717f8bba-08a8-496f-a4a2-86341d864711" containerName="cleanup" Jul 07 10:45:30.416642 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.416614 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="717f8bba-08a8-496f-a4a2-86341d864711" containerName="cleanup" Jul 07 10:45:30.419728 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.419708 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.426912 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.426885 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 10:45:30.427032 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.426985 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 10:45:30.427032 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.427021 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 10:45:30.427180 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.427102 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 10:45:30.428360 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.428334 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 10:45:30.428445 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.428414 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d4kbr\"" Jul 07 10:45:30.428445 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.428422 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 10:45:30.428518 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.428422 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 10:45:30.438654 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.438637 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 10:45:30.457706 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.457684 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-778bd455c8-kqf45"] Jul 07 10:45:30.536962 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.536925 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-console-serving-cert\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.536962 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.536959 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-service-ca\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.537216 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.536999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhp62\" (UniqueName: \"kubernetes.io/projected/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-kube-api-access-lhp62\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.537216 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.537060 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-console-config\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.537216 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.537092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-trusted-ca-bundle\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.537216 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.537110 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-oauth-serving-cert\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.537216 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.537137 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-console-oauth-config\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.639278 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.639228 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-trusted-ca-bundle\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.639453 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.639293 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-oauth-serving-cert\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.639453 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.639343 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-console-oauth-config\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.639453 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.639432 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-console-serving-cert\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.639623 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.639466 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-service-ca\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.639623 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.639530 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhp62\" (UniqueName: \"kubernetes.io/projected/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-kube-api-access-lhp62\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.639623 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.639590 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-console-config\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.640356 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.640329 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-console-config\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.640869 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.640837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-service-ca\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.641567 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.641542 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-oauth-serving-cert\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.642828 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.642805 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-console-serving-cert\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.643864 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.643833 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-trusted-ca-bundle\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.643997 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.643977 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-console-oauth-config\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.652048 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.652024 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhp62\" (UniqueName: \"kubernetes.io/projected/e36e94b8-ec3d-4fd0-82aa-77479af6d1c4-kube-api-access-lhp62\") pod \"console-778bd455c8-kqf45\" (UID: \"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4\") " pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.728915 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.728834 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:30.894695 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:30.894667 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-778bd455c8-kqf45"] Jul 07 10:45:30.895931 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:45:30.895909 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36e94b8_ec3d_4fd0_82aa_77479af6d1c4.slice/crio-3dbe2cd03ad73885a98ea26c961f3fcb814ef6d5eb67c562d89e39f9690f619e WatchSource:0}: Error finding container 3dbe2cd03ad73885a98ea26c961f3fcb814ef6d5eb67c562d89e39f9690f619e: Status 404 returned error can't find the container with id 3dbe2cd03ad73885a98ea26c961f3fcb814ef6d5eb67c562d89e39f9690f619e Jul 07 10:45:31.591769 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:31.591735 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-778bd455c8-kqf45" event={"ID":"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4","Type":"ContainerStarted","Data":"0f7ecb56589cf76d67cfa65322d5321da872fe34672bf8095f663279c304fc54"} Jul 07 10:45:31.592362 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:31.591784 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-778bd455c8-kqf45" event={"ID":"e36e94b8-ec3d-4fd0-82aa-77479af6d1c4","Type":"ContainerStarted","Data":"3dbe2cd03ad73885a98ea26c961f3fcb814ef6d5eb67c562d89e39f9690f619e"} Jul 07 10:45:31.691135 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:31.691084 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-778bd455c8-kqf45" podStartSLOduration=1.691070122 podStartE2EDuration="1.691070122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:45:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:45:31.689274275 +0000 UTC m=+1090.461867331" watchObservedRunningTime="2026-07-07 10:45:31.691070122 +0000 UTC m=+1090.463663177" Jul 07 10:45:32.200224 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:32.200179 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh"] Jul 07 10:45:32.200503 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:32.200436 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" podUID="0b01524e-c0dd-44d3-8bbb-33c4fc99939e" containerName="manager" containerID="cri-o://07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414" gracePeriod=10 Jul 07 10:45:34.857078 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:34.857053 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:45:34.878264 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:34.878234 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-extensions-socket-volume\") pod \"0b01524e-c0dd-44d3-8bbb-33c4fc99939e\" (UID: \"0b01524e-c0dd-44d3-8bbb-33c4fc99939e\") " Jul 07 10:45:34.878461 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:34.878306 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-965tn\" (UniqueName: \"kubernetes.io/projected/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-kube-api-access-965tn\") pod \"0b01524e-c0dd-44d3-8bbb-33c4fc99939e\" (UID: \"0b01524e-c0dd-44d3-8bbb-33c4fc99939e\") " Jul 07 10:45:34.878791 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:34.878766 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0b01524e-c0dd-44d3-8bbb-33c4fc99939e" (UID: "0b01524e-c0dd-44d3-8bbb-33c4fc99939e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 10:45:34.881506 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:34.881306 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-kube-api-access-965tn" (OuterVolumeSpecName: "kube-api-access-965tn") pod "0b01524e-c0dd-44d3-8bbb-33c4fc99939e" (UID: "0b01524e-c0dd-44d3-8bbb-33c4fc99939e"). InnerVolumeSpecName "kube-api-access-965tn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:45:34.979021 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:34.978947 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-extensions-socket-volume\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:45:34.979021 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:34.978975 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-965tn\" (UniqueName: \"kubernetes.io/projected/0b01524e-c0dd-44d3-8bbb-33c4fc99939e-kube-api-access-965tn\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:45:35.611886 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:35.611850 2566 generic.go:356] "Generic (PLEG): container finished" podID="0b01524e-c0dd-44d3-8bbb-33c4fc99939e" containerID="07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414" exitCode=0 Jul 07 10:45:35.612061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:35.611894 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" Jul 07 10:45:35.612061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:35.611913 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" event={"ID":"0b01524e-c0dd-44d3-8bbb-33c4fc99939e","Type":"ContainerDied","Data":"07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414"} Jul 07 10:45:35.612061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:35.611984 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh" event={"ID":"0b01524e-c0dd-44d3-8bbb-33c4fc99939e","Type":"ContainerDied","Data":"d4d82ac334d86602c27e65b97dde754e5032212dce39a91930acbcdb8657475d"} Jul 07 10:45:35.612061 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:35.612005 2566 scope.go:117] "RemoveContainer" containerID="07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414" Jul 07 10:45:35.621644 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:35.621628 2566 scope.go:117] "RemoveContainer" containerID="07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414" Jul 07 10:45:35.621897 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:45:35.621879 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414\": container with ID starting with 07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414 not found: ID does not exist" containerID="07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414" Jul 07 10:45:35.621957 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:35.621905 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414"} err="failed to get container status \"07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414\": rpc error: code = NotFound desc = could not find container \"07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414\": container with ID starting with 07113055170ef0cedcdfd179d365af6eaeb96fcb6997ad87ded728eeadade414 not found: ID does not exist" Jul 07 10:45:35.635646 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:35.635618 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh"] Jul 07 10:45:35.639859 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:35.639839 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z8xrh"] Jul 07 10:45:35.715043 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:35.715018 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b01524e-c0dd-44d3-8bbb-33c4fc99939e" path="/var/lib/kubelet/pods/0b01524e-c0dd-44d3-8bbb-33c4fc99939e/volumes" Jul 07 10:45:40.728967 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:40.728933 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:40.729354 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:40.728981 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:40.733774 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:40.733753 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:45:41.644071 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:45:41.644040 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-778bd455c8-kqf45" Jul 07 10:46:33.443044 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.442988 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv"] Jul 07 10:46:33.443835 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.443809 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b01524e-c0dd-44d3-8bbb-33c4fc99939e" containerName="manager" Jul 07 10:46:33.443916 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.443839 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b01524e-c0dd-44d3-8bbb-33c4fc99939e" containerName="manager" Jul 07 10:46:33.444041 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.444027 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b01524e-c0dd-44d3-8bbb-33c4fc99939e" containerName="manager" Jul 07 10:46:33.449351 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.449324 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" Jul 07 10:46:33.455037 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.455009 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 10:46:33.455194 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.455017 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 10:46:33.455194 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.455100 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mx77n\"" Jul 07 10:46:33.463785 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.463754 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv"] Jul 07 10:46:33.493095 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.493056 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53ac7782-8049-47af-a6ed-da810d054ec4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kbldv\" (UID: \"53ac7782-8049-47af-a6ed-da810d054ec4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" Jul 07 10:46:33.493306 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.493106 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjlnq\" (UniqueName: \"kubernetes.io/projected/53ac7782-8049-47af-a6ed-da810d054ec4-kube-api-access-jjlnq\") pod \"kuadrant-operator-controller-manager-86878c769f-kbldv\" (UID: \"53ac7782-8049-47af-a6ed-da810d054ec4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" Jul 07 10:46:33.594010 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.593967 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53ac7782-8049-47af-a6ed-da810d054ec4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kbldv\" (UID: \"53ac7782-8049-47af-a6ed-da810d054ec4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" Jul 07 10:46:33.594239 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.594033 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlnq\" (UniqueName: \"kubernetes.io/projected/53ac7782-8049-47af-a6ed-da810d054ec4-kube-api-access-jjlnq\") pod \"kuadrant-operator-controller-manager-86878c769f-kbldv\" (UID: \"53ac7782-8049-47af-a6ed-da810d054ec4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" Jul 07 10:46:33.594402 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.594381 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53ac7782-8049-47af-a6ed-da810d054ec4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kbldv\" (UID: \"53ac7782-8049-47af-a6ed-da810d054ec4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" Jul 07 10:46:33.607398 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.607375 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjlnq\" (UniqueName: \"kubernetes.io/projected/53ac7782-8049-47af-a6ed-da810d054ec4-kube-api-access-jjlnq\") pod \"kuadrant-operator-controller-manager-86878c769f-kbldv\" (UID: \"53ac7782-8049-47af-a6ed-da810d054ec4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" Jul 07 10:46:33.759698 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.759603 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" Jul 07 10:46:33.909281 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:33.909257 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv"] Jul 07 10:46:33.912565 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:46:33.912535 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ac7782_8049_47af_a6ed_da810d054ec4.slice/crio-7773100a787e13add0d72cde43f7fc4561565fec6ffac071a3da4b4b8bbb24a8 WatchSource:0}: Error finding container 7773100a787e13add0d72cde43f7fc4561565fec6ffac071a3da4b4b8bbb24a8: Status 404 returned error can't find the container with id 7773100a787e13add0d72cde43f7fc4561565fec6ffac071a3da4b4b8bbb24a8 Jul 07 10:46:34.887069 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:34.887032 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" event={"ID":"53ac7782-8049-47af-a6ed-da810d054ec4","Type":"ContainerStarted","Data":"5a9313ae6c64df1ecff3f9aa5a7faa52e3a563996b88c0cad1a0f9ed0aeaef62"} Jul 07 10:46:34.887532 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:34.887086 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" event={"ID":"53ac7782-8049-47af-a6ed-da810d054ec4","Type":"ContainerStarted","Data":"7773100a787e13add0d72cde43f7fc4561565fec6ffac071a3da4b4b8bbb24a8"} Jul 07 10:46:34.887532 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:34.887107 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" Jul 07 10:46:34.909885 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:34.909833 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" podStartSLOduration=1.909818802 podStartE2EDuration="1.909818802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:46:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:46:34.907659048 +0000 UTC m=+1153.680252103" watchObservedRunningTime="2026-07-07 10:46:34.909818802 +0000 UTC m=+1153.682411857" Jul 07 10:46:45.894975 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:46:45.894895 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kbldv" Jul 07 10:47:21.697523 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:47:21.697493 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:47:21.698059 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:47:21.697832 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:52:21.725496 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:21.725458 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:52:21.728073 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:21.726925 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:52:44.621813 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.621777 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd"] Jul 07 10:52:44.625745 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.625719 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:44.628834 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.628802 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-07962f32-serving-cert\"" Jul 07 10:52:44.628968 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.628932 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qlm6h\"" Jul 07 10:52:44.640665 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.640634 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd"] Jul 07 10:52:44.656096 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.656073 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b94a8551-6dca-4758-87ce-c67b5941596d-maas-api-tls\") pod \"maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:44.656252 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.656104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94a8551-6dca-4758-87ce-c67b5941596d-openshift-service-ca\") pod \"maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:44.656252 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.656155 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49w28\" (UniqueName: \"kubernetes.io/projected/b94a8551-6dca-4758-87ce-c67b5941596d-kube-api-access-49w28\") pod \"maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:44.756982 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.756945 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94a8551-6dca-4758-87ce-c67b5941596d-openshift-service-ca\") pod \"maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:44.757201 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.757033 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49w28\" (UniqueName: \"kubernetes.io/projected/b94a8551-6dca-4758-87ce-c67b5941596d-kube-api-access-49w28\") pod \"maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:44.757201 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.757166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b94a8551-6dca-4758-87ce-c67b5941596d-maas-api-tls\") pod \"maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:44.757331 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:52:44.757285 2566 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-07962f32-serving-cert: secret "maas-api-e2e-ait-07962f32-serving-cert" not found Jul 07 10:52:44.757386 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:52:44.757368 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94a8551-6dca-4758-87ce-c67b5941596d-maas-api-tls podName:b94a8551-6dca-4758-87ce-c67b5941596d nodeName:}" failed. No retries permitted until 2026-07-07 10:52:45.257345798 +0000 UTC m=+1524.029938830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b94a8551-6dca-4758-87ce-c67b5941596d-maas-api-tls") pod "maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" (UID: "b94a8551-6dca-4758-87ce-c67b5941596d") : secret "maas-api-e2e-ait-07962f32-serving-cert" not found Jul 07 10:52:44.757691 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.757667 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94a8551-6dca-4758-87ce-c67b5941596d-openshift-service-ca\") pod \"maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:44.770977 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:44.770949 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49w28\" (UniqueName: \"kubernetes.io/projected/b94a8551-6dca-4758-87ce-c67b5941596d-kube-api-access-49w28\") pod \"maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:45.261890 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:45.261846 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b94a8551-6dca-4758-87ce-c67b5941596d-maas-api-tls\") pod \"maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:45.264638 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:45.264605 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b94a8551-6dca-4758-87ce-c67b5941596d-maas-api-tls\") pod \"maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:45.538211 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:45.538113 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:45.680999 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:45.680968 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd"] Jul 07 10:52:45.683344 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:52:45.683313 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94a8551_6dca_4758_87ce_c67b5941596d.slice/crio-5719c6457bffe9e0cf19f1a0c1925a77ddf9008d7dd48fa7a1fafb9539ca5dce WatchSource:0}: Error finding container 5719c6457bffe9e0cf19f1a0c1925a77ddf9008d7dd48fa7a1fafb9539ca5dce: Status 404 returned error can't find the container with id 5719c6457bffe9e0cf19f1a0c1925a77ddf9008d7dd48fa7a1fafb9539ca5dce Jul 07 10:52:45.684565 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:45.684547 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 10:52:46.617689 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:46.617655 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" event={"ID":"b94a8551-6dca-4758-87ce-c67b5941596d","Type":"ContainerStarted","Data":"5719c6457bffe9e0cf19f1a0c1925a77ddf9008d7dd48fa7a1fafb9539ca5dce"} Jul 07 10:52:47.623963 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:47.623925 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" event={"ID":"b94a8551-6dca-4758-87ce-c67b5941596d","Type":"ContainerStarted","Data":"53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac"} Jul 07 10:52:47.624464 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:47.623992 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:47.648133 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:47.648085 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" podStartSLOduration=1.912348986 podStartE2EDuration="3.648069072s" totalImagesPullingTime="1.735720086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:52:47.646098073 +0000 UTC m=+1526.418691130" watchObservedRunningTime="2026-07-07 10:52:47.648069072 +0000 UTC m=+1526.420662131" Jul 07 10:52:50.130683 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.130645 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd"] Jul 07 10:52:50.131171 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.130818 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" podUID="b94a8551-6dca-4758-87ce-c67b5941596d" containerName="maas-api" containerID="cri-o://53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac" gracePeriod=30 Jul 07 10:52:50.374310 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.374285 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:50.409384 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.409301 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94a8551-6dca-4758-87ce-c67b5941596d-openshift-service-ca\") pod \"b94a8551-6dca-4758-87ce-c67b5941596d\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " Jul 07 10:52:50.409384 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.409362 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49w28\" (UniqueName: \"kubernetes.io/projected/b94a8551-6dca-4758-87ce-c67b5941596d-kube-api-access-49w28\") pod \"b94a8551-6dca-4758-87ce-c67b5941596d\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " Jul 07 10:52:50.409564 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.409442 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b94a8551-6dca-4758-87ce-c67b5941596d-maas-api-tls\") pod \"b94a8551-6dca-4758-87ce-c67b5941596d\" (UID: \"b94a8551-6dca-4758-87ce-c67b5941596d\") " Jul 07 10:52:50.409726 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.409695 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b94a8551-6dca-4758-87ce-c67b5941596d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b94a8551-6dca-4758-87ce-c67b5941596d" (UID: "b94a8551-6dca-4758-87ce-c67b5941596d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:52:50.411493 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.411463 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b94a8551-6dca-4758-87ce-c67b5941596d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b94a8551-6dca-4758-87ce-c67b5941596d" (UID: "b94a8551-6dca-4758-87ce-c67b5941596d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:52:50.411585 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.411533 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b94a8551-6dca-4758-87ce-c67b5941596d-kube-api-access-49w28" (OuterVolumeSpecName: "kube-api-access-49w28") pod "b94a8551-6dca-4758-87ce-c67b5941596d" (UID: "b94a8551-6dca-4758-87ce-c67b5941596d"). InnerVolumeSpecName "kube-api-access-49w28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:52:50.510212 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.510183 2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b94a8551-6dca-4758-87ce-c67b5941596d-maas-api-tls\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:52:50.510380 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.510217 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94a8551-6dca-4758-87ce-c67b5941596d-openshift-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:52:50.510380 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.510229 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49w28\" (UniqueName: \"kubernetes.io/projected/b94a8551-6dca-4758-87ce-c67b5941596d-kube-api-access-49w28\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:52:50.639971 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.639937 2566 generic.go:356] "Generic (PLEG): container finished" podID="b94a8551-6dca-4758-87ce-c67b5941596d" containerID="53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac" exitCode=0 Jul 07 10:52:50.639971 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.639976 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" event={"ID":"b94a8551-6dca-4758-87ce-c67b5941596d","Type":"ContainerDied","Data":"53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac"} Jul 07 10:52:50.640186 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.639985 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" Jul 07 10:52:50.640186 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.640045 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd" event={"ID":"b94a8551-6dca-4758-87ce-c67b5941596d","Type":"ContainerDied","Data":"5719c6457bffe9e0cf19f1a0c1925a77ddf9008d7dd48fa7a1fafb9539ca5dce"} Jul 07 10:52:50.640186 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.640067 2566 scope.go:117] "RemoveContainer" containerID="53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac" Jul 07 10:52:50.650857 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.650837 2566 scope.go:117] "RemoveContainer" containerID="53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac" Jul 07 10:52:50.651101 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:52:50.651080 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac\": container with ID starting with 53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac not found: ID does not exist" containerID="53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac" Jul 07 10:52:50.651165 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.651109 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac"} err="failed to get container status \"53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac\": rpc error: code = NotFound desc = could not find container \"53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac\": container with ID starting with 53e443ecea5725b3e34fa68ac493aabcdefa94e913701ee01c4bf039955cc1ac not found: ID does not exist" Jul 07 10:52:50.665958 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.665889 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd"] Jul 07 10:52:50.667618 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:50.667601 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-07962f32-54bc9dbd85-6bfxd"] Jul 07 10:52:51.715116 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:52:51.715071 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b94a8551-6dca-4758-87ce-c67b5941596d" path="/var/lib/kubelet/pods/b94a8551-6dca-4758-87ce-c67b5941596d/volumes" Jul 07 10:55:09.475927 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.475894 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t"] Jul 07 10:55:09.476411 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.476270 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b94a8551-6dca-4758-87ce-c67b5941596d" containerName="maas-api" Jul 07 10:55:09.476411 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.476282 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b94a8551-6dca-4758-87ce-c67b5941596d" containerName="maas-api" Jul 07 10:55:09.476411 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.476343 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b94a8551-6dca-4758-87ce-c67b5941596d" containerName="maas-api" Jul 07 10:55:09.478383 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.478357 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:09.481256 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.481233 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qlm6h\"" Jul 07 10:55:09.481393 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.481232 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-b69a63f5-serving-cert\"" Jul 07 10:55:09.490574 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.490546 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t"] Jul 07 10:55:09.632586 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.632553 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-openshift-service-ca\") pod \"maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:09.632759 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.632623 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-maas-api-tls\") pod \"maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:09.632759 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.632642 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvpjq\" (UniqueName: \"kubernetes.io/projected/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-kube-api-access-xvpjq\") pod \"maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:09.734090 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.734012 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-openshift-service-ca\") pod \"maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:09.734090 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.734077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-maas-api-tls\") pod \"maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:09.734330 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.734095 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvpjq\" (UniqueName: \"kubernetes.io/projected/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-kube-api-access-xvpjq\") pod \"maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:09.734330 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:55:09.734203 2566 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-b69a63f5-serving-cert: secret "maas-api-e2e-mt-b69a63f5-serving-cert" not found Jul 07 10:55:09.734330 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:55:09.734286 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-maas-api-tls podName:b4505b7c-2676-40f2-a7bc-16dbf42dec5c nodeName:}" failed. No retries permitted until 2026-07-07 10:55:10.234265227 +0000 UTC m=+1669.006858262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-maas-api-tls") pod "maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" (UID: "b4505b7c-2676-40f2-a7bc-16dbf42dec5c") : secret "maas-api-e2e-mt-b69a63f5-serving-cert" not found Jul 07 10:55:09.734711 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.734692 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-openshift-service-ca\") pod \"maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:09.745387 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:09.745365 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvpjq\" (UniqueName: \"kubernetes.io/projected/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-kube-api-access-xvpjq\") pod \"maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:10.238399 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:10.238357 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-maas-api-tls\") pod \"maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:10.240858 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:10.240828 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-maas-api-tls\") pod \"maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:10.389867 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:10.389830 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:10.523275 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:10.523247 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t"] Jul 07 10:55:10.525208 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:55:10.525181 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4505b7c_2676_40f2_a7bc_16dbf42dec5c.slice/crio-28b83b287ae8ce288de075ce3f70e8941fe589ee20d03abcb87b3116ef096dbd WatchSource:0}: Error finding container 28b83b287ae8ce288de075ce3f70e8941fe589ee20d03abcb87b3116ef096dbd: Status 404 returned error can't find the container with id 28b83b287ae8ce288de075ce3f70e8941fe589ee20d03abcb87b3116ef096dbd Jul 07 10:55:11.292946 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:11.292915 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" event={"ID":"b4505b7c-2676-40f2-a7bc-16dbf42dec5c","Type":"ContainerStarted","Data":"3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8"} Jul 07 10:55:11.293113 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:11.292971 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" event={"ID":"b4505b7c-2676-40f2-a7bc-16dbf42dec5c","Type":"ContainerStarted","Data":"28b83b287ae8ce288de075ce3f70e8941fe589ee20d03abcb87b3116ef096dbd"} Jul 07 10:55:11.293113 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:11.293058 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:11.312414 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:11.312366 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" podStartSLOduration=1.8522453570000001 podStartE2EDuration="2.312348378s" totalImagesPullingTime="460.103021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:55:11.310705047 +0000 UTC m=+1670.083298104" watchObservedRunningTime="2026-07-07 10:55:11.312348378 +0000 UTC m=+1670.084941454" Jul 07 10:55:17.302250 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:17.302221 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:21.539251 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.539211 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t"] Jul 07 10:55:21.539671 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.539430 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" podUID="b4505b7c-2676-40f2-a7bc-16dbf42dec5c" containerName="maas-api" containerID="cri-o://3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8" gracePeriod=30 Jul 07 10:55:21.790023 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.789963 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:21.842783 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.842753 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-maas-api-tls\") pod \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " Jul 07 10:55:21.842942 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.842832 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvpjq\" (UniqueName: \"kubernetes.io/projected/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-kube-api-access-xvpjq\") pod \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " Jul 07 10:55:21.842942 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.842859 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-openshift-service-ca\") pod \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\" (UID: \"b4505b7c-2676-40f2-a7bc-16dbf42dec5c\") " Jul 07 10:55:21.843247 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.843221 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4505b7c-2676-40f2-a7bc-16dbf42dec5c" (UID: "b4505b7c-2676-40f2-a7bc-16dbf42dec5c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:55:21.844905 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.844875 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-kube-api-access-xvpjq" (OuterVolumeSpecName: "kube-api-access-xvpjq") pod "b4505b7c-2676-40f2-a7bc-16dbf42dec5c" (UID: "b4505b7c-2676-40f2-a7bc-16dbf42dec5c"). InnerVolumeSpecName "kube-api-access-xvpjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:55:21.844988 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.844906 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4505b7c-2676-40f2-a7bc-16dbf42dec5c" (UID: "b4505b7c-2676-40f2-a7bc-16dbf42dec5c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:55:21.944260 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.944225 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvpjq\" (UniqueName: \"kubernetes.io/projected/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-kube-api-access-xvpjq\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:55:21.944260 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.944253 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-openshift-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:55:21.944260 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:21.944262 2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4505b7c-2676-40f2-a7bc-16dbf42dec5c-maas-api-tls\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:55:22.342694 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:22.342665 2566 generic.go:356] "Generic (PLEG): container finished" podID="b4505b7c-2676-40f2-a7bc-16dbf42dec5c" containerID="3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8" exitCode=0 Jul 07 10:55:22.342855 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:22.342717 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" Jul 07 10:55:22.342855 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:22.342746 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" event={"ID":"b4505b7c-2676-40f2-a7bc-16dbf42dec5c","Type":"ContainerDied","Data":"3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8"} Jul 07 10:55:22.342855 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:22.342802 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t" event={"ID":"b4505b7c-2676-40f2-a7bc-16dbf42dec5c","Type":"ContainerDied","Data":"28b83b287ae8ce288de075ce3f70e8941fe589ee20d03abcb87b3116ef096dbd"} Jul 07 10:55:22.342855 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:22.342826 2566 scope.go:117] "RemoveContainer" containerID="3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8" Jul 07 10:55:22.351996 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:22.351976 2566 scope.go:117] "RemoveContainer" containerID="3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8" Jul 07 10:55:22.352290 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:55:22.352263 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8\": container with ID starting with 3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8 not found: ID does not exist" containerID="3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8" Jul 07 10:55:22.352347 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:22.352297 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8"} err="failed to get container status \"3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8\": rpc error: code = NotFound desc = could not find container \"3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8\": container with ID starting with 3191f78a613f49121e90b0b03982c7b420af0fde47c063d363533c6927feeba8 not found: ID does not exist" Jul 07 10:55:22.364422 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:22.364398 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t"] Jul 07 10:55:22.368408 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:22.368388 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-b69a63f5-7bc4c749fc-rsd8t"] Jul 07 10:55:23.715382 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:23.715353 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4505b7c-2676-40f2-a7bc-16dbf42dec5c" path="/var/lib/kubelet/pods/b4505b7c-2676-40f2-a7bc-16dbf42dec5c/volumes" Jul 07 10:55:51.612022 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.611948 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc"] Jul 07 10:55:51.612670 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.612406 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4505b7c-2676-40f2-a7bc-16dbf42dec5c" containerName="maas-api" Jul 07 10:55:51.612670 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.612424 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4505b7c-2676-40f2-a7bc-16dbf42dec5c" containerName="maas-api" Jul 07 10:55:51.612670 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.612489 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4505b7c-2676-40f2-a7bc-16dbf42dec5c" containerName="maas-api" Jul 07 10:55:51.615485 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.615462 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:51.618478 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.618442 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-17d0cfdd-serving-cert\"" Jul 07 10:55:51.618601 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.618489 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qlm6h\"" Jul 07 10:55:51.629905 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.629875 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc"] Jul 07 10:55:51.715205 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.715131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w22b\" (UniqueName: \"kubernetes.io/projected/81834460-f7d8-4010-b369-9a0e6eff3690-kube-api-access-9w22b\") pod \"maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:51.715405 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.715266 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81834460-f7d8-4010-b369-9a0e6eff3690-openshift-service-ca\") pod \"maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:51.715405 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.715348 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81834460-f7d8-4010-b369-9a0e6eff3690-maas-api-tls\") pod \"maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:51.816716 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.816685 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81834460-f7d8-4010-b369-9a0e6eff3690-maas-api-tls\") pod \"maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:51.816903 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.816738 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w22b\" (UniqueName: \"kubernetes.io/projected/81834460-f7d8-4010-b369-9a0e6eff3690-kube-api-access-9w22b\") pod \"maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:51.816903 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.816775 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81834460-f7d8-4010-b369-9a0e6eff3690-openshift-service-ca\") pod \"maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:51.816903 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:55:51.816841 2566 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-17d0cfdd-serving-cert: secret "maas-api-e2e-mt-17d0cfdd-serving-cert" not found Jul 07 10:55:51.817016 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:55:51.816926 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81834460-f7d8-4010-b369-9a0e6eff3690-maas-api-tls podName:81834460-f7d8-4010-b369-9a0e6eff3690 nodeName:}" failed. No retries permitted until 2026-07-07 10:55:52.316907663 +0000 UTC m=+1711.089500698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/81834460-f7d8-4010-b369-9a0e6eff3690-maas-api-tls") pod "maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" (UID: "81834460-f7d8-4010-b369-9a0e6eff3690") : secret "maas-api-e2e-mt-17d0cfdd-serving-cert" not found Jul 07 10:55:51.817416 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.817399 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81834460-f7d8-4010-b369-9a0e6eff3690-openshift-service-ca\") pod \"maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:51.827103 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:51.827083 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w22b\" (UniqueName: \"kubernetes.io/projected/81834460-f7d8-4010-b369-9a0e6eff3690-kube-api-access-9w22b\") pod \"maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:52.321756 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:52.321716 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81834460-f7d8-4010-b369-9a0e6eff3690-maas-api-tls\") pod \"maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:52.324283 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:52.324257 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81834460-f7d8-4010-b369-9a0e6eff3690-maas-api-tls\") pod \"maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:52.527825 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:52.527787 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:52.667629 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:52.667592 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc"] Jul 07 10:55:52.671969 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:55:52.671941 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81834460_f7d8_4010_b369_9a0e6eff3690.slice/crio-102750f57bf730c936d704daa16034dfa83c074b2428801151166e3bee570b08 WatchSource:0}: Error finding container 102750f57bf730c936d704daa16034dfa83c074b2428801151166e3bee570b08: Status 404 returned error can't find the container with id 102750f57bf730c936d704daa16034dfa83c074b2428801151166e3bee570b08 Jul 07 10:55:53.487073 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:53.487027 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" event={"ID":"81834460-f7d8-4010-b369-9a0e6eff3690","Type":"ContainerStarted","Data":"35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477"} Jul 07 10:55:53.487274 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:53.487095 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" event={"ID":"81834460-f7d8-4010-b369-9a0e6eff3690","Type":"ContainerStarted","Data":"102750f57bf730c936d704daa16034dfa83c074b2428801151166e3bee570b08"} Jul 07 10:55:53.487274 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:53.487164 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:55:53.507893 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:53.507843 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" podStartSLOduration=2.184287723 podStartE2EDuration="2.507828643s" totalImagesPullingTime="323.54092ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:55:53.506084988 +0000 UTC m=+1712.278678041" watchObservedRunningTime="2026-07-07 10:55:53.507828643 +0000 UTC m=+1712.280421701" Jul 07 10:55:59.497345 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:55:59.497314 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:56:34.255863 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.255825 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc"] Jul 07 10:56:34.256432 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.256088 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" podUID="81834460-f7d8-4010-b369-9a0e6eff3690" containerName="maas-api" containerID="cri-o://35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477" gracePeriod=30 Jul 07 10:56:34.498594 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.498573 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:56:34.601311 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.601282 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81834460-f7d8-4010-b369-9a0e6eff3690-maas-api-tls\") pod \"81834460-f7d8-4010-b369-9a0e6eff3690\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " Jul 07 10:56:34.601503 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.601343 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w22b\" (UniqueName: \"kubernetes.io/projected/81834460-f7d8-4010-b369-9a0e6eff3690-kube-api-access-9w22b\") pod \"81834460-f7d8-4010-b369-9a0e6eff3690\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " Jul 07 10:56:34.601503 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.601368 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81834460-f7d8-4010-b369-9a0e6eff3690-openshift-service-ca\") pod \"81834460-f7d8-4010-b369-9a0e6eff3690\" (UID: \"81834460-f7d8-4010-b369-9a0e6eff3690\") " Jul 07 10:56:34.601805 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.601764 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81834460-f7d8-4010-b369-9a0e6eff3690-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "81834460-f7d8-4010-b369-9a0e6eff3690" (UID: "81834460-f7d8-4010-b369-9a0e6eff3690"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 10:56:34.603808 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.603785 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81834460-f7d8-4010-b369-9a0e6eff3690-kube-api-access-9w22b" (OuterVolumeSpecName: "kube-api-access-9w22b") pod "81834460-f7d8-4010-b369-9a0e6eff3690" (UID: "81834460-f7d8-4010-b369-9a0e6eff3690"). InnerVolumeSpecName "kube-api-access-9w22b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 10:56:34.603909 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.603817 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81834460-f7d8-4010-b369-9a0e6eff3690-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "81834460-f7d8-4010-b369-9a0e6eff3690" (UID: "81834460-f7d8-4010-b369-9a0e6eff3690"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 10:56:34.682768 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.682731 2566 generic.go:356] "Generic (PLEG): container finished" podID="81834460-f7d8-4010-b369-9a0e6eff3690" containerID="35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477" exitCode=0 Jul 07 10:56:34.682768 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.682774 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" event={"ID":"81834460-f7d8-4010-b369-9a0e6eff3690","Type":"ContainerDied","Data":"35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477"} Jul 07 10:56:34.683055 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.682776 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" Jul 07 10:56:34.683055 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.682814 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" event={"ID":"81834460-f7d8-4010-b369-9a0e6eff3690","Type":"ContainerDied","Data":"102750f57bf730c936d704daa16034dfa83c074b2428801151166e3bee570b08"} Jul 07 10:56:34.683055 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.682835 2566 scope.go:117] "RemoveContainer" containerID="35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477" Jul 07 10:56:34.691890 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.691870 2566 scope.go:117] "RemoveContainer" containerID="35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477" Jul 07 10:56:34.692175 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:56:34.692129 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477\": container with ID starting with 35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477 not found: ID does not exist" containerID="35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477" Jul 07 10:56:34.692233 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.692186 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477"} err="failed to get container status \"35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477\": rpc error: code = NotFound desc = could not find container \"35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477\": container with ID starting with 35dbdf68fca7a39a70ab20cfe0cfc4af17454da023367fb8ada5f015720ad477 not found: ID does not exist" Jul 07 10:56:34.702152 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.702116 2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81834460-f7d8-4010-b369-9a0e6eff3690-maas-api-tls\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:56:34.702236 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.702164 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w22b\" (UniqueName: \"kubernetes.io/projected/81834460-f7d8-4010-b369-9a0e6eff3690-kube-api-access-9w22b\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:56:34.702236 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.702178 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81834460-f7d8-4010-b369-9a0e6eff3690-openshift-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 10:56:34.713868 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.713835 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc"] Jul 07 10:56:34.717540 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:34.717519 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc"] Jul 07 10:56:35.713726 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:35.713696 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81834460-f7d8-4010-b369-9a0e6eff3690" path="/var/lib/kubelet/pods/81834460-f7d8-4010-b369-9a0e6eff3690/volumes" Jul 07 10:56:37.492805 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:56:37.492740 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-17d0cfdd-84b649678b-7q5bc" podUID="81834460-f7d8-4010-b369-9a0e6eff3690" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.35:8443/health\": context deadline exceeded" Jul 07 10:57:21.751480 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:57:21.751379 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:57:21.753815 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:57:21.753793 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 10:58:40.683939 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.683905 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft"] Jul 07 10:58:40.684495 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.684307 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81834460-f7d8-4010-b369-9a0e6eff3690" containerName="maas-api" Jul 07 10:58:40.684495 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.684324 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="81834460-f7d8-4010-b369-9a0e6eff3690" containerName="maas-api" Jul 07 10:58:40.684495 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.684383 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="81834460-f7d8-4010-b369-9a0e6eff3690" containerName="maas-api" Jul 07 10:58:40.687486 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.687467 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:40.691812 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.691790 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-845408-serving-cert\"" Jul 07 10:58:40.691962 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.691945 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qlm6h\"" Jul 07 10:58:40.701070 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.701044 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft"] Jul 07 10:58:40.827387 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.827347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-openshift-service-ca\") pod \"maas-api-e2e-inf-b-845408-796bcbd7d9-sttft\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:40.827387 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.827404 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-maas-api-tls\") pod \"maas-api-e2e-inf-b-845408-796bcbd7d9-sttft\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:40.827614 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.827519 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz9ff\" (UniqueName: \"kubernetes.io/projected/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-kube-api-access-mz9ff\") pod \"maas-api-e2e-inf-b-845408-796bcbd7d9-sttft\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:40.928051 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.928011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-openshift-service-ca\") pod \"maas-api-e2e-inf-b-845408-796bcbd7d9-sttft\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:40.928051 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.928055 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-maas-api-tls\") pod \"maas-api-e2e-inf-b-845408-796bcbd7d9-sttft\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:40.928343 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.928109 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz9ff\" (UniqueName: \"kubernetes.io/projected/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-kube-api-access-mz9ff\") pod \"maas-api-e2e-inf-b-845408-796bcbd7d9-sttft\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:40.928343 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:58:40.928237 2566 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-845408-serving-cert: secret "maas-api-e2e-inf-b-845408-serving-cert" not found Jul 07 10:58:40.928343 ip-10-0-135-59 kubenswrapper[2566]: E0707 10:58:40.928301 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-maas-api-tls podName:5be418ac-f1a1-46fc-90ae-d74ea36b4b72 nodeName:}" failed. No retries permitted until 2026-07-07 10:58:41.428284835 +0000 UTC m=+1880.200877868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-maas-api-tls") pod "maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" (UID: "5be418ac-f1a1-46fc-90ae-d74ea36b4b72") : secret "maas-api-e2e-inf-b-845408-serving-cert" not found Jul 07 10:58:40.928752 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.928732 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-openshift-service-ca\") pod \"maas-api-e2e-inf-b-845408-796bcbd7d9-sttft\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:40.938118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:40.938067 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz9ff\" (UniqueName: \"kubernetes.io/projected/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-kube-api-access-mz9ff\") pod \"maas-api-e2e-inf-b-845408-796bcbd7d9-sttft\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:41.433401 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:41.433360 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-maas-api-tls\") pod \"maas-api-e2e-inf-b-845408-796bcbd7d9-sttft\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:41.435885 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:41.435855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-maas-api-tls\") pod \"maas-api-e2e-inf-b-845408-796bcbd7d9-sttft\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:41.599428 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:41.599378 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:41.756084 ip-10-0-135-59 kubenswrapper[2566]: W0707 10:58:41.756057 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be418ac_f1a1_46fc_90ae_d74ea36b4b72.slice/crio-94300a4bab4e926f3e56da641d4befa8d175125c2a0b13d21ace5de86365ad10 WatchSource:0}: Error finding container 94300a4bab4e926f3e56da641d4befa8d175125c2a0b13d21ace5de86365ad10: Status 404 returned error can't find the container with id 94300a4bab4e926f3e56da641d4befa8d175125c2a0b13d21ace5de86365ad10 Jul 07 10:58:41.757118 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:41.757096 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft"] Jul 07 10:58:41.757860 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:41.757842 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 10:58:42.284808 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:42.284715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" event={"ID":"5be418ac-f1a1-46fc-90ae-d74ea36b4b72","Type":"ContainerStarted","Data":"cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899"} Jul 07 10:58:42.284808 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:42.284783 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 10:58:42.285055 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:42.284810 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" event={"ID":"5be418ac-f1a1-46fc-90ae-d74ea36b4b72","Type":"ContainerStarted","Data":"94300a4bab4e926f3e56da641d4befa8d175125c2a0b13d21ace5de86365ad10"} Jul 07 10:58:42.303619 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:42.303568 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" podStartSLOduration=1.975760253 podStartE2EDuration="2.303549386s" totalImagesPullingTime="327.789133ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 10:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 10:58:42.302524175 +0000 UTC m=+1881.075117231" watchObservedRunningTime="2026-07-07 10:58:42.303549386 +0000 UTC m=+1881.076142441" Jul 07 10:58:48.294042 ip-10-0-135-59 kubenswrapper[2566]: I0707 10:58:48.294011 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 11:00:00.142673 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.142634 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723700-5cdbg"] Jul 07 11:00:00.151401 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.151356 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5"] Jul 07 11:00:00.151573 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.151489 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" Jul 07 11:00:00.156751 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.156727 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j"] Jul 07 11:00:00.157138 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.157114 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" Jul 07 11:00:00.161586 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.160787 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723700-5cdbg"] Jul 07 11:00:00.161586 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.160832 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5"] Jul 07 11:00:00.161586 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.160855 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j"] Jul 07 11:00:00.161586 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.160889 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" Jul 07 11:00:00.237275 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.237234 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glrmt\" (UniqueName: \"kubernetes.io/projected/6314e9d1-9973-4a9e-9da0-83cd429d4f6a-kube-api-access-glrmt\") pod \"maas-api-key-cleanup-29723700-5cdbg\" (UID: \"6314e9d1-9973-4a9e-9da0-83cd429d4f6a\") " pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" Jul 07 11:00:00.237275 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.237279 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26g2f\" (UniqueName: \"kubernetes.io/projected/d44f7f7c-974c-4266-b5e0-ea01025d688a-kube-api-access-26g2f\") pod \"maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5\" (UID: \"d44f7f7c-974c-4266-b5e0-ea01025d688a\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" Jul 07 11:00:00.237479 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.237359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gbvq\" (UniqueName: \"kubernetes.io/projected/9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e-kube-api-access-5gbvq\") pod \"maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j\" (UID: \"9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" Jul 07 11:00:00.338381 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.338346 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gbvq\" (UniqueName: \"kubernetes.io/projected/9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e-kube-api-access-5gbvq\") pod \"maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j\" (UID: \"9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" Jul 07 11:00:00.338537 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.338414 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glrmt\" (UniqueName: \"kubernetes.io/projected/6314e9d1-9973-4a9e-9da0-83cd429d4f6a-kube-api-access-glrmt\") pod \"maas-api-key-cleanup-29723700-5cdbg\" (UID: \"6314e9d1-9973-4a9e-9da0-83cd429d4f6a\") " pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" Jul 07 11:00:00.338537 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.338442 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26g2f\" (UniqueName: \"kubernetes.io/projected/d44f7f7c-974c-4266-b5e0-ea01025d688a-kube-api-access-26g2f\") pod \"maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5\" (UID: \"d44f7f7c-974c-4266-b5e0-ea01025d688a\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" Jul 07 11:00:00.348652 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.348619 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glrmt\" (UniqueName: \"kubernetes.io/projected/6314e9d1-9973-4a9e-9da0-83cd429d4f6a-kube-api-access-glrmt\") pod \"maas-api-key-cleanup-29723700-5cdbg\" (UID: \"6314e9d1-9973-4a9e-9da0-83cd429d4f6a\") " pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" Jul 07 11:00:00.349098 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.349079 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26g2f\" (UniqueName: \"kubernetes.io/projected/d44f7f7c-974c-4266-b5e0-ea01025d688a-kube-api-access-26g2f\") pod \"maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5\" (UID: \"d44f7f7c-974c-4266-b5e0-ea01025d688a\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" Jul 07 11:00:00.349267 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.349247 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gbvq\" (UniqueName: \"kubernetes.io/projected/9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e-kube-api-access-5gbvq\") pod \"maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j\" (UID: \"9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" Jul 07 11:00:00.466777 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.466677 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" Jul 07 11:00:00.474208 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.474181 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" Jul 07 11:00:00.480310 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.480283 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" Jul 07 11:00:00.631541 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.631491 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723700-5cdbg"] Jul 07 11:00:00.642525 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.642492 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" event={"ID":"6314e9d1-9973-4a9e-9da0-83cd429d4f6a","Type":"ContainerStarted","Data":"49ab33b37b2dc6681d3d9375bb19d9a1eba417e7778a48fa57403fa7dd0b5bcf"} Jul 07 11:00:00.680121 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.680096 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j"] Jul 07 11:00:00.682688 ip-10-0-135-59 kubenswrapper[2566]: W0707 11:00:00.682658 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9936fdbb_4178_4f7e_9d16_43f3b1a5ae5e.slice/crio-7decba78699333dbfb91fb6b7236c2a41b8777fd1a6069b0c90f46b98c992fb4 WatchSource:0}: Error finding container 7decba78699333dbfb91fb6b7236c2a41b8777fd1a6069b0c90f46b98c992fb4: Status 404 returned error can't find the container with id 7decba78699333dbfb91fb6b7236c2a41b8777fd1a6069b0c90f46b98c992fb4 Jul 07 11:00:00.866180 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:00.866125 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5"] Jul 07 11:00:00.875203 ip-10-0-135-59 kubenswrapper[2566]: W0707 11:00:00.875178 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44f7f7c_974c_4266_b5e0_ea01025d688a.slice/crio-2d90e3dc11f60d1d47e3090df4561fbdccc5d643d28ac6751864112221268c53 WatchSource:0}: Error finding container 2d90e3dc11f60d1d47e3090df4561fbdccc5d643d28ac6751864112221268c53: Status 404 returned error can't find the container with id 2d90e3dc11f60d1d47e3090df4561fbdccc5d643d28ac6751864112221268c53 Jul 07 11:00:01.648646 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:01.648611 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" event={"ID":"d44f7f7c-974c-4266-b5e0-ea01025d688a","Type":"ContainerStarted","Data":"55cce03eab0898cd990ddcee7bdedfa6343e7ead5f338e9f7d8fc1fb913c49bb"} Jul 07 11:00:01.649126 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:01.648669 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" event={"ID":"d44f7f7c-974c-4266-b5e0-ea01025d688a","Type":"ContainerStarted","Data":"2d90e3dc11f60d1d47e3090df4561fbdccc5d643d28ac6751864112221268c53"} Jul 07 11:00:01.650162 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:01.650119 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" event={"ID":"9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e","Type":"ContainerStarted","Data":"767a51f430303778d7d90a7a563e62b591aaafe9ce0329288a6314d7de64de23"} Jul 07 11:00:01.650283 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:01.650175 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" event={"ID":"9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e","Type":"ContainerStarted","Data":"7decba78699333dbfb91fb6b7236c2a41b8777fd1a6069b0c90f46b98c992fb4"} Jul 07 11:00:01.651475 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:01.651451 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" event={"ID":"6314e9d1-9973-4a9e-9da0-83cd429d4f6a","Type":"ContainerStarted","Data":"76d6dec381ef68cb733866fc198e3cd387076a1d573aaa3932e93ad716c88835"} Jul 07 11:00:01.666664 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:01.666617 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" podStartSLOduration=1.666596181 podStartE2EDuration="1.666596181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:00:01.665303728 +0000 UTC m=+1960.437896784" watchObservedRunningTime="2026-07-07 11:00:01.666596181 +0000 UTC m=+1960.439189237" Jul 07 11:00:01.681882 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:01.681839 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" podStartSLOduration=1.681824013 podStartE2EDuration="1.681824013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:00:01.681021412 +0000 UTC m=+1960.453614467" watchObservedRunningTime="2026-07-07 11:00:01.681824013 +0000 UTC m=+1960.454417068" Jul 07 11:00:01.697905 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:01.697862 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" podStartSLOduration=1.6978464949999998 podStartE2EDuration="1.697846495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:00:01.697028046 +0000 UTC m=+1960.469621100" watchObservedRunningTime="2026-07-07 11:00:01.697846495 +0000 UTC m=+1960.470439550" Jul 07 11:00:02.657257 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:02.657224 2566 generic.go:356] "Generic (PLEG): container finished" podID="d44f7f7c-974c-4266-b5e0-ea01025d688a" containerID="55cce03eab0898cd990ddcee7bdedfa6343e7ead5f338e9f7d8fc1fb913c49bb" exitCode=0 Jul 07 11:00:02.657720 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:02.657263 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" event={"ID":"d44f7f7c-974c-4266-b5e0-ea01025d688a","Type":"ContainerDied","Data":"55cce03eab0898cd990ddcee7bdedfa6343e7ead5f338e9f7d8fc1fb913c49bb"} Jul 07 11:00:02.658730 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:02.658703 2566 generic.go:356] "Generic (PLEG): container finished" podID="9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e" containerID="767a51f430303778d7d90a7a563e62b591aaafe9ce0329288a6314d7de64de23" exitCode=0 Jul 07 11:00:02.658849 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:02.658789 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" event={"ID":"9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e","Type":"ContainerDied","Data":"767a51f430303778d7d90a7a563e62b591aaafe9ce0329288a6314d7de64de23"} Jul 07 11:00:02.660122 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:02.660097 2566 generic.go:356] "Generic (PLEG): container finished" podID="6314e9d1-9973-4a9e-9da0-83cd429d4f6a" containerID="76d6dec381ef68cb733866fc198e3cd387076a1d573aaa3932e93ad716c88835" exitCode=0 Jul 07 11:00:02.660247 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:02.660131 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" event={"ID":"6314e9d1-9973-4a9e-9da0-83cd429d4f6a","Type":"ContainerDied","Data":"76d6dec381ef68cb733866fc198e3cd387076a1d573aaa3932e93ad716c88835"} Jul 07 11:00:03.823368 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:03.823342 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" Jul 07 11:00:03.870658 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:03.870625 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" Jul 07 11:00:03.873980 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:03.873955 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" Jul 07 11:00:03.973646 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:03.973561 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26g2f\" (UniqueName: \"kubernetes.io/projected/d44f7f7c-974c-4266-b5e0-ea01025d688a-kube-api-access-26g2f\") pod \"d44f7f7c-974c-4266-b5e0-ea01025d688a\" (UID: \"d44f7f7c-974c-4266-b5e0-ea01025d688a\") " Jul 07 11:00:03.973646 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:03.973598 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gbvq\" (UniqueName: \"kubernetes.io/projected/9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e-kube-api-access-5gbvq\") pod \"9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e\" (UID: \"9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e\") " Jul 07 11:00:03.973646 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:03.973635 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glrmt\" (UniqueName: \"kubernetes.io/projected/6314e9d1-9973-4a9e-9da0-83cd429d4f6a-kube-api-access-glrmt\") pod \"6314e9d1-9973-4a9e-9da0-83cd429d4f6a\" (UID: \"6314e9d1-9973-4a9e-9da0-83cd429d4f6a\") " Jul 07 11:00:03.975814 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:03.975783 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6314e9d1-9973-4a9e-9da0-83cd429d4f6a-kube-api-access-glrmt" (OuterVolumeSpecName: "kube-api-access-glrmt") pod "6314e9d1-9973-4a9e-9da0-83cd429d4f6a" (UID: "6314e9d1-9973-4a9e-9da0-83cd429d4f6a"). InnerVolumeSpecName "kube-api-access-glrmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:00:03.975959 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:03.975879 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d44f7f7c-974c-4266-b5e0-ea01025d688a-kube-api-access-26g2f" (OuterVolumeSpecName: "kube-api-access-26g2f") pod "d44f7f7c-974c-4266-b5e0-ea01025d688a" (UID: "d44f7f7c-974c-4266-b5e0-ea01025d688a"). InnerVolumeSpecName "kube-api-access-26g2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:00:03.975959 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:03.975879 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e-kube-api-access-5gbvq" (OuterVolumeSpecName: "kube-api-access-5gbvq") pod "9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e" (UID: "9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e"). InnerVolumeSpecName "kube-api-access-5gbvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:00:04.074760 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.074733 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26g2f\" (UniqueName: \"kubernetes.io/projected/d44f7f7c-974c-4266-b5e0-ea01025d688a-kube-api-access-26g2f\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:00:04.074760 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.074756 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gbvq\" (UniqueName: \"kubernetes.io/projected/9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e-kube-api-access-5gbvq\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:00:04.074910 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.074766 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glrmt\" (UniqueName: \"kubernetes.io/projected/6314e9d1-9973-4a9e-9da0-83cd429d4f6a-kube-api-access-glrmt\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:00:04.672616 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.672582 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" Jul 07 11:00:04.672820 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.672614 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j" event={"ID":"9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e","Type":"ContainerDied","Data":"7decba78699333dbfb91fb6b7236c2a41b8777fd1a6069b0c90f46b98c992fb4"} Jul 07 11:00:04.672820 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.672667 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7decba78699333dbfb91fb6b7236c2a41b8777fd1a6069b0c90f46b98c992fb4" Jul 07 11:00:04.673851 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.673831 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" Jul 07 11:00:04.673988 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.673862 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723700-5cdbg" event={"ID":"6314e9d1-9973-4a9e-9da0-83cd429d4f6a","Type":"ContainerDied","Data":"49ab33b37b2dc6681d3d9375bb19d9a1eba417e7778a48fa57403fa7dd0b5bcf"} Jul 07 11:00:04.673988 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.673904 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49ab33b37b2dc6681d3d9375bb19d9a1eba417e7778a48fa57403fa7dd0b5bcf" Jul 07 11:00:04.675251 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.675227 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" event={"ID":"d44f7f7c-974c-4266-b5e0-ea01025d688a","Type":"ContainerDied","Data":"2d90e3dc11f60d1d47e3090df4561fbdccc5d643d28ac6751864112221268c53"} Jul 07 11:00:04.675365 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.675262 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d90e3dc11f60d1d47e3090df4561fbdccc5d643d28ac6751864112221268c53" Jul 07 11:00:04.675365 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:04.675264 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5" Jul 07 11:00:06.158192 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:06.158138 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j"] Jul 07 11:00:06.163944 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:06.163912 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-27bc88-29723700-8dm2j"] Jul 07 11:00:07.719842 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:07.719806 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e" path="/var/lib/kubelet/pods/9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e/volumes" Jul 07 11:00:48.899782 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:48.899743 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft"] Jul 07 11:00:48.900730 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:48.900038 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" podUID="5be418ac-f1a1-46fc-90ae-d74ea36b4b72" containerName="maas-api" containerID="cri-o://cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899" gracePeriod=30 Jul 07 11:00:48.925687 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:48.925638 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5"] Jul 07 11:00:48.928592 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:48.928562 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-845408-29723700-dgnc5"] Jul 07 11:00:49.714871 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:49.714834 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d44f7f7c-974c-4266-b5e0-ea01025d688a" path="/var/lib/kubelet/pods/d44f7f7c-974c-4266-b5e0-ea01025d688a/volumes" Jul 07 11:00:50.154356 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.154330 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 11:00:50.287108 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.287033 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz9ff\" (UniqueName: \"kubernetes.io/projected/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-kube-api-access-mz9ff\") pod \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " Jul 07 11:00:50.287108 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.287101 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-openshift-service-ca\") pod \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " Jul 07 11:00:50.287347 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.287195 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-maas-api-tls\") pod \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\" (UID: \"5be418ac-f1a1-46fc-90ae-d74ea36b4b72\") " Jul 07 11:00:50.287439 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.287418 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5be418ac-f1a1-46fc-90ae-d74ea36b4b72" (UID: "5be418ac-f1a1-46fc-90ae-d74ea36b4b72"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:00:50.289297 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.289273 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-kube-api-access-mz9ff" (OuterVolumeSpecName: "kube-api-access-mz9ff") pod "5be418ac-f1a1-46fc-90ae-d74ea36b4b72" (UID: "5be418ac-f1a1-46fc-90ae-d74ea36b4b72"). InnerVolumeSpecName "kube-api-access-mz9ff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:00:50.289401 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.289312 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5be418ac-f1a1-46fc-90ae-d74ea36b4b72" (UID: "5be418ac-f1a1-46fc-90ae-d74ea36b4b72"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 11:00:50.388322 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.388286 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-openshift-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:00:50.388322 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.388315 2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-maas-api-tls\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:00:50.388322 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.388325 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz9ff\" (UniqueName: \"kubernetes.io/projected/5be418ac-f1a1-46fc-90ae-d74ea36b4b72-kube-api-access-mz9ff\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:00:50.908226 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.908190 2566 generic.go:356] "Generic (PLEG): container finished" podID="5be418ac-f1a1-46fc-90ae-d74ea36b4b72" containerID="cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899" exitCode=0 Jul 07 11:00:50.908392 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.908240 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" Jul 07 11:00:50.908392 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.908278 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" event={"ID":"5be418ac-f1a1-46fc-90ae-d74ea36b4b72","Type":"ContainerDied","Data":"cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899"} Jul 07 11:00:50.908392 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.908326 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft" event={"ID":"5be418ac-f1a1-46fc-90ae-d74ea36b4b72","Type":"ContainerDied","Data":"94300a4bab4e926f3e56da641d4befa8d175125c2a0b13d21ace5de86365ad10"} Jul 07 11:00:50.908392 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.908350 2566 scope.go:117] "RemoveContainer" containerID="cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899" Jul 07 11:00:50.917675 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.917658 2566 scope.go:117] "RemoveContainer" containerID="cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899" Jul 07 11:00:50.917889 ip-10-0-135-59 kubenswrapper[2566]: E0707 11:00:50.917873 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899\": container with ID starting with cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899 not found: ID does not exist" containerID="cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899" Jul 07 11:00:50.917931 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.917897 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899"} err="failed to get container status \"cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899\": rpc error: code = NotFound desc = could not find container \"cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899\": container with ID starting with cc7fb69e489dcc1b97c2d62d588e07a1a1fdd292425ed838409bdc729fe08899 not found: ID does not exist" Jul 07 11:00:50.930076 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.930055 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft"] Jul 07 11:00:50.935747 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:50.935726 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-845408-796bcbd7d9-sttft"] Jul 07 11:00:51.714249 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:00:51.714209 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5be418ac-f1a1-46fc-90ae-d74ea36b4b72" path="/var/lib/kubelet/pods/5be418ac-f1a1-46fc-90ae-d74ea36b4b72/volumes" Jul 07 11:01:07.290817 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.290769 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2"] Jul 07 11:01:07.291430 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291411 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e" containerName="cleanup" Jul 07 11:01:07.291480 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291435 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e" containerName="cleanup" Jul 07 11:01:07.291480 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291457 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6314e9d1-9973-4a9e-9da0-83cd429d4f6a" containerName="cleanup" Jul 07 11:01:07.291480 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291466 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6314e9d1-9973-4a9e-9da0-83cd429d4f6a" containerName="cleanup" Jul 07 11:01:07.291576 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291482 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44f7f7c-974c-4266-b5e0-ea01025d688a" containerName="cleanup" Jul 07 11:01:07.291576 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291491 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44f7f7c-974c-4266-b5e0-ea01025d688a" containerName="cleanup" Jul 07 11:01:07.291576 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291508 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be418ac-f1a1-46fc-90ae-d74ea36b4b72" containerName="maas-api" Jul 07 11:01:07.291576 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291516 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be418ac-f1a1-46fc-90ae-d74ea36b4b72" containerName="maas-api" Jul 07 11:01:07.291695 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291606 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d44f7f7c-974c-4266-b5e0-ea01025d688a" containerName="cleanup" Jul 07 11:01:07.291695 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291619 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6314e9d1-9973-4a9e-9da0-83cd429d4f6a" containerName="cleanup" Jul 07 11:01:07.291695 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291633 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9936fdbb-4178-4f7e-9d16-43f3b1a5ae5e" containerName="cleanup" Jul 07 11:01:07.291695 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.291644 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be418ac-f1a1-46fc-90ae-d74ea36b4b72" containerName="maas-api" Jul 07 11:01:07.295263 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.295235 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:07.298203 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.298178 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qlm6h\"" Jul 07 11:01:07.298613 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.298599 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-dcb300-serving-cert\"" Jul 07 11:01:07.304357 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.304318 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2"] Jul 07 11:01:07.332527 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.332479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-maas-api-tls\") pod \"maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:07.332713 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.332590 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-openshift-service-ca\") pod \"maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:07.332713 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.332637 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng8gs\" (UniqueName: \"kubernetes.io/projected/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-kube-api-access-ng8gs\") pod \"maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:07.433916 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.433869 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-maas-api-tls\") pod \"maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:07.434109 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.433941 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-openshift-service-ca\") pod \"maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:07.434109 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.433976 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8gs\" (UniqueName: \"kubernetes.io/projected/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-kube-api-access-ng8gs\") pod \"maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:07.434792 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.434668 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-openshift-service-ca\") pod \"maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:07.436710 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.436682 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-maas-api-tls\") pod \"maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:07.444054 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.444025 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8gs\" (UniqueName: \"kubernetes.io/projected/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-kube-api-access-ng8gs\") pod \"maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:07.608951 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.608831 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:07.762527 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.762497 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2"] Jul 07 11:01:07.765258 ip-10-0-135-59 kubenswrapper[2566]: W0707 11:01:07.765223 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee22d9e_c762_4d5e_b1d9_e527ba5e3c89.slice/crio-1734b82784a9df8b83332ddb5b9537aa396c8bad2a9bc2fbead91bb3c45f1599 WatchSource:0}: Error finding container 1734b82784a9df8b83332ddb5b9537aa396c8bad2a9bc2fbead91bb3c45f1599: Status 404 returned error can't find the container with id 1734b82784a9df8b83332ddb5b9537aa396c8bad2a9bc2fbead91bb3c45f1599 Jul 07 11:01:07.999738 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:07.999634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" event={"ID":"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89","Type":"ContainerStarted","Data":"1734b82784a9df8b83332ddb5b9537aa396c8bad2a9bc2fbead91bb3c45f1599"} Jul 07 11:01:09.005900 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:09.005860 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" event={"ID":"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89","Type":"ContainerStarted","Data":"5698a52e6c8ced6fb84f4422b6ce6b19cde5dfdf220cfb5597366ad91701bd8c"} Jul 07 11:01:09.006386 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:09.006061 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:09.025441 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:09.025378 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" podStartSLOduration=1.447819182 podStartE2EDuration="2.025358456s" totalImagesPullingTime="577.539274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:01:09.023749191 +0000 UTC m=+2027.796342249" watchObservedRunningTime="2026-07-07 11:01:09.025358456 +0000 UTC m=+2027.797951524" Jul 07 11:01:15.017838 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:15.017803 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:27.906992 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:27.906942 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2"] Jul 07 11:01:27.907566 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:27.907254 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" podUID="eee22d9e-c762-4d5e-b1d9-e527ba5e3c89" containerName="maas-api" containerID="cri-o://5698a52e6c8ced6fb84f4422b6ce6b19cde5dfdf220cfb5597366ad91701bd8c" gracePeriod=30 Jul 07 11:01:28.109459 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.109412 2566 generic.go:356] "Generic (PLEG): container finished" podID="eee22d9e-c762-4d5e-b1d9-e527ba5e3c89" containerID="5698a52e6c8ced6fb84f4422b6ce6b19cde5dfdf220cfb5597366ad91701bd8c" exitCode=0 Jul 07 11:01:28.109608 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.109490 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" event={"ID":"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89","Type":"ContainerDied","Data":"5698a52e6c8ced6fb84f4422b6ce6b19cde5dfdf220cfb5597366ad91701bd8c"} Jul 07 11:01:28.151590 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.151568 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:28.225053 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.224959 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-openshift-service-ca\") pod \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " Jul 07 11:01:28.225232 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.225056 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng8gs\" (UniqueName: \"kubernetes.io/projected/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-kube-api-access-ng8gs\") pod \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " Jul 07 11:01:28.225232 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.225098 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-maas-api-tls\") pod \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\" (UID: \"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89\") " Jul 07 11:01:28.225431 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.225411 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eee22d9e-c762-4d5e-b1d9-e527ba5e3c89" (UID: "eee22d9e-c762-4d5e-b1d9-e527ba5e3c89"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:01:28.227340 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.227320 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eee22d9e-c762-4d5e-b1d9-e527ba5e3c89" (UID: "eee22d9e-c762-4d5e-b1d9-e527ba5e3c89"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 11:01:28.227396 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.227349 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-kube-api-access-ng8gs" (OuterVolumeSpecName: "kube-api-access-ng8gs") pod "eee22d9e-c762-4d5e-b1d9-e527ba5e3c89" (UID: "eee22d9e-c762-4d5e-b1d9-e527ba5e3c89"). InnerVolumeSpecName "kube-api-access-ng8gs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:01:28.325914 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.325878 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-openshift-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:01:28.325914 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.325906 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng8gs\" (UniqueName: \"kubernetes.io/projected/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-kube-api-access-ng8gs\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:01:28.325914 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:28.325916 2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89-maas-api-tls\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:01:29.116549 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:29.116516 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" event={"ID":"eee22d9e-c762-4d5e-b1d9-e527ba5e3c89","Type":"ContainerDied","Data":"1734b82784a9df8b83332ddb5b9537aa396c8bad2a9bc2fbead91bb3c45f1599"} Jul 07 11:01:29.116986 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:29.116578 2566 scope.go:117] "RemoveContainer" containerID="5698a52e6c8ced6fb84f4422b6ce6b19cde5dfdf220cfb5597366ad91701bd8c" Jul 07 11:01:29.116986 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:29.116524 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2" Jul 07 11:01:29.139733 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:29.139615 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2"] Jul 07 11:01:29.141550 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:29.141527 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-dcb300-6fbd6f9df9-rrpv2"] Jul 07 11:01:29.719882 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:29.719848 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eee22d9e-c762-4d5e-b1d9-e527ba5e3c89" path="/var/lib/kubelet/pods/eee22d9e-c762-4d5e-b1d9-e527ba5e3c89/volumes" Jul 07 11:01:45.507225 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.507106 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb"] Jul 07 11:01:45.507727 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.507544 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eee22d9e-c762-4d5e-b1d9-e527ba5e3c89" containerName="maas-api" Jul 07 11:01:45.507727 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.507559 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eee22d9e-c762-4d5e-b1d9-e527ba5e3c89" containerName="maas-api" Jul 07 11:01:45.507727 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.507614 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="eee22d9e-c762-4d5e-b1d9-e527ba5e3c89" containerName="maas-api" Jul 07 11:01:45.512331 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.512300 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:45.515377 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.515348 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-2a3633-serving-cert\"" Jul 07 11:01:45.515559 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.515448 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qlm6h\"" Jul 07 11:01:45.523769 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.523733 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb"] Jul 07 11:01:45.681972 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.681923 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/279cc869-bc6d-4758-ab59-83e88a7b5491-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:45.682219 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.681993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhnvt\" (UniqueName: \"kubernetes.io/projected/279cc869-bc6d-4758-ab59-83e88a7b5491-kube-api-access-rhnvt\") pod \"maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:45.682219 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.682021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/279cc869-bc6d-4758-ab59-83e88a7b5491-maas-api-tls\") pod \"maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:45.782846 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.782738 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/279cc869-bc6d-4758-ab59-83e88a7b5491-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:45.782846 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.782821 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhnvt\" (UniqueName: \"kubernetes.io/projected/279cc869-bc6d-4758-ab59-83e88a7b5491-kube-api-access-rhnvt\") pod \"maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:45.782846 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.782848 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/279cc869-bc6d-4758-ab59-83e88a7b5491-maas-api-tls\") pod \"maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:45.783530 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.783504 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/279cc869-bc6d-4758-ab59-83e88a7b5491-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:45.785751 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.785723 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/279cc869-bc6d-4758-ab59-83e88a7b5491-maas-api-tls\") pod \"maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:45.792345 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.792315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhnvt\" (UniqueName: \"kubernetes.io/projected/279cc869-bc6d-4758-ab59-83e88a7b5491-kube-api-access-rhnvt\") pod \"maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:45.825077 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.825036 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:45.980320 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:45.980110 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb"] Jul 07 11:01:45.983220 ip-10-0-135-59 kubenswrapper[2566]: W0707 11:01:45.983189 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279cc869_bc6d_4758_ab59_83e88a7b5491.slice/crio-7bbce2ac597b4d1b4ebab20bb231d33abb229aa699a71a7dbceafae28f025aff WatchSource:0}: Error finding container 7bbce2ac597b4d1b4ebab20bb231d33abb229aa699a71a7dbceafae28f025aff: Status 404 returned error can't find the container with id 7bbce2ac597b4d1b4ebab20bb231d33abb229aa699a71a7dbceafae28f025aff Jul 07 11:01:46.203393 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:46.203344 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" event={"ID":"279cc869-bc6d-4758-ab59-83e88a7b5491","Type":"ContainerStarted","Data":"7bbce2ac597b4d1b4ebab20bb231d33abb229aa699a71a7dbceafae28f025aff"} Jul 07 11:01:47.211991 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:47.211897 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" event={"ID":"279cc869-bc6d-4758-ab59-83e88a7b5491","Type":"ContainerStarted","Data":"fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e"} Jul 07 11:01:47.211991 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:47.211978 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:01:47.230714 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:47.230654 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" podStartSLOduration=1.358689292 podStartE2EDuration="2.230635377s" totalImagesPullingTime="871.946085ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:01:47.230381608 +0000 UTC m=+2066.002974667" watchObservedRunningTime="2026-07-07 11:01:47.230635377 +0000 UTC m=+2066.003228432" Jul 07 11:01:53.223020 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:01:53.222987 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:02:21.783014 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:02:21.782904 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 11:02:21.787665 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:02:21.787646 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 11:06:21.886898 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:06:21.886813 2566 scope.go:117] "RemoveContainer" containerID="55cce03eab0898cd990ddcee7bdedfa6343e7ead5f338e9f7d8fc1fb913c49bb" Jul 07 11:06:21.895106 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:06:21.895085 2566 scope.go:117] "RemoveContainer" containerID="767a51f430303778d7d90a7a563e62b591aaafe9ce0329288a6314d7de64de23" Jul 07 11:07:21.810232 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:21.810200 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 11:07:21.815614 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:21.815592 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 11:07:52.212198 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.212111 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb"] Jul 07 11:07:52.212569 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.212325 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" podUID="279cc869-bc6d-4758-ab59-83e88a7b5491" containerName="maas-api" containerID="cri-o://fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e" gracePeriod=30 Jul 07 11:07:52.459198 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.459136 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:07:52.566120 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.566092 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhnvt\" (UniqueName: \"kubernetes.io/projected/279cc869-bc6d-4758-ab59-83e88a7b5491-kube-api-access-rhnvt\") pod \"279cc869-bc6d-4758-ab59-83e88a7b5491\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " Jul 07 11:07:52.566311 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.566208 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/279cc869-bc6d-4758-ab59-83e88a7b5491-openshift-service-ca\") pod \"279cc869-bc6d-4758-ab59-83e88a7b5491\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " Jul 07 11:07:52.566311 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.566242 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/279cc869-bc6d-4758-ab59-83e88a7b5491-maas-api-tls\") pod \"279cc869-bc6d-4758-ab59-83e88a7b5491\" (UID: \"279cc869-bc6d-4758-ab59-83e88a7b5491\") " Jul 07 11:07:52.566596 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.566569 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279cc869-bc6d-4758-ab59-83e88a7b5491-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "279cc869-bc6d-4758-ab59-83e88a7b5491" (UID: "279cc869-bc6d-4758-ab59-83e88a7b5491"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 11:07:52.568415 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.568383 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279cc869-bc6d-4758-ab59-83e88a7b5491-kube-api-access-rhnvt" (OuterVolumeSpecName: "kube-api-access-rhnvt") pod "279cc869-bc6d-4758-ab59-83e88a7b5491" (UID: "279cc869-bc6d-4758-ab59-83e88a7b5491"). InnerVolumeSpecName "kube-api-access-rhnvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 11:07:52.568508 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.568425 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/279cc869-bc6d-4758-ab59-83e88a7b5491-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "279cc869-bc6d-4758-ab59-83e88a7b5491" (UID: "279cc869-bc6d-4758-ab59-83e88a7b5491"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 11:07:52.669211 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.669132 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/279cc869-bc6d-4758-ab59-83e88a7b5491-openshift-service-ca\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:07:52.669211 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.669218 2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/279cc869-bc6d-4758-ab59-83e88a7b5491-maas-api-tls\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:07:52.669470 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.669233 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhnvt\" (UniqueName: \"kubernetes.io/projected/279cc869-bc6d-4758-ab59-83e88a7b5491-kube-api-access-rhnvt\") on node \"ip-10-0-135-59.ec2.internal\" DevicePath \"\"" Jul 07 11:07:52.971482 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.971398 2566 generic.go:356] "Generic (PLEG): container finished" podID="279cc869-bc6d-4758-ab59-83e88a7b5491" containerID="fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e" exitCode=0 Jul 07 11:07:52.971482 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.971465 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" Jul 07 11:07:52.971747 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.971489 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" event={"ID":"279cc869-bc6d-4758-ab59-83e88a7b5491","Type":"ContainerDied","Data":"fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e"} Jul 07 11:07:52.971747 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.971551 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb" event={"ID":"279cc869-bc6d-4758-ab59-83e88a7b5491","Type":"ContainerDied","Data":"7bbce2ac597b4d1b4ebab20bb231d33abb229aa699a71a7dbceafae28f025aff"} Jul 07 11:07:52.971747 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.971581 2566 scope.go:117] "RemoveContainer" containerID="fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e" Jul 07 11:07:52.980520 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.980500 2566 scope.go:117] "RemoveContainer" containerID="fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e" Jul 07 11:07:52.980782 ip-10-0-135-59 kubenswrapper[2566]: E0707 11:07:52.980763 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e\": container with ID starting with fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e not found: ID does not exist" containerID="fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e" Jul 07 11:07:52.980825 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:52.980793 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e"} err="failed to get container status \"fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e\": rpc error: code = NotFound desc = could not find container \"fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e\": container with ID starting with fd4b20ee5f0b7ed1b930cf8ac737e4c47b2acaa89654baf1d841fd22d177e64e not found: ID does not exist" Jul 07 11:07:53.005672 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:53.005649 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb"] Jul 07 11:07:53.010693 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:53.010671 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-2a3633-5dff487d7b-gqblb"] Jul 07 11:07:53.714507 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:07:53.714468 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="279cc869-bc6d-4758-ab59-83e88a7b5491" path="/var/lib/kubelet/pods/279cc869-bc6d-4758-ab59-83e88a7b5491/volumes" Jul 07 11:08:03.668381 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:03.668349 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723685-5nnw6_717f8bba-08a8-496f-a4a2-86341d864711/cleanup/0.log" Jul 07 11:08:03.774848 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:03.774815 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723700-5cdbg_6314e9d1-9973-4a9e-9da0-83cd429d4f6a/cleanup/0.log" Jul 07 11:08:04.017487 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:04.017386 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-n8bdc_c4982133-c9aa-42b1-a48e-f8c5ee204f27/server/0.log" Jul 07 11:08:04.508822 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:04.508791 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586fcf4d5b-vvjjg_b46cab4c-308f-46b6-97cb-580a8f56cdfc/copy-manifests/0.log" Jul 07 11:08:04.521469 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:04.521441 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586fcf4d5b-vvjjg_b46cab4c-308f-46b6-97cb-580a8f56cdfc/manager/0.log" Jul 07 11:08:06.544896 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:06.544863 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kbldv_53ac7782-8049-47af-a6ed-da810d054ec4/manager/0.log" Jul 07 11:08:07.467902 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:07.467874 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zxssp_c7283885-f05c-4996-b58e-0e0821d70ab8/discovery/0.log" Jul 07 11:08:08.051355 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:08.051327 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jd6m4_844ae801-2c15-43ba-b478-e35e2cc911c6/payload-processing/0.log" Jul 07 11:08:08.625328 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:08.625299 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-sw68s_f0adee05-36b9-4af1-8954-584020b665dc/main/0.log" Jul 07 11:08:08.737258 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:08.737230 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6gp4l_91aa3626-a3d0-4af4-baad-2911857124d7/main/0.log" Jul 07 11:08:16.389318 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:16.389285 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4t7c8_e1f3bd64-ddef-47d4-82bd-405034aac7b6/global-pull-secret-syncer/0.log" Jul 07 11:08:16.623837 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:16.623808 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zn24z_9379b713-f601-4993-9695-95d111564321/konnectivity-agent/0.log" Jul 07 11:08:16.671309 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:16.671226 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-59.ec2.internal_90a4ce6b5344e1b6a330df4dc8cc3efd/haproxy/0.log" Jul 07 11:08:21.732207 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:21.732172 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kbldv_53ac7782-8049-47af-a6ed-da810d054ec4/manager/0.log" Jul 07 11:08:23.887858 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:23.887771 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-l9j7k_4e941db7-7c0b-41d2-a2f7-9c86142ec435/cluster-monitoring-operator/0.log" Jul 07 11:08:24.049275 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.049249 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-2r65t_44ec3e16-153d-4347-8ea0-dedec549e7db/monitoring-plugin/0.log" Jul 07 11:08:24.172834 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.172758 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frn8p_639f09af-f0bb-4340-942c-dfc5b6aa8279/node-exporter/0.log" Jul 07 11:08:24.195705 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.195680 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frn8p_639f09af-f0bb-4340-942c-dfc5b6aa8279/kube-rbac-proxy/0.log" Jul 07 11:08:24.218771 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.218744 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frn8p_639f09af-f0bb-4340-942c-dfc5b6aa8279/init-textfile/0.log" Jul 07 11:08:24.429327 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.429250 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_005d2248-7cf6-40cb-9f7a-6ab652059668/prometheus/0.log" Jul 07 11:08:24.451122 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.451103 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_005d2248-7cf6-40cb-9f7a-6ab652059668/config-reloader/0.log" Jul 07 11:08:24.480746 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.480727 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_005d2248-7cf6-40cb-9f7a-6ab652059668/thanos-sidecar/0.log" Jul 07 11:08:24.504794 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.504774 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_005d2248-7cf6-40cb-9f7a-6ab652059668/kube-rbac-proxy-web/0.log" Jul 07 11:08:24.532200 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.532171 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_005d2248-7cf6-40cb-9f7a-6ab652059668/kube-rbac-proxy/0.log" Jul 07 11:08:24.562914 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.562887 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_005d2248-7cf6-40cb-9f7a-6ab652059668/kube-rbac-proxy-thanos/0.log" Jul 07 11:08:24.586208 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.586187 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_005d2248-7cf6-40cb-9f7a-6ab652059668/init-config-reloader/0.log" Jul 07 11:08:24.709733 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.709660 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-hk95f_f27ae057-e108-42f8-912b-55f76dee40fb/prometheus-operator-admission-webhook/0.log" Jul 07 11:08:24.830430 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.830399 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696d7b868b-pjvpm_460cf075-80b8-49ee-8121-8a1a492c3e08/thanos-query/0.log" Jul 07 11:08:24.858936 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.858911 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696d7b868b-pjvpm_460cf075-80b8-49ee-8121-8a1a492c3e08/kube-rbac-proxy-web/0.log" Jul 07 11:08:24.887093 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.887038 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696d7b868b-pjvpm_460cf075-80b8-49ee-8121-8a1a492c3e08/kube-rbac-proxy/0.log" Jul 07 11:08:24.909827 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.909790 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696d7b868b-pjvpm_460cf075-80b8-49ee-8121-8a1a492c3e08/prom-label-proxy/0.log" Jul 07 11:08:24.938277 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.938248 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696d7b868b-pjvpm_460cf075-80b8-49ee-8121-8a1a492c3e08/kube-rbac-proxy-rules/0.log" Jul 07 11:08:24.974773 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:24.974699 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696d7b868b-pjvpm_460cf075-80b8-49ee-8121-8a1a492c3e08/kube-rbac-proxy-metrics/0.log" Jul 07 11:08:26.372682 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.372641 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r"] Jul 07 11:08:26.373175 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.373130 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279cc869-bc6d-4758-ab59-83e88a7b5491" containerName="maas-api" Jul 07 11:08:26.373175 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.373161 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="279cc869-bc6d-4758-ab59-83e88a7b5491" containerName="maas-api" Jul 07 11:08:26.373276 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.373234 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="279cc869-bc6d-4758-ab59-83e88a7b5491" containerName="maas-api" Jul 07 11:08:26.377857 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.377832 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.380749 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.380727 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rgbf7\"/\"openshift-service-ca.crt\"" Jul 07 11:08:26.381851 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.381835 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rgbf7\"/\"default-dockercfg-9prl2\"" Jul 07 11:08:26.381945 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.381870 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rgbf7\"/\"kube-root-ca.crt\"" Jul 07 11:08:26.387262 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.387234 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r"] Jul 07 11:08:26.473932 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.473897 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-sys\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.473932 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.473939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-podres\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.474257 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.474040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58gwr\" (UniqueName: \"kubernetes.io/projected/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-kube-api-access-58gwr\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.474257 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.474123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-lib-modules\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.474257 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.474230 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-proc\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.575624 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.575578 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-lib-modules\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.575624 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.575632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-proc\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.575898 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.575713 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-proc\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.575898 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.575734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-sys\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.575898 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.575777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-podres\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.575898 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.575798 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-lib-modules\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.575898 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.575818 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58gwr\" (UniqueName: \"kubernetes.io/projected/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-kube-api-access-58gwr\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.575898 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.575837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-sys\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.575898 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.575894 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-podres\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.585037 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.585007 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58gwr\" (UniqueName: \"kubernetes.io/projected/80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7-kube-api-access-58gwr\") pod \"perf-node-gather-daemonset-wsn4r\" (UID: \"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7\") " pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.689634 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.689533 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:26.786378 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.786351 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/1.log" Jul 07 11:08:26.792518 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.792479 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lvjn6_2d6d25c2-a30c-4131-8a22-604414cd0f2f/console-operator/2.log" Jul 07 11:08:26.836280 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:26.836247 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r"] Jul 07 11:08:26.839585 ip-10-0-135-59 kubenswrapper[2566]: W0707 11:08:26.839561 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod80fc1ae8_d1ab_4ae6_bd63_7b6b7f2df8b7.slice/crio-d902e7b818a03e71bf149fdf3a4dfd46763ed100f2b6046ee15820ebda69c5eb WatchSource:0}: Error finding container d902e7b818a03e71bf149fdf3a4dfd46763ed100f2b6046ee15820ebda69c5eb: Status 404 returned error can't find the container with id d902e7b818a03e71bf149fdf3a4dfd46763ed100f2b6046ee15820ebda69c5eb Jul 07 11:08:27.139666 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:27.139634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" event={"ID":"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7","Type":"ContainerStarted","Data":"c67d82cb5caaefa3fc8e515bfd54470881976ae17f476fce604258f24dc51820"} Jul 07 11:08:27.139841 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:27.139684 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" event={"ID":"80fc1ae8-d1ab-4ae6-bd63-7b6b7f2df8b7","Type":"ContainerStarted","Data":"d902e7b818a03e71bf149fdf3a4dfd46763ed100f2b6046ee15820ebda69c5eb"} Jul 07 11:08:27.139841 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:27.139727 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:27.157240 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:27.157188 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" podStartSLOduration=1.157173474 podStartE2EDuration="1.157173474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:08:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:08:27.156389526 +0000 UTC m=+2465.928982581" watchObservedRunningTime="2026-07-07 11:08:27.157173474 +0000 UTC m=+2465.929766529" Jul 07 11:08:27.371434 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:27.371383 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-778bd455c8-kqf45_e36e94b8-ec3d-4fd0-82aa-77479af6d1c4/console/0.log" Jul 07 11:08:29.389670 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:29.389642 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dvvp6_aa8416e1-ce47-4760-b121-924aa3b1d346/dns/0.log" Jul 07 11:08:29.414257 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:29.414221 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dvvp6_aa8416e1-ce47-4760-b121-924aa3b1d346/kube-rbac-proxy/0.log" Jul 07 11:08:29.505135 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:29.505096 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5xshq_c6b1c54e-ae2d-4e19-a90c-0e4f8494e2a5/dns-node-resolver/0.log" Jul 07 11:08:30.181832 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:30.181797 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d5vcg_7aa34fad-be27-460f-9462-24b73575e5b4/node-ca/0.log" Jul 07 11:08:31.370456 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:31.370418 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zxssp_c7283885-f05c-4996-b58e-0e0821d70ab8/discovery/0.log" Jul 07 11:08:31.623226 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:31.623121 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jd6m4_844ae801-2c15-43ba-b478-e35e2cc911c6/payload-processing/0.log" Jul 07 11:08:32.391375 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:32.391329 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-86ndf_798adf2c-b8c3-4d94-bdf2-39d781d3420b/serve-healthcheck-canary/0.log" Jul 07 11:08:32.981457 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:32.981431 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5s6q6_346e82be-6d04-428f-b05a-aa73064a847f/kube-rbac-proxy/0.log" Jul 07 11:08:33.006043 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:33.006017 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5s6q6_346e82be-6d04-428f-b05a-aa73064a847f/exporter/0.log" Jul 07 11:08:33.037306 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:33.037278 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5s6q6_346e82be-6d04-428f-b05a-aa73064a847f/extractor/0.log" Jul 07 11:08:33.155446 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:33.155422 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rgbf7/perf-node-gather-daemonset-wsn4r" Jul 07 11:08:36.537495 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:36.537462 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723685-5nnw6_717f8bba-08a8-496f-a4a2-86341d864711/cleanup/0.log" Jul 07 11:08:36.562905 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:36.562876 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723700-5cdbg_6314e9d1-9973-4a9e-9da0-83cd429d4f6a/cleanup/0.log" Jul 07 11:08:36.754073 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:36.753968 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-n8bdc_c4982133-c9aa-42b1-a48e-f8c5ee204f27/server/0.log" Jul 07 11:08:37.042784 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:37.042757 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586fcf4d5b-vvjjg_b46cab4c-308f-46b6-97cb-580a8f56cdfc/manager/0.log" Jul 07 11:08:37.063320 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:37.063295 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586fcf4d5b-vvjjg_b46cab4c-308f-46b6-97cb-580a8f56cdfc/copy-manifests/0.log" Jul 07 11:08:37.330840 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:37.330822 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zxssp_c7283885-f05c-4996-b58e-0e0821d70ab8/discovery/0.log" Jul 07 11:08:37.504649 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:37.504611 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jd6m4_844ae801-2c15-43ba-b478-e35e2cc911c6/payload-processing/0.log" Jul 07 11:08:38.535453 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:38.535365 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59649ddfff-b9x2q_b81902a9-14c8-4e3e-831f-9228c883c1b9/manager/0.log" Jul 07 11:08:38.849623 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:38.849590 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zxssp_c7283885-f05c-4996-b58e-0e0821d70ab8/discovery/0.log" Jul 07 11:08:39.031776 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:39.031736 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jd6m4_844ae801-2c15-43ba-b478-e35e2cc911c6/payload-processing/0.log" Jul 07 11:08:43.393645 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:43.393616 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-g4fqb_6e219e0a-7f4d-4f59-b56a-4ad6dd9ff65d/migrator/0.log" Jul 07 11:08:43.417471 ip-10-0-135-59 kubenswrapper[2566]: I0707 11:08:43.417439 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-g4fqb_6e219e0a-7f4d-4f59-b56a-4ad6dd9ff65d/graceful-termination/0.log"