Jul 09 13:24:47.207366 ip-10-0-133-150 systemd[1]: Starting Kubernetes Kubelet... Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.625649 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631894 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631906 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631912 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631916 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631919 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631929 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631932 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:47.683342 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631935 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631938 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631941 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631944 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631947 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631950 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631953 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631956 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631959 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631962 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631965 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631967 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631970 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631973 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631976 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631979 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631981 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631984 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631986 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:47.684634 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631989 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631992 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631994 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.631997 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632000 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632003 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632005 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632008 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632010 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632013 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632016 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632019 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632022 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632024 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632027 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632030 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632032 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632036 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632040 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:47.685515 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632043 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632046 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632049 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632051 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632054 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632057 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632061 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632063 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632066 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632068 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632071 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632073 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632087 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632090 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632093 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632097 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632100 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632104 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632107 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632110 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:47.686421 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632114 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632116 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632119 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632122 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632125 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632127 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632130 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632132 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632135 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632138 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632140 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632143 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632145 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632148 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632150 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632153 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632156 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632159 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632163 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632166 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632168 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:47.687328 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632171 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632173 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632176 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632178 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632181 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632183 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632186 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632188 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632192 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632195 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632198 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632201 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632203 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632898 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632905 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632909 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632912 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632915 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632918 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:47.688210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632920 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632923 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632926 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632929 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632931 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632934 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632936 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632939 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632941 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632944 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632947 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632949 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632951 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632954 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632958 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632962 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632965 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632968 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632971 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:47.689096 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632974 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632977 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632980 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632982 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632985 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632987 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632990 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632993 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632996 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.632998 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633002 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633005 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633008 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633010 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633013 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633017 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633020 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633022 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633025 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633028 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:47.689959 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633030 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633032 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633035 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633037 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633040 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633043 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633045 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633048 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633052 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633056 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633059 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633062 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633066 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633068 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633071 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633074 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633091 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633094 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633096 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633099 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:47.690857 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633102 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633105 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633107 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633110 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633113 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633115 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633118 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633121 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633123 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633126 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633128 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633132 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633135 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633138 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633140 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633143 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633145 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633148 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633151 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:47.691740 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633154 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633157 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633159 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633162 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633164 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633167 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633170 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633172 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633174 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633177 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633180 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633182 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633185 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633187 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633190 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633581 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633587 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633593 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633596 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:47.692635 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633599 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633602 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633605 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633608 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633610 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633612 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633615 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633618 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633621 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633623 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633626 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633628 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633631 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633633 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633636 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633639 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633641 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633644 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633646 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633649 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:47.693518 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633652 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633654 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633657 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633663 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633667 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633670 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633673 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633676 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633679 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633681 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633686 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633690 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633692 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633695 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633697 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633700 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633702 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633705 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633708 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:47.694411 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633710 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633713 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633716 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633718 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633721 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633723 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633726 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633728 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633731 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633734 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633736 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633739 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633741 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633743 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633747 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633750 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633755 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633758 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633761 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:47.695284 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633763 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633766 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633769 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633771 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633775 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633778 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633780 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633783 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633785 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633788 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633791 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633794 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633796 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633799 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633801 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633804 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633806 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633809 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633811 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633813 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:47.696364 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633816 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633818 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633821 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633824 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633826 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633829 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633831 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633833 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633836 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633843 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633845 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633848 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633850 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633853 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633856 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633858 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.633862 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633928 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633935 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633941 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633945 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 13:24:47.697242 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633949 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633952 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633957 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633961 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633964 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633967 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633971 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633975 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633978 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633981 2577 flags.go:64] FLAG: --cgroup-root="" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633984 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633986 2577 flags.go:64] FLAG: --client-ca-file="" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633989 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633992 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633996 2577 flags.go:64] FLAG: --cluster-domain="" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.633999 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634002 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634005 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634008 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634012 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634017 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634019 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634022 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634025 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 09 13:24:47.698339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634028 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634031 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634035 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634040 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634044 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634047 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634050 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634052 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634055 2577 flags.go:64] FLAG: --enable-server="true" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634058 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634063 2577 flags.go:64] FLAG: --event-burst="100" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634066 2577 flags.go:64] FLAG: --event-qps="50" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634069 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634072 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634089 2577 flags.go:64] FLAG: --eviction-hard="" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634094 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634097 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634100 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634103 2577 flags.go:64] FLAG: --eviction-soft="" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634106 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634109 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634112 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634115 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634118 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634121 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 13:24:47.699435 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634124 2577 flags.go:64] FLAG: --feature-gates="" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634128 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634130 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634135 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634138 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634141 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634144 2577 flags.go:64] FLAG: --help="false" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634147 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-133-150.ec2.internal" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634150 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634153 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634159 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634162 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634165 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634168 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634171 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634186 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634189 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634191 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634195 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634197 2577 flags.go:64] FLAG: --kube-reserved="" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634201 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634204 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634207 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634209 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 13:24:47.700556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634212 2577 flags.go:64] FLAG: --lock-file="" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634215 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634218 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634221 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634226 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634229 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634232 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634235 2577 flags.go:64] FLAG: --logging-format="text" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634238 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634241 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634244 2577 flags.go:64] FLAG: --manifest-url="" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634248 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634253 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634256 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634260 2577 flags.go:64] FLAG: --max-pods="110" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634263 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634266 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634269 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634274 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634277 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634280 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634283 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634290 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634293 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634296 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 13:24:47.701644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634299 2577 flags.go:64] FLAG: --pod-cidr="" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634302 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634307 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634310 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634313 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634316 2577 flags.go:64] FLAG: --port="10250" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634319 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634322 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ab515e497786a16b" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634325 2577 flags.go:64] FLAG: --qos-reserved="" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634328 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634330 2577 flags.go:64] FLAG: --register-node="true" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634333 2577 flags.go:64] FLAG: --register-with-taints="" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634337 2577 flags.go:64] FLAG: --registry-burst="10" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634340 2577 flags.go:64] FLAG: --registry-qps="5" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634343 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634345 2577 flags.go:64] FLAG: --reserved-memory="" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634353 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634356 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634360 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634363 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634366 2577 flags.go:64] FLAG: --runonce="false" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634368 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634371 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634375 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634377 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 13:24:47.705327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634380 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634386 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634389 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634393 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634395 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634398 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634401 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634404 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634407 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634410 2577 flags.go:64] FLAG: --system-cgroups="" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634412 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634418 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634420 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634423 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634427 2577 flags.go:64] FLAG: --tls-min-version="" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634430 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634432 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634435 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634438 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634441 2577 flags.go:64] FLAG: --v="2" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634445 2577 flags.go:64] FLAG: --version="false" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634449 2577 flags.go:64] FLAG: --vmodule="" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634453 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.634456 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 13:24:47.798763 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634601 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:47.717921 ip-10-0-133-150 systemd[1]: Started Kubernetes Kubelet. Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634607 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634610 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634613 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634616 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634619 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634622 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634625 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634628 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634632 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634635 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634638 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634641 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634645 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634648 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634651 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634654 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634656 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634659 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:47.808130 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634662 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634665 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634667 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634670 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634672 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634675 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634677 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634680 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634682 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634685 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634687 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634689 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634692 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634694 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634698 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634701 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634704 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634706 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634709 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634711 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:47.809641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634714 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634716 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634720 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634722 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634725 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634729 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634732 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634735 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634738 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634741 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634744 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634746 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634749 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634751 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634754 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634756 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634759 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634761 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634764 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634767 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:47.810817 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634769 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634772 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634775 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634777 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634780 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634783 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634786 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634789 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634791 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634794 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634796 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634798 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634801 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634803 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634808 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634812 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634815 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634818 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634822 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634825 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:47.812033 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634828 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634831 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634833 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634836 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634838 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634841 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634844 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634846 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634849 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634852 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634854 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634857 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634859 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634862 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634864 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634867 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634869 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634872 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634876 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:47.813221 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.634878 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.635406 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.645097 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.645114 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.645136 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.645141 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645199 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645205 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645208 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645211 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645214 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645218 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645221 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645224 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:47.814636 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645226 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645229 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645232 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645234 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645237 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645240 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645243 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645246 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645248 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645252 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645254 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645257 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645260 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645263 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645266 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645269 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645271 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645274 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645279 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:47.815578 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645283 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645286 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645288 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645291 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645294 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645297 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645299 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645302 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645305 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645307 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645310 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645313 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645319 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645322 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645325 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645327 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645330 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645334 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645337 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645340 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:47.816541 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645344 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645347 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645350 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645353 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645356 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645358 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645362 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645365 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645367 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645370 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645372 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645375 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645379 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645382 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645385 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645388 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645391 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645393 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645396 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645398 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:47.817736 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645401 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645403 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645406 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645408 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645412 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645415 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645417 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645420 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645423 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645425 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645428 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645430 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645434 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645437 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645440 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645442 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645445 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645447 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645450 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645452 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:47.818944 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645455 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645457 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645460 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645462 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645465 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645467 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645470 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645472 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645475 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645477 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645480 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645483 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.645488 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645608 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645614 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:47.819841 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645618 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645621 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645625 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645628 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645631 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645633 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645636 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645638 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645641 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645645 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645648 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645651 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645653 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645656 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645658 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645661 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645664 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645666 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645669 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645671 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:47.820803 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645674 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645676 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645679 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645682 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645684 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645687 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645689 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645692 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645695 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645700 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645704 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645707 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645710 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645713 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645716 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645719 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645722 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645724 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645727 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645729 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:47.821755 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645732 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645735 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645738 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645741 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645744 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645746 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645749 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645752 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645754 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645757 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645759 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645761 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645764 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645767 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645769 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645772 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645774 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645777 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645779 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:47.822725 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645781 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645784 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645787 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645789 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645791 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645794 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645796 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645800 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645802 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645805 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645807 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645810 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645812 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645815 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645818 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645822 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645826 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645830 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645833 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645836 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:47.823684 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645838 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645841 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645844 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645846 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645849 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645851 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645854 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645856 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645859 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645861 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645864 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645866 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645869 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645872 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645876 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645880 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645884 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:47.824628 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:47.645887 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.645895 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.646024 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.651249 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.652904 2577 server.go:1019] "Starting client certificate rotation" Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.653003 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.653043 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.656171 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.658772 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.676857 2577 log.go:25] "Validated CRI v1 runtime API" Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.679836 2577 log.go:25] "Validated CRI v1 image API" Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.680466 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 13:24:47.825578 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.686938 2577 fs.go:135] Filesystem UUIDs: map[00100e82-8245-469b-b0de-f08116ddabe2:/dev/nvme0n1p3 6088aa87-e41a-4b03-97fe-282b2dffd002:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 09 13:24:47.828465 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.686957 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 13:24:47.828681 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.693459 2577 manager.go:216] Machine: {Timestamp:2026-07-09 13:24:47.691705759 +0000 UTC m=+0.362326914 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099685 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23544ca7354362638be0f1af8c69cb SystemUUID:ec23544c-a735-4362-638b-e0f1af8c69cb BootID:901006c0-9544-4255-8740-ff6c523c9397 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:be:5c:1c:ed:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:be:5c:1c:ed:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:c9:3f:fb:b0:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 13:24:47.828681 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.693607 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 13:24:47.828681 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.693702 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 13:24:47.828681 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.697831 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 13:24:47.828681 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.697880 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-150.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 13:24:47.828681 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.698722 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 13:24:47.828681 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.698733 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 13:24:47.828681 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.698740 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.699592 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.701139 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.704550 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.704676 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.705409 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.705422 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.705433 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.705446 2577 kubelet.go:398] "Adding apiserver pod source" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.705454 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.706057 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.706074 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.708477 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.710605 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.710633 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.711997 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.712011 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.712017 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.712022 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.712030 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.712036 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.712043 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.712048 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.712054 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.712060 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.712068 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.712073 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.713395 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.713404 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.715934 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.716100 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rg4b4" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.717145 2577 server.go:1268] "Started kubelet" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.720970 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rg4b4" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.721198 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.721297 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-150.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.721376 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-150.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.721511 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.721561 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.721552 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 13:24:47.829328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.723703 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.723618 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-150.ec2.internal.18c0a1ec118624fc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-150.ec2.internal,UID:ip-10-0-133-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-150.ec2.internal,},FirstTimestamp:2026-07-09 13:24:47.717074172 +0000 UTC m=+0.387695324,LastTimestamp:2026-07-09 13:24:47.717074172 +0000 UTC m=+0.387695324,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-150.ec2.internal,}" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.727239 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.729320 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.729338 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.729400 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.729472 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730052 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730052 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730127 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730309 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730323 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730426 2577 factory.go:55] Registering systemd factory Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730442 2577 factory.go:223] Registration of the systemd container factory successfully Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730715 2577 factory.go:153] Registering CRI-O factory Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730728 2577 factory.go:223] Registration of the crio container factory successfully Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730790 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730817 2577 factory.go:103] Registering Raw factory Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.730828 2577 manager.go:1196] Started watching for new ooms in manager Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.732920 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.733890 2577 manager.go:349] Starting recovery of all containers Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.736531 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-150.ec2.internal\" not found" node="ip-10-0-133-150.ec2.internal" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.762169 2577 manager.go:354] Recovery completed Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.766972 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.773053 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.773095 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.773110 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.773798 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.773810 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.773830 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.773802 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.774811 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.774848 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.774868 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.775360 2577 policy_none.go:49] "None policy: Start" Jul 09 13:24:47.849763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.775374 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 13:24:47.851051 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.775385 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 13:24:47.851051 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.776514 2577 policy_none.go:47] "Start" Jul 09 13:24:47.851051 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.830305 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.871794 2577 manager.go:337] "Starting Device Plugin manager" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.871830 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.871845 2577 server.go:87] "Starting device plugin registration server" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.872181 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.872199 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.872305 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.872400 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.872413 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.873031 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.873075 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.894384 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.895714 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.895777 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.895804 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.895848 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 13:24:47.973811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.904691 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:24:47.975682 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.974981 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.976864 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.976896 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.976911 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.976939 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.991927 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:47.991953 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-150.ec2.internal\": node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.996257 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-150.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal"] Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.996322 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.998002 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.998029 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.998039 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.999625 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.999762 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:47.999801 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.002029 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.002049 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.002060 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.002491 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.002516 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.002531 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.003407 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.003433 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.004206 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.004226 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.004249 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.032139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d70a0c898764cecc72dc2bff5d7aa381-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal\" (UID: \"d70a0c898764cecc72dc2bff5d7aa381\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.063194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.032168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d70a0c898764cecc72dc2bff5d7aa381-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal\" (UID: \"d70a0c898764cecc72dc2bff5d7aa381\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.064428 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.032191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e79c4d080c88104a74e6d82e667d4c5e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-150.ec2.internal\" (UID: \"e79c4d080c88104a74e6d82e667d4c5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.064428 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:48.051058 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-150.ec2.internal\" not found" node="ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.064428 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:48.053067 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:48.064428 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:48.055845 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-150.ec2.internal\" not found" node="ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.215079 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.133281 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e79c4d080c88104a74e6d82e667d4c5e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-150.ec2.internal\" (UID: \"e79c4d080c88104a74e6d82e667d4c5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.215079 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.133292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e79c4d080c88104a74e6d82e667d4c5e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-150.ec2.internal\" (UID: \"e79c4d080c88104a74e6d82e667d4c5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.215079 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.133335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d70a0c898764cecc72dc2bff5d7aa381-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal\" (UID: \"d70a0c898764cecc72dc2bff5d7aa381\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.215079 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.133355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d70a0c898764cecc72dc2bff5d7aa381-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal\" (UID: \"d70a0c898764cecc72dc2bff5d7aa381\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.215079 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.133388 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d70a0c898764cecc72dc2bff5d7aa381-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal\" (UID: \"d70a0c898764cecc72dc2bff5d7aa381\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.215079 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.133445 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d70a0c898764cecc72dc2bff5d7aa381-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal\" (UID: \"d70a0c898764cecc72dc2bff5d7aa381\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.215079 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:48.153548 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:48.384763 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:48.255255 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:48.384763 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:48.356993 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:48.384763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.379847 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.384763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.379847 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-150.ec2.internal" Jul 09 13:24:48.517801 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:48.458579 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:48.656890 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:48.558876 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:48.656890 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.652382 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 13:24:48.656890 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.652545 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 13:24:48.656890 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.652595 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 13:24:48.661390 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:48.659111 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:48.778373 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.728390 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 13:19:48 +0000 UTC" deadline="2028-02-10 01:34:47.324532039 +0000 UTC" Jul 09 13:24:48.778373 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.728415 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13932h9m58.596120084s" Jul 09 13:24:48.778373 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.737007 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:24:48.778373 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:48.759972 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:48.896210 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:48.860671 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-150.ec2.internal\" not found" Jul 09 13:24:49.022661 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.918657 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:24:49.022661 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.930457 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-150.ec2.internal" Jul 09 13:24:49.022661 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.941778 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:24:49.022661 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.942967 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" Jul 09 13:24:49.022661 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:48.953781 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:24:49.371520 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:49.371475 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79c4d080c88104a74e6d82e667d4c5e.slice/crio-1488e646e111b626b4ec29cd31dc8d2930f7593c23997c1502b40c8a35326263 WatchSource:0}: Error finding container 1488e646e111b626b4ec29cd31dc8d2930f7593c23997c1502b40c8a35326263: Status 404 returned error can't find the container with id 1488e646e111b626b4ec29cd31dc8d2930f7593c23997c1502b40c8a35326263 Jul 09 13:24:49.372044 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:49.372021 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70a0c898764cecc72dc2bff5d7aa381.slice/crio-5fead983dd537210db4cdb3c420d3166397fb3ab0fd72e16203dfc55e606ad6c WatchSource:0}: Error finding container 5fead983dd537210db4cdb3c420d3166397fb3ab0fd72e16203dfc55e606ad6c: Status 404 returned error can't find the container with id 5fead983dd537210db4cdb3c420d3166397fb3ab0fd72e16203dfc55e606ad6c Jul 09 13:24:49.378269 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.378253 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 13:24:49.507796 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.507768 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:24:49.709381 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.709293 2577 apiserver.go:52] "Watching apiserver" Jul 09 13:24:49.717406 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.717384 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 13:24:49.717788 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.717766 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf","openshift-cluster-node-tuning-operator/tuned-wljzj","openshift-network-diagnostics/network-check-target-mktm5","openshift-network-operator/iptables-alerter-fwx7f","openshift-ovn-kubernetes/ovnkube-node-sx8bc","kube-system/global-pull-secret-syncer-6rhhv","kube-system/konnectivity-agent-gssd4","openshift-dns/node-resolver-2bxw7","openshift-image-registry/node-ca-6tvhm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal","openshift-multus/multus-2c87d","openshift-multus/multus-additional-cni-plugins-rtbxp","openshift-multus/network-metrics-daemon-q9wtv","kube-system/kube-apiserver-proxy-ip-10-0-133-150.ec2.internal"] Jul 09 13:24:49.720241 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.720214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:24:49.721419 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.721404 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:49.721493 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:49.721474 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:24:49.722623 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.722608 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:49.722685 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:49.722657 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:24:49.723334 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.723318 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 13:24:49.723472 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.723443 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 13:24:49.723574 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.723556 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sz75c\"" Jul 09 13:24:49.723829 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.723812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwx7f" Jul 09 13:24:49.725076 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.725058 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.726467 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.726447 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 13:24:49.726567 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.726465 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:24:49.726567 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.726483 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gwxtt\"" Jul 09 13:24:49.726567 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.726448 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 13:24:49.726989 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.726970 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:49.727095 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:49.727037 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:24:49.727455 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.727437 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 13:24:49.727833 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.727800 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 13:24:49.727905 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.727849 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 13:24:49.727905 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.727865 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8qg9j\"" Jul 09 13:24:49.728012 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.727905 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 13:24:49.728455 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.728439 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6tvhm" Jul 09 13:24:49.728834 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.728815 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 13:24:49.728953 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.728928 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 13:24:49.729647 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.729630 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 13:24:49.729995 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.729976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.732514 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.730973 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 13:24:49.732514 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.731266 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5vg4k\"" Jul 09 13:24:49.732514 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.731306 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 13:24:49.732514 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.731362 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 13:24:49.732785 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.732551 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 13:24:49.732785 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.732783 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 13:24:49.734093 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.732976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.734093 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.733134 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-df8g5\"" Jul 09 13:24:49.734093 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.733414 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 13:24:49.734376 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.734337 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2bxw7" Jul 09 13:24:49.735834 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.735813 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vsnxs\"" Jul 09 13:24:49.735924 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.735815 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 13:24:49.735995 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.735961 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:24:49.736285 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.736225 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.737815 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.737798 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.739844 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.739813 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 13:24:49.739949 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.739823 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 13:24:49.740083 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.740066 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 13:24:49.740172 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.740117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hsr7d\"" Jul 09 13:24:49.740868 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.740849 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 13:24:49.740976 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.740869 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 13:24:49.740976 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.740874 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v7x28\"" Jul 09 13:24:49.740976 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.740880 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 13:24:49.740976 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.740934 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 13:24:49.741256 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.741240 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 13:24:49.741370 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.741354 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b7bfw\"" Jul 09 13:24:49.742702 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.742682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-var-lib-openvswitch\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.742757 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.742718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28144e94-6c28-4d5c-90ff-e3f548590536-agent-certs\") pod \"konnectivity-agent-gssd4\" (UID: \"28144e94-6c28-4d5c-90ff-e3f548590536\") " pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:24:49.742757 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.742746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-device-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.742832 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.742773 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b3939c7-9b8d-4139-b09c-18df0eab4813-kubelet-config\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:49.742832 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.742795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-modprobe-d\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.742832 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.742812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-kubernetes\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.742832 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.742830 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-ovn-node-metrics-cert\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.743013 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.742878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-var-lib-kubelet\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.743013 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.742952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj2fr\" (UniqueName: \"kubernetes.io/projected/f445db22-9563-43de-b572-bcbd7d3b604e-kube-api-access-wj2fr\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:49.743013 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.742987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f7967fba-b519-4892-a817-330df52c8d2a-serviceca\") pod \"node-ca-6tvhm\" (UID: \"f7967fba-b519-4892-a817-330df52c8d2a\") " pod="openshift-image-registry/node-ca-6tvhm" Jul 09 13:24:49.743013 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.743237 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743028 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wxrd\" (UniqueName: \"kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd\") pod \"network-check-target-mktm5\" (UID: \"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4\") " pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:49.743237 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-run-ovn\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.743237 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-run\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.743237 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28144e94-6c28-4d5c-90ff-e3f548590536-konnectivity-ca\") pod \"konnectivity-agent-gssd4\" (UID: \"28144e94-6c28-4d5c-90ff-e3f548590536\") " pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:24:49.743237 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-cni-netd\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.743237 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743192 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:24:49.743237 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-sys\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743264 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7102ecc-61d3-4a13-873d-1ac962a99e5c-iptables-alerter-script\") pod \"iptables-alerter-fwx7f\" (UID: \"b7102ecc-61d3-4a13-873d-1ac962a99e5c\") " pod="openshift-network-operator/iptables-alerter-fwx7f" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-run-netns\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-ovnkube-config\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-env-overrides\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b3939c7-9b8d-4139-b09c-18df0eab4813-dbus\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k9n2\" (UniqueName: \"kubernetes.io/projected/ad0de3c6-3207-4fac-b6a2-e664a395356e-kube-api-access-6k9n2\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-socket-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-sysctl-d\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-run-systemd\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-node-log\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-854kn\" (UniqueName: \"kubernetes.io/projected/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-kube-api-access-854kn\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.743619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad0de3c6-3207-4fac-b6a2-e664a395356e-tmp\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-slash\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-etc-openvswitch\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-tuned\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-run-openvswitch\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-sysconfig\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743776 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-host\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743799 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-cni-bin\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-sysctl-conf\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-sys-fs\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-kubelet\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-systemd\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.743984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9xxn\" (UniqueName: \"kubernetes.io/projected/b7102ecc-61d3-4a13-873d-1ac962a99e5c-kube-api-access-n9xxn\") pod \"iptables-alerter-fwx7f\" (UID: \"b7102ecc-61d3-4a13-873d-1ac962a99e5c\") " pod="openshift-network-operator/iptables-alerter-fwx7f" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7967fba-b519-4892-a817-330df52c8d2a-host\") pod \"node-ca-6tvhm\" (UID: \"f7967fba-b519-4892-a817-330df52c8d2a\") " pod="openshift-image-registry/node-ca-6tvhm" Jul 09 13:24:49.744352 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7102ecc-61d3-4a13-873d-1ac962a99e5c-host-slash\") pod \"iptables-alerter-fwx7f\" (UID: \"b7102ecc-61d3-4a13-873d-1ac962a99e5c\") " pod="openshift-network-operator/iptables-alerter-fwx7f" Jul 09 13:24:49.744775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-759dj\" (UniqueName: \"kubernetes.io/projected/218bdc53-0761-4b9f-8be4-85c3cc52adbc-kube-api-access-759dj\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.744775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-log-socket\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.744775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-ovnkube-script-lib\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.744775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.744775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-registration-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.744775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.744775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:49.744775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4djvg\" (UniqueName: \"kubernetes.io/projected/f7967fba-b519-4892-a817-330df52c8d2a-kube-api-access-4djvg\") pod \"node-ca-6tvhm\" (UID: \"f7967fba-b519-4892-a817-330df52c8d2a\") " pod="openshift-image-registry/node-ca-6tvhm" Jul 09 13:24:49.744775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-systemd-units\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.744775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-lib-modules\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.744775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.744364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:49.765079 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.765056 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vf6f4" Jul 09 13:24:49.776770 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.776702 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vf6f4" Jul 09 13:24:49.831226 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.831194 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 13:24:49.846462 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-var-lib-cni-multus\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.846462 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf332382-6a36-4625-9ce5-691f6e74a58d-tmp-dir\") pod \"node-resolver-2bxw7\" (UID: \"bf332382-6a36-4625-9ce5-691f6e74a58d\") " pod="openshift-dns/node-resolver-2bxw7" Jul 09 13:24:49.846727 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-cni-bin\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.846727 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-cni-bin\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.846727 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-sysctl-conf\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.846727 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-sys-fs\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.846727 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846665 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-cni-dir\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.847045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-kubelet\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.847045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846746 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-sys-fs\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.847045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-systemd\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.847045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846805 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-sysctl-conf\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.847045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846850 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9xxn\" (UniqueName: \"kubernetes.io/projected/b7102ecc-61d3-4a13-873d-1ac962a99e5c-kube-api-access-n9xxn\") pod \"iptables-alerter-fwx7f\" (UID: \"b7102ecc-61d3-4a13-873d-1ac962a99e5c\") " pod="openshift-network-operator/iptables-alerter-fwx7f" Jul 09 13:24:49.847045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846925 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-kubelet\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.847045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.846955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-systemd\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.847045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7967fba-b519-4892-a817-330df52c8d2a-host\") pod \"node-ca-6tvhm\" (UID: \"f7967fba-b519-4892-a817-330df52c8d2a\") " pod="openshift-image-registry/node-ca-6tvhm" Jul 09 13:24:49.847506 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847059 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7967fba-b519-4892-a817-330df52c8d2a-host\") pod \"node-ca-6tvhm\" (UID: \"f7967fba-b519-4892-a817-330df52c8d2a\") " pod="openshift-image-registry/node-ca-6tvhm" Jul 09 13:24:49.847506 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/821fc019-e3f5-4a7d-9ec2-04659b2b11df-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.847506 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847251 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7102ecc-61d3-4a13-873d-1ac962a99e5c-host-slash\") pod \"iptables-alerter-fwx7f\" (UID: \"b7102ecc-61d3-4a13-873d-1ac962a99e5c\") " pod="openshift-network-operator/iptables-alerter-fwx7f" Jul 09 13:24:49.847506 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847300 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-759dj\" (UniqueName: \"kubernetes.io/projected/218bdc53-0761-4b9f-8be4-85c3cc52adbc-kube-api-access-759dj\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.847506 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-etc-kubernetes\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.847506 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.847506 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-log-socket\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.847869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-ovnkube-script-lib\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.847869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.847869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847545 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7102ecc-61d3-4a13-873d-1ac962a99e5c-host-slash\") pod \"iptables-alerter-fwx7f\" (UID: \"b7102ecc-61d3-4a13-873d-1ac962a99e5c\") " pod="openshift-network-operator/iptables-alerter-fwx7f" Jul 09 13:24:49.847869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-registration-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.847869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-log-socket\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.847869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-system-cni-dir\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.847869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847659 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.847869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847684 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-registration-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.847869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.847869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4djvg\" (UniqueName: \"kubernetes.io/projected/f7967fba-b519-4892-a817-330df52c8d2a-kube-api-access-4djvg\") pod \"node-ca-6tvhm\" (UID: \"f7967fba-b519-4892-a817-330df52c8d2a\") " pod="openshift-image-registry/node-ca-6tvhm" Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.847959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-systemd-units\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:49.848079 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-lib-modules\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:49.848201 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret podName:4b3939c7-9b8d-4139-b09c-18df0eab4813 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:50.348169778 +0000 UTC m=+3.018790983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret") pod "global-pull-secret-syncer-6rhhv" (UID: "4b3939c7-9b8d-4139-b09c-18df0eab4813") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:49.848240 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-conf-dir\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-cnibin\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:49.848301 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs podName:f445db22-9563-43de-b572-bcbd7d3b604e nodeName:}" failed. No retries permitted until 2026-07-09 13:24:50.348282177 +0000 UTC m=+3.018903335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs") pod "network-metrics-daemon-q9wtv" (UID: "f445db22-9563-43de-b572-bcbd7d3b604e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848349 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-ovnkube-script-lib\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-systemd-units\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.848431 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-var-lib-openvswitch\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-lib-modules\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848850 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28144e94-6c28-4d5c-90ff-e3f548590536-agent-certs\") pod \"konnectivity-agent-gssd4\" (UID: \"28144e94-6c28-4d5c-90ff-e3f548590536\") " pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-device-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848890 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-var-lib-openvswitch\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-socket-dir-parent\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b3939c7-9b8d-4139-b09c-18df0eab4813-kubelet-config\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848952 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-device-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-modprobe-d\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.848999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b3939c7-9b8d-4139-b09c-18df0eab4813-kubelet-config\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-kubernetes\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkm6x\" (UniqueName: \"kubernetes.io/projected/1c16166d-2f5a-4fd4-8153-67c1330496b3-kube-api-access-fkm6x\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849052 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-kubernetes\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skvwm\" (UniqueName: \"kubernetes.io/projected/821fc019-e3f5-4a7d-9ec2-04659b2b11df-kube-api-access-skvwm\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.849206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-ovn-node-metrics-cert\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-var-lib-kubelet\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849177 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-modprobe-d\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj2fr\" (UniqueName: \"kubernetes.io/projected/f445db22-9563-43de-b572-bcbd7d3b604e-kube-api-access-wj2fr\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f7967fba-b519-4892-a817-330df52c8d2a-serviceca\") pod \"node-ca-6tvhm\" (UID: \"f7967fba-b519-4892-a817-330df52c8d2a\") " pod="openshift-image-registry/node-ca-6tvhm" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849257 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-var-lib-kubelet\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxrd\" (UniqueName: \"kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd\") pod \"network-check-target-mktm5\" (UID: \"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4\") " pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849264 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-run-ovn\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-run\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28144e94-6c28-4d5c-90ff-e3f548590536-konnectivity-ca\") pod \"konnectivity-agent-gssd4\" (UID: \"28144e94-6c28-4d5c-90ff-e3f548590536\") " pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-system-cni-dir\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-cni-netd\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849447 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-cni-netd\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.849803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-run-ovn\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-sys\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-sys\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7102ecc-61d3-4a13-873d-1ac962a99e5c-iptables-alerter-script\") pod \"iptables-alerter-fwx7f\" (UID: \"b7102ecc-61d3-4a13-873d-1ac962a99e5c\") " pod="openshift-network-operator/iptables-alerter-fwx7f" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c16166d-2f5a-4fd4-8153-67c1330496b3-cni-binary-copy\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849629 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849677 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-run\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-var-lib-cni-bin\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-run-netns\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-ovnkube-config\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849902 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-run-netns\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849934 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f7967fba-b519-4892-a817-330df52c8d2a-serviceca\") pod \"node-ca-6tvhm\" (UID: \"f7967fba-b519-4892-a817-330df52c8d2a\") " pod="openshift-image-registry/node-ca-6tvhm" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-env-overrides\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.850468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.849997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b3939c7-9b8d-4139-b09c-18df0eab4813-dbus\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9n2\" (UniqueName: \"kubernetes.io/projected/ad0de3c6-3207-4fac-b6a2-e664a395356e-kube-api-access-6k9n2\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-socket-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-cnibin\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-sysctl-d\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-run-k8s-cni-cncf-io\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28144e94-6c28-4d5c-90ff-e3f548590536-konnectivity-ca\") pod \"konnectivity-agent-gssd4\" (UID: \"28144e94-6c28-4d5c-90ff-e3f548590536\") " pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850257 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7102ecc-61d3-4a13-873d-1ac962a99e5c-iptables-alerter-script\") pod \"iptables-alerter-fwx7f\" (UID: \"b7102ecc-61d3-4a13-873d-1ac962a99e5c\") " pod="openshift-network-operator/iptables-alerter-fwx7f" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-run-netns\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-hostroot\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-sysctl-d\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-os-release\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-env-overrides\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.851263 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850363 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/218bdc53-0761-4b9f-8be4-85c3cc52adbc-socket-dir\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/821fc019-e3f5-4a7d-9ec2-04659b2b11df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf332382-6a36-4625-9ce5-691f6e74a58d-hosts-file\") pod \"node-resolver-2bxw7\" (UID: \"bf332382-6a36-4625-9ce5-691f6e74a58d\") " pod="openshift-dns/node-resolver-2bxw7" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b3939c7-9b8d-4139-b09c-18df0eab4813-dbus\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgwlv\" (UniqueName: \"kubernetes.io/projected/bf332382-6a36-4625-9ce5-691f6e74a58d-kube-api-access-kgwlv\") pod \"node-resolver-2bxw7\" (UID: \"bf332382-6a36-4625-9ce5-691f6e74a58d\") " pod="openshift-dns/node-resolver-2bxw7" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-run-systemd\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-node-log\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850558 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-run-systemd\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-node-log\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-854kn\" (UniqueName: \"kubernetes.io/projected/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-kube-api-access-854kn\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad0de3c6-3207-4fac-b6a2-e664a395356e-tmp\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850662 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-run-multus-certs\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-slash\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-etc-openvswitch\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.851938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850723 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-ovnkube-config\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-tuned\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-host-slash\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-var-lib-kubelet\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850788 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-etc-openvswitch\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-daemon-config\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/821fc019-e3f5-4a7d-9ec2-04659b2b11df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-run-openvswitch\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-sysconfig\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-host\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-run-openvswitch\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850951 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-os-release\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850959 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-host\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.852627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.850992 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-sysconfig\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.853405 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.853354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-ovn-node-metrics-cert\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.853544 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.853517 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28144e94-6c28-4d5c-90ff-e3f548590536-agent-certs\") pod \"konnectivity-agent-gssd4\" (UID: \"28144e94-6c28-4d5c-90ff-e3f548590536\") " pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:24:49.853694 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.853545 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad0de3c6-3207-4fac-b6a2-e664a395356e-etc-tuned\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.853694 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.853569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad0de3c6-3207-4fac-b6a2-e664a395356e-tmp\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.856307 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.856249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9xxn\" (UniqueName: \"kubernetes.io/projected/b7102ecc-61d3-4a13-873d-1ac962a99e5c-kube-api-access-n9xxn\") pod \"iptables-alerter-fwx7f\" (UID: \"b7102ecc-61d3-4a13-873d-1ac962a99e5c\") " pod="openshift-network-operator/iptables-alerter-fwx7f" Jul 09 13:24:49.856636 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.856614 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4djvg\" (UniqueName: \"kubernetes.io/projected/f7967fba-b519-4892-a817-330df52c8d2a-kube-api-access-4djvg\") pod \"node-ca-6tvhm\" (UID: \"f7967fba-b519-4892-a817-330df52c8d2a\") " pod="openshift-image-registry/node-ca-6tvhm" Jul 09 13:24:49.856760 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.856738 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-759dj\" (UniqueName: \"kubernetes.io/projected/218bdc53-0761-4b9f-8be4-85c3cc52adbc-kube-api-access-759dj\") pod \"aws-ebs-csi-driver-node-thrbf\" (UID: \"218bdc53-0761-4b9f-8be4-85c3cc52adbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:49.861794 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:49.861771 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:24:49.861794 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:49.861794 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:24:49.861931 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:49.861809 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4wxrd for pod openshift-network-diagnostics/network-check-target-mktm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:49.861931 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:49.861880 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd podName:5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:50.36186154 +0000 UTC m=+3.032482697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4wxrd" (UniqueName: "kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd") pod "network-check-target-mktm5" (UID: "5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:49.865489 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.865419 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k9n2\" (UniqueName: \"kubernetes.io/projected/ad0de3c6-3207-4fac-b6a2-e664a395356e-kube-api-access-6k9n2\") pod \"tuned-wljzj\" (UID: \"ad0de3c6-3207-4fac-b6a2-e664a395356e\") " pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:49.865797 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.865773 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj2fr\" (UniqueName: \"kubernetes.io/projected/f445db22-9563-43de-b572-bcbd7d3b604e-kube-api-access-wj2fr\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:49.865889 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.865831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-854kn\" (UniqueName: \"kubernetes.io/projected/1d12d3ec-ec60-4bd0-8e58-b0891582a2b6-kube-api-access-854kn\") pod \"ovnkube-node-sx8bc\" (UID: \"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:49.901128 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.901000 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" event={"ID":"d70a0c898764cecc72dc2bff5d7aa381","Type":"ContainerStarted","Data":"5fead983dd537210db4cdb3c420d3166397fb3ab0fd72e16203dfc55e606ad6c"} Jul 09 13:24:49.902245 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.902209 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-150.ec2.internal" event={"ID":"e79c4d080c88104a74e6d82e667d4c5e","Type":"ContainerStarted","Data":"1488e646e111b626b4ec29cd31dc8d2930f7593c23997c1502b40c8a35326263"} Jul 09 13:24:49.951693 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-run-k8s-cni-cncf-io\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.951693 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-run-netns\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.951928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-hostroot\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.951928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-os-release\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.951928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/821fc019-e3f5-4a7d-9ec2-04659b2b11df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.951928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951779 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-run-k8s-cni-cncf-io\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.951928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf332382-6a36-4625-9ce5-691f6e74a58d-hosts-file\") pod \"node-resolver-2bxw7\" (UID: \"bf332382-6a36-4625-9ce5-691f6e74a58d\") " pod="openshift-dns/node-resolver-2bxw7" Jul 09 13:24:49.951928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951812 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-hostroot\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.951928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgwlv\" (UniqueName: \"kubernetes.io/projected/bf332382-6a36-4625-9ce5-691f6e74a58d-kube-api-access-kgwlv\") pod \"node-resolver-2bxw7\" (UID: \"bf332382-6a36-4625-9ce5-691f6e74a58d\") " pod="openshift-dns/node-resolver-2bxw7" Jul 09 13:24:49.951928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-run-multus-certs\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.951928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-os-release\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.951928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-var-lib-kubelet\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.951928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951870 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf332382-6a36-4625-9ce5-691f6e74a58d-hosts-file\") pod \"node-resolver-2bxw7\" (UID: \"bf332382-6a36-4625-9ce5-691f6e74a58d\") " pod="openshift-dns/node-resolver-2bxw7" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951933 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-run-multus-certs\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951950 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-var-lib-kubelet\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-daemon-config\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951810 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-run-netns\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.951990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/821fc019-e3f5-4a7d-9ec2-04659b2b11df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-os-release\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-var-lib-cni-multus\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf332382-6a36-4625-9ce5-691f6e74a58d-tmp-dir\") pod \"node-resolver-2bxw7\" (UID: \"bf332382-6a36-4625-9ce5-691f6e74a58d\") " pod="openshift-dns/node-resolver-2bxw7" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-cni-dir\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/821fc019-e3f5-4a7d-9ec2-04659b2b11df-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-etc-kubernetes\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-system-cni-dir\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-conf-dir\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.952486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-cnibin\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-socket-dir-parent\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkm6x\" (UniqueName: \"kubernetes.io/projected/1c16166d-2f5a-4fd4-8153-67c1330496b3-kube-api-access-fkm6x\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvwm\" (UniqueName: \"kubernetes.io/projected/821fc019-e3f5-4a7d-9ec2-04659b2b11df-kube-api-access-skvwm\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952478 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/821fc019-e3f5-4a7d-9ec2-04659b2b11df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-system-cni-dir\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-daemon-config\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c16166d-2f5a-4fd4-8153-67c1330496b3-cni-binary-copy\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952574 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/821fc019-e3f5-4a7d-9ec2-04659b2b11df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952563 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-os-release\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-var-lib-cni-bin\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-var-lib-cni-multus\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-system-cni-dir\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-cnibin\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952667 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-cni-dir\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952676 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-cnibin\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952726 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-host-var-lib-cni-bin\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952749 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-socket-dir-parent\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952774 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-system-cni-dir\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-etc-kubernetes\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-cnibin\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.953667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c16166d-2f5a-4fd4-8153-67c1330496b3-multus-conf-dir\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.953667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/821fc019-e3f5-4a7d-9ec2-04659b2b11df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.953667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.952993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf332382-6a36-4625-9ce5-691f6e74a58d-tmp-dir\") pod \"node-resolver-2bxw7\" (UID: \"bf332382-6a36-4625-9ce5-691f6e74a58d\") " pod="openshift-dns/node-resolver-2bxw7" Jul 09 13:24:49.953667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.953137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/821fc019-e3f5-4a7d-9ec2-04659b2b11df-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.953667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.953309 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c16166d-2f5a-4fd4-8153-67c1330496b3-cni-binary-copy\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.961763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.961702 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgwlv\" (UniqueName: \"kubernetes.io/projected/bf332382-6a36-4625-9ce5-691f6e74a58d-kube-api-access-kgwlv\") pod \"node-resolver-2bxw7\" (UID: \"bf332382-6a36-4625-9ce5-691f6e74a58d\") " pod="openshift-dns/node-resolver-2bxw7" Jul 09 13:24:49.961899 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.961767 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skvwm\" (UniqueName: \"kubernetes.io/projected/821fc019-e3f5-4a7d-9ec2-04659b2b11df-kube-api-access-skvwm\") pod \"multus-additional-cni-plugins-rtbxp\" (UID: \"821fc019-e3f5-4a7d-9ec2-04659b2b11df\") " pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:49.962039 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.962021 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkm6x\" (UniqueName: \"kubernetes.io/projected/1c16166d-2f5a-4fd4-8153-67c1330496b3-kube-api-access-fkm6x\") pod \"multus-2c87d\" (UID: \"1c16166d-2f5a-4fd4-8153-67c1330496b3\") " pod="openshift-multus/multus-2c87d" Jul 09 13:24:49.991761 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:49.991738 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:24:50.032257 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.032222 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:24:50.039996 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.039966 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwx7f" Jul 09 13:24:50.043546 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:50.043518 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28144e94_6c28_4d5c_90ff_e3f548590536.slice/crio-b1ef3ef2e31e0b5bfcfa60c8b30c3cc2c1671cf4018ee09809fc70340b667891 WatchSource:0}: Error finding container b1ef3ef2e31e0b5bfcfa60c8b30c3cc2c1671cf4018ee09809fc70340b667891: Status 404 returned error can't find the container with id b1ef3ef2e31e0b5bfcfa60c8b30c3cc2c1671cf4018ee09809fc70340b667891 Jul 09 13:24:50.048603 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.048576 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:24:50.049366 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:50.049338 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7102ecc_61d3_4a13_873d_1ac962a99e5c.slice/crio-c248df21eab4e6f2e50d50c8249fa9cd6bc57dcbee4a636f85e6a4e933440075 WatchSource:0}: Error finding container c248df21eab4e6f2e50d50c8249fa9cd6bc57dcbee4a636f85e6a4e933440075: Status 404 returned error can't find the container with id c248df21eab4e6f2e50d50c8249fa9cd6bc57dcbee4a636f85e6a4e933440075 Jul 09 13:24:50.052440 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.052422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6tvhm" Jul 09 13:24:50.058900 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.058879 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" Jul 09 13:24:50.059189 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:50.059165 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d12d3ec_ec60_4bd0_8e58_b0891582a2b6.slice/crio-9bbd2f67b6bc903ce17d0ae5ab40e17658ec406cbb9cd6ec0f5fb093378cfbff WatchSource:0}: Error finding container 9bbd2f67b6bc903ce17d0ae5ab40e17658ec406cbb9cd6ec0f5fb093378cfbff: Status 404 returned error can't find the container with id 9bbd2f67b6bc903ce17d0ae5ab40e17658ec406cbb9cd6ec0f5fb093378cfbff Jul 09 13:24:50.061742 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:50.061540 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7967fba_b519_4892_a817_330df52c8d2a.slice/crio-54add3f9ec93c6877bea6bd9f68e34585aaa2cffcef56cee3628eb116feb4bde WatchSource:0}: Error finding container 54add3f9ec93c6877bea6bd9f68e34585aaa2cffcef56cee3628eb116feb4bde: Status 404 returned error can't find the container with id 54add3f9ec93c6877bea6bd9f68e34585aaa2cffcef56cee3628eb116feb4bde Jul 09 13:24:50.066157 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.066133 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wljzj" Jul 09 13:24:50.067935 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:50.067912 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218bdc53_0761_4b9f_8be4_85c3cc52adbc.slice/crio-71a6c7e0cf548fffcbce40f9a919ccdf1d2f3283669039f33fbbcfb5d3e6f642 WatchSource:0}: Error finding container 71a6c7e0cf548fffcbce40f9a919ccdf1d2f3283669039f33fbbcfb5d3e6f642: Status 404 returned error can't find the container with id 71a6c7e0cf548fffcbce40f9a919ccdf1d2f3283669039f33fbbcfb5d3e6f642 Jul 09 13:24:50.073267 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.073248 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2bxw7" Jul 09 13:24:50.076530 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:50.076508 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0de3c6_3207_4fac_b6a2_e664a395356e.slice/crio-8ac714e805b99b867a650e919022af88484e23f71962d88a58b8c7ad8b863f29 WatchSource:0}: Error finding container 8ac714e805b99b867a650e919022af88484e23f71962d88a58b8c7ad8b863f29: Status 404 returned error can't find the container with id 8ac714e805b99b867a650e919022af88484e23f71962d88a58b8c7ad8b863f29 Jul 09 13:24:50.081487 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.081327 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2c87d" Jul 09 13:24:50.081660 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:50.081626 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf332382_6a36_4625_9ce5_691f6e74a58d.slice/crio-ad538fdc94a2ffc004defef5b0b9878c69bcc8c0b21c941f2db6de0c77bf8eb7 WatchSource:0}: Error finding container ad538fdc94a2ffc004defef5b0b9878c69bcc8c0b21c941f2db6de0c77bf8eb7: Status 404 returned error can't find the container with id ad538fdc94a2ffc004defef5b0b9878c69bcc8c0b21c941f2db6de0c77bf8eb7 Jul 09 13:24:50.086983 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.086881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" Jul 09 13:24:50.091005 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:50.090979 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c16166d_2f5a_4fd4_8153_67c1330496b3.slice/crio-4a938adbe3e045b8846ba4865efd1a4be8a179e588b71fa76c17208d4dbc11c8 WatchSource:0}: Error finding container 4a938adbe3e045b8846ba4865efd1a4be8a179e588b71fa76c17208d4dbc11c8: Status 404 returned error can't find the container with id 4a938adbe3e045b8846ba4865efd1a4be8a179e588b71fa76c17208d4dbc11c8 Jul 09 13:24:50.096270 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:24:50.096147 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821fc019_e3f5_4a7d_9ec2_04659b2b11df.slice/crio-7d178a46a0c0038cbeddaf27b83cfa086672f4e72871d43cf18053aeb84c62d2 WatchSource:0}: Error finding container 7d178a46a0c0038cbeddaf27b83cfa086672f4e72871d43cf18053aeb84c62d2: Status 404 returned error can't find the container with id 7d178a46a0c0038cbeddaf27b83cfa086672f4e72871d43cf18053aeb84c62d2 Jul 09 13:24:50.356547 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.356503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:50.356731 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.356560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:50.356731 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:50.356683 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:50.356837 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:50.356740 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:50.356837 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:50.356774 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret podName:4b3939c7-9b8d-4139-b09c-18df0eab4813 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:51.356748191 +0000 UTC m=+4.027369355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret") pod "global-pull-secret-syncer-6rhhv" (UID: "4b3939c7-9b8d-4139-b09c-18df0eab4813") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:50.356837 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:50.356797 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs podName:f445db22-9563-43de-b572-bcbd7d3b604e nodeName:}" failed. No retries permitted until 2026-07-09 13:24:51.356787085 +0000 UTC m=+4.027408232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs") pod "network-metrics-daemon-q9wtv" (UID: "f445db22-9563-43de-b572-bcbd7d3b604e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:50.457511 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.457464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxrd\" (UniqueName: \"kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd\") pod \"network-check-target-mktm5\" (UID: \"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4\") " pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:50.457696 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:50.457670 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:24:50.457696 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:50.457697 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:24:50.457783 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:50.457714 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4wxrd for pod openshift-network-diagnostics/network-check-target-mktm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:50.457783 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:50.457779 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd podName:5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:51.45776239 +0000 UTC m=+4.128383531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wxrd" (UniqueName: "kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd") pod "network-check-target-mktm5" (UID: "5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:50.781248 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.779324 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:19:50 +0000 UTC" deadline="2028-02-17 06:07:48.141439009 +0000 UTC" Jul 09 13:24:50.781248 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.779390 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14104h42m57.362053963s" Jul 09 13:24:50.896591 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.896546 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:50.897486 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:50.896704 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:24:50.897486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.897168 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:50.897486 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:50.897281 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:24:50.924416 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.924369 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2c87d" event={"ID":"1c16166d-2f5a-4fd4-8153-67c1330496b3","Type":"ContainerStarted","Data":"4a938adbe3e045b8846ba4865efd1a4be8a179e588b71fa76c17208d4dbc11c8"} Jul 09 13:24:50.942449 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.942412 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2bxw7" event={"ID":"bf332382-6a36-4625-9ce5-691f6e74a58d","Type":"ContainerStarted","Data":"ad538fdc94a2ffc004defef5b0b9878c69bcc8c0b21c941f2db6de0c77bf8eb7"} Jul 09 13:24:50.948765 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.948707 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6tvhm" event={"ID":"f7967fba-b519-4892-a817-330df52c8d2a","Type":"ContainerStarted","Data":"54add3f9ec93c6877bea6bd9f68e34585aaa2cffcef56cee3628eb116feb4bde"} Jul 09 13:24:50.951189 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.951141 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" event={"ID":"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6","Type":"ContainerStarted","Data":"9bbd2f67b6bc903ce17d0ae5ab40e17658ec406cbb9cd6ec0f5fb093378cfbff"} Jul 09 13:24:50.957361 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.957326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gssd4" event={"ID":"28144e94-6c28-4d5c-90ff-e3f548590536","Type":"ContainerStarted","Data":"b1ef3ef2e31e0b5bfcfa60c8b30c3cc2c1671cf4018ee09809fc70340b667891"} Jul 09 13:24:50.963729 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.963690 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" event={"ID":"821fc019-e3f5-4a7d-9ec2-04659b2b11df","Type":"ContainerStarted","Data":"7d178a46a0c0038cbeddaf27b83cfa086672f4e72871d43cf18053aeb84c62d2"} Jul 09 13:24:50.973358 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.973296 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wljzj" event={"ID":"ad0de3c6-3207-4fac-b6a2-e664a395356e","Type":"ContainerStarted","Data":"8ac714e805b99b867a650e919022af88484e23f71962d88a58b8c7ad8b863f29"} Jul 09 13:24:50.980200 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.980030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" event={"ID":"218bdc53-0761-4b9f-8be4-85c3cc52adbc","Type":"ContainerStarted","Data":"71a6c7e0cf548fffcbce40f9a919ccdf1d2f3283669039f33fbbcfb5d3e6f642"} Jul 09 13:24:50.982113 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:50.982023 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwx7f" event={"ID":"b7102ecc-61d3-4a13-873d-1ac962a99e5c","Type":"ContainerStarted","Data":"c248df21eab4e6f2e50d50c8249fa9cd6bc57dcbee4a636f85e6a4e933440075"} Jul 09 13:24:51.364863 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:51.364086 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:51.364863 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:51.364151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:51.364863 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:51.364291 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:51.364863 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:51.364358 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs podName:f445db22-9563-43de-b572-bcbd7d3b604e nodeName:}" failed. No retries permitted until 2026-07-09 13:24:53.364337744 +0000 UTC m=+6.034958911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs") pod "network-metrics-daemon-q9wtv" (UID: "f445db22-9563-43de-b572-bcbd7d3b604e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:51.364863 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:51.364766 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:51.364863 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:51.364815 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret podName:4b3939c7-9b8d-4139-b09c-18df0eab4813 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:53.364800102 +0000 UTC m=+6.035421259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret") pod "global-pull-secret-syncer-6rhhv" (UID: "4b3939c7-9b8d-4139-b09c-18df0eab4813") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:51.465777 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:51.465037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxrd\" (UniqueName: \"kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd\") pod \"network-check-target-mktm5\" (UID: \"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4\") " pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:51.465777 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:51.465265 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:24:51.465777 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:51.465288 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:24:51.465777 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:51.465302 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4wxrd for pod openshift-network-diagnostics/network-check-target-mktm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:51.465777 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:51.465361 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd podName:5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:53.465342902 +0000 UTC m=+6.135964062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wxrd" (UniqueName: "kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd") pod "network-check-target-mktm5" (UID: "5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:51.779724 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:51.779580 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:19:50 +0000 UTC" deadline="2028-04-08 09:50:29.29392097 +0000 UTC" Jul 09 13:24:51.779724 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:51.779622 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15332h25m37.514303696s" Jul 09 13:24:51.899792 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:51.899462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:51.900312 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:51.899864 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:24:52.003198 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:52.003133 2577 generic.go:356] "Generic (PLEG): container finished" podID="d70a0c898764cecc72dc2bff5d7aa381" containerID="ce0e10ab1ce802aa0599e52115c57bc435e20ef07554ae1a84ea01a2b379f9b8" exitCode=0 Jul 09 13:24:52.003378 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:52.003220 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" event={"ID":"d70a0c898764cecc72dc2bff5d7aa381","Type":"ContainerDied","Data":"ce0e10ab1ce802aa0599e52115c57bc435e20ef07554ae1a84ea01a2b379f9b8"} Jul 09 13:24:52.896509 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:52.896460 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:52.896779 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:52.896634 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:24:52.897067 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:52.897048 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:52.897182 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:52.897164 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:24:53.012810 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:53.012770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" event={"ID":"d70a0c898764cecc72dc2bff5d7aa381","Type":"ContainerStarted","Data":"6805cc27c0abb48005a194acdabf8e928e5f8613032fe22e7590b301cb655d5b"} Jul 09 13:24:53.385026 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:53.384353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:53.385026 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:53.384413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:53.385026 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:53.384555 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:53.385026 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:53.384627 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs podName:f445db22-9563-43de-b572-bcbd7d3b604e nodeName:}" failed. No retries permitted until 2026-07-09 13:24:57.384604839 +0000 UTC m=+10.055225983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs") pod "network-metrics-daemon-q9wtv" (UID: "f445db22-9563-43de-b572-bcbd7d3b604e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:53.385026 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:53.384555 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:53.385026 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:53.384710 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret podName:4b3939c7-9b8d-4139-b09c-18df0eab4813 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:57.384695996 +0000 UTC m=+10.055317141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret") pod "global-pull-secret-syncer-6rhhv" (UID: "4b3939c7-9b8d-4139-b09c-18df0eab4813") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:53.484908 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:53.484866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxrd\" (UniqueName: \"kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd\") pod \"network-check-target-mktm5\" (UID: \"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4\") " pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:53.485106 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:53.485062 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:24:53.485106 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:53.485082 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:24:53.485106 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:53.485095 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4wxrd for pod openshift-network-diagnostics/network-check-target-mktm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:53.485285 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:53.485181 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd podName:5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:57.485159336 +0000 UTC m=+10.155780497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wxrd" (UniqueName: "kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd") pod "network-check-target-mktm5" (UID: "5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:53.899291 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:53.899254 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:53.899497 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:53.899415 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:24:54.896757 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:54.896715 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:54.897146 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:54.896879 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:24:54.897146 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:54.896973 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:54.897146 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:54.897049 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:24:55.896537 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:55.896483 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:55.896766 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:55.896659 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:24:56.896949 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:56.896911 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:56.897509 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:56.897048 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:24:56.897509 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:56.897181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:56.897509 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:56.897310 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:24:57.419533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:57.419374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:57.419533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:57.419431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:57.419533 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:57.419511 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:57.419817 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:57.419581 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret podName:4b3939c7-9b8d-4139-b09c-18df0eab4813 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:05.419563527 +0000 UTC m=+18.090184695 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret") pod "global-pull-secret-syncer-6rhhv" (UID: "4b3939c7-9b8d-4139-b09c-18df0eab4813") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:57.419817 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:57.419512 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:57.419817 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:57.419669 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs podName:f445db22-9563-43de-b572-bcbd7d3b604e nodeName:}" failed. No retries permitted until 2026-07-09 13:25:05.419645728 +0000 UTC m=+18.090266871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs") pod "network-metrics-daemon-q9wtv" (UID: "f445db22-9563-43de-b572-bcbd7d3b604e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:57.520545 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:57.520509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxrd\" (UniqueName: \"kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd\") pod \"network-check-target-mktm5\" (UID: \"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4\") " pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:57.520750 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:57.520732 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:24:57.520820 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:57.520762 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:24:57.520820 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:57.520777 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4wxrd for pod openshift-network-diagnostics/network-check-target-mktm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:57.520910 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:57.520835 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd podName:5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:05.520816033 +0000 UTC m=+18.191437192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wxrd" (UniqueName: "kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd") pod "network-check-target-mktm5" (UID: "5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:57.897096 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:57.897047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:57.897493 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:57.897205 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:24:58.896424 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:58.896326 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:24:58.896607 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:58.896460 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:24:58.896607 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:58.896468 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:24:58.896720 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:58.896610 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:24:59.896678 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:24:59.896506 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:24:59.897105 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:24:59.896672 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:00.896870 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:00.896823 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:00.896870 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:00.896868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:00.897340 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:00.896969 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:00.897340 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:00.897102 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:01.896131 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:01.896097 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:01.896323 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:01.896218 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:02.897027 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:02.896984 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:02.897492 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:02.897133 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:02.897492 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:02.897198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:02.897492 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:02.897318 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:03.896899 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:03.896849 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:03.897104 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:03.896999 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:04.896471 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:04.896432 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:04.896696 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:04.896561 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:04.896696 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:04.896611 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:04.896809 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:04.896729 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:05.483980 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:05.483939 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:05.484419 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:05.483988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:05.484419 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:05.484126 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:25:05.484419 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:05.484139 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:25:05.484419 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:05.484199 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs podName:f445db22-9563-43de-b572-bcbd7d3b604e nodeName:}" failed. No retries permitted until 2026-07-09 13:25:21.484183843 +0000 UTC m=+34.154804983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs") pod "network-metrics-daemon-q9wtv" (UID: "f445db22-9563-43de-b572-bcbd7d3b604e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:25:05.484419 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:05.484213 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret podName:4b3939c7-9b8d-4139-b09c-18df0eab4813 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:21.484206873 +0000 UTC m=+34.154828013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret") pod "global-pull-secret-syncer-6rhhv" (UID: "4b3939c7-9b8d-4139-b09c-18df0eab4813") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:25:05.584664 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:05.584626 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxrd\" (UniqueName: \"kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd\") pod \"network-check-target-mktm5\" (UID: \"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4\") " pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:05.584850 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:05.584781 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:25:05.584850 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:05.584797 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:25:05.584850 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:05.584810 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4wxrd for pod openshift-network-diagnostics/network-check-target-mktm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:25:05.584973 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:05.584872 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd podName:5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:21.584853007 +0000 UTC m=+34.255474167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wxrd" (UniqueName: "kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd") pod "network-check-target-mktm5" (UID: "5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:25:05.896947 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:05.896914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:05.897147 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:05.897041 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:06.896718 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:06.896674 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:06.897209 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:06.896825 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:06.897209 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:06.896861 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:06.897209 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:06.896973 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:07.896875 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:07.896845 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:07.897391 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:07.896969 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:08.896183 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:08.896149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:08.896183 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:08.896176 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:08.896464 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:08.896262 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:08.896464 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:08.896377 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:09.896936 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:09.896890 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:09.897398 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:09.897045 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:10.897102 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:10.896771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:10.897762 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:10.896825 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:10.897762 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:10.897185 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:10.897762 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:10.897264 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:11.049591 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.049559 2577 generic.go:356] "Generic (PLEG): container finished" podID="821fc019-e3f5-4a7d-9ec2-04659b2b11df" containerID="fd451e1f994318c799886452614d6d5f3f5f891fc12be35dea0953c9939d508f" exitCode=0 Jul 09 13:25:11.050316 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.049639 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" event={"ID":"821fc019-e3f5-4a7d-9ec2-04659b2b11df","Type":"ContainerDied","Data":"fd451e1f994318c799886452614d6d5f3f5f891fc12be35dea0953c9939d508f"} Jul 09 13:25:11.051316 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.051294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wljzj" event={"ID":"ad0de3c6-3207-4fac-b6a2-e664a395356e","Type":"ContainerStarted","Data":"8b5b353452c2fb08ebc95b64417d026793c960dcf3b454b6864f608963887fe4"} Jul 09 13:25:11.052772 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.052752 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" event={"ID":"218bdc53-0761-4b9f-8be4-85c3cc52adbc","Type":"ContainerStarted","Data":"bc2deab40efad497d1000fead046d7a48fb00e7691361d3febedf6d2e07e1585"} Jul 09 13:25:11.054464 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.054427 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-150.ec2.internal" event={"ID":"e79c4d080c88104a74e6d82e667d4c5e","Type":"ContainerStarted","Data":"9b6269379ed1bebd7862bee39c7ed056fa5c5a9037f02326a5a781ba2bbe8508"} Jul 09 13:25:11.055955 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.055922 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2c87d" event={"ID":"1c16166d-2f5a-4fd4-8153-67c1330496b3","Type":"ContainerStarted","Data":"f18ee4f32245f38115a4c549cd90a5a527f62d93bcf66b151009a8fef0ef6063"} Jul 09 13:25:11.057214 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.057195 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2bxw7" event={"ID":"bf332382-6a36-4625-9ce5-691f6e74a58d","Type":"ContainerStarted","Data":"f18f0e6c3717e1da6a8eb0e8562554bd54ceef9e45e2cbe4aba579bca1c503d2"} Jul 09 13:25:11.061199 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.061167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6tvhm" event={"ID":"f7967fba-b519-4892-a817-330df52c8d2a","Type":"ContainerStarted","Data":"b44a60fb8f8c6de87e8a079ff077bcf94a0b6d9474b6fb06424602c41a549e8e"} Jul 09 13:25:11.063758 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.063740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" event={"ID":"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6","Type":"ContainerStarted","Data":"7583a5c6020bb21d41c8fc5bba33098a528198188647ea0e331714ffb90062b1"} Jul 09 13:25:11.063874 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.063806 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" event={"ID":"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6","Type":"ContainerStarted","Data":"8f897c7299847f3523c2c4f6dde7e0c1be0220d61e766502362afdfa46830419"} Jul 09 13:25:11.063874 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.063856 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" event={"ID":"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6","Type":"ContainerStarted","Data":"ed38eecb5ed31126a653f8d26fea1d849d802971a17c77f802f61714ab2ca882"} Jul 09 13:25:11.063979 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.063903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" event={"ID":"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6","Type":"ContainerStarted","Data":"b85befd804845562a5cf9ffeb0e27d38e3d5d149d65393a8318d01553e0b7ca7"} Jul 09 13:25:11.063979 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.063956 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" event={"ID":"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6","Type":"ContainerStarted","Data":"ca8f855ad30ea119e3135b24aa29d9abbd804ea800d006640150675be8427492"} Jul 09 13:25:11.065032 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.065008 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gssd4" event={"ID":"28144e94-6c28-4d5c-90ff-e3f548590536","Type":"ContainerStarted","Data":"15c8e8d0800561353c1f5238c0f7b3fec86b8a891a79bd3712d97da7f09541b9"} Jul 09 13:25:11.080318 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.080273 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-150.ec2.internal" podStartSLOduration=22.080259854 podStartE2EDuration="22.080259854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:24:53.032711016 +0000 UTC m=+5.703332182" watchObservedRunningTime="2026-07-09 13:25:11.080259854 +0000 UTC m=+23.750881017" Jul 09 13:25:11.099944 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.099883 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6tvhm" podStartSLOduration=2.812342802 podStartE2EDuration="23.099866432s" totalImagesPullingTime="20.28752363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:11.099295952 +0000 UTC m=+23.769917116" watchObservedRunningTime="2026-07-09 13:25:11.099866432 +0000 UTC m=+23.770487594" Jul 09 13:25:11.132400 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.132353 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wljzj" podStartSLOduration=2.860238629 podStartE2EDuration="23.132335708s" totalImagesPullingTime="20.272097079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:11.116495351 +0000 UTC m=+23.787116585" watchObservedRunningTime="2026-07-09 13:25:11.132335708 +0000 UTC m=+23.802956870" Jul 09 13:25:11.132690 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.132668 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2bxw7" podStartSLOduration=2.871750285 podStartE2EDuration="23.13266301s" totalImagesPullingTime="20.260912725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:11.132033408 +0000 UTC m=+23.802654571" watchObservedRunningTime="2026-07-09 13:25:11.13266301 +0000 UTC m=+23.803284172" Jul 09 13:25:11.151459 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.151409 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2c87d" podStartSLOduration=2.852483357 podStartE2EDuration="23.151394314s" totalImagesPullingTime="20.298910957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:11.151168783 +0000 UTC m=+23.821789945" watchObservedRunningTime="2026-07-09 13:25:11.151394314 +0000 UTC m=+23.822015476" Jul 09 13:25:11.166347 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.166297 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-150.ec2.internal" podStartSLOduration=22.166281588 podStartE2EDuration="22.166281588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:11.165663964 +0000 UTC m=+23.836285127" watchObservedRunningTime="2026-07-09 13:25:11.166281588 +0000 UTC m=+23.836902749" Jul 09 13:25:11.181370 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.181321 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gssd4" podStartSLOduration=2.877094477 podStartE2EDuration="23.181304571s" totalImagesPullingTime="20.304210094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:11.181000442 +0000 UTC m=+23.851621603" watchObservedRunningTime="2026-07-09 13:25:11.181304571 +0000 UTC m=+23.851925730" Jul 09 13:25:11.896841 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:11.896762 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:11.897029 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:11.896901 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:12.071402 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:12.071356 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" event={"ID":"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6","Type":"ContainerStarted","Data":"aba55d07a79e2f2306026b59d9ad5b1d04771300294b3e10e1d5e01d60fb1a31"} Jul 09 13:25:12.073269 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:12.073237 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwx7f" event={"ID":"b7102ecc-61d3-4a13-873d-1ac962a99e5c","Type":"ContainerStarted","Data":"6c78518ff155f3cf6bb6a0eaa9b9e69a5911c58c72c4d9925779efd4577cf908"} Jul 09 13:25:12.091414 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:12.091362 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fwx7f" podStartSLOduration=3.795897998 podStartE2EDuration="24.091340067s" totalImagesPullingTime="20.295442069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:12.090675307 +0000 UTC m=+24.761296468" watchObservedRunningTime="2026-07-09 13:25:12.091340067 +0000 UTC m=+24.761961230" Jul 09 13:25:12.107670 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:12.107643 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 13:25:12.241953 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:12.241875 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:25:12.242540 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:12.242524 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:25:12.891807 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:12.891719 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T13:25:12.107662919Z","UUID":"528c0eaa-fead-4dfa-b575-2b2b67e342b1","Handler":null,"Name":"","Endpoint":""} Jul 09 13:25:12.893189 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:12.893172 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 13:25:12.893300 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:12.893219 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 13:25:12.896016 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:12.895998 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:12.896139 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:12.895999 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:12.896139 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:12.896101 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:12.896219 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:12.896176 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:13.078055 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:13.078022 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" event={"ID":"218bdc53-0761-4b9f-8be4-85c3cc52adbc","Type":"ContainerStarted","Data":"828afe11911d55659d6627bc462ff650caf5dbf8183c19f4db892c19c97be4b7"} Jul 09 13:25:13.078571 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:13.078439 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:25:13.078876 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:13.078851 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gssd4" Jul 09 13:25:13.896179 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:13.896149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:13.896415 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:13.896258 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:14.084662 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:14.084625 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" event={"ID":"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6","Type":"ContainerStarted","Data":"383d0ec98d2c60c0c8e42b5d490d67576231fb2d9e14095aafc283f60cf15be6"} Jul 09 13:25:14.086905 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:14.086880 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" event={"ID":"218bdc53-0761-4b9f-8be4-85c3cc52adbc","Type":"ContainerStarted","Data":"713aedcca15621235e816ced9ab42e4d7d006c04bd9b55bb409c0989dc948572"} Jul 09 13:25:14.107397 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:14.107339 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thrbf" podStartSLOduration=3.112600101 podStartE2EDuration="26.107318931s" totalImagesPullingTime="22.99471883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:14.106537935 +0000 UTC m=+26.777159111" watchObservedRunningTime="2026-07-09 13:25:14.107318931 +0000 UTC m=+26.777940092" Jul 09 13:25:14.896922 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:14.896717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:14.897115 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:14.896717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:14.897115 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:14.897026 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:14.897222 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:14.897190 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:15.896218 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:15.896187 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:15.896620 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:15.896333 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:16.095837 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:16.095805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" event={"ID":"1d12d3ec-ec60-4bd0-8e58-b0891582a2b6","Type":"ContainerStarted","Data":"dd5b950892fd652317eddc916eb2604293eb82fd0ab592efcca40caba6125eff"} Jul 09 13:25:16.104881 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:16.104855 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:25:16.104955 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:16.104945 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:25:16.123000 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:16.122971 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:25:16.133901 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:16.133492 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" podStartSLOduration=7.790537497 podStartE2EDuration="28.133473505s" totalImagesPullingTime="20.342936008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:16.132875668 +0000 UTC m=+28.803496855" watchObservedRunningTime="2026-07-09 13:25:16.133473505 +0000 UTC m=+28.804094668" Jul 09 13:25:16.896899 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:16.896703 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:16.897528 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:16.896703 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:16.897528 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:16.896975 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:16.897528 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:16.897042 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:17.099450 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:17.099416 2577 generic.go:356] "Generic (PLEG): container finished" podID="821fc019-e3f5-4a7d-9ec2-04659b2b11df" containerID="b8039431f8a3a03574653bf9c8511cbbc1c75ec331594f12650ec6bbac7a0356" exitCode=0 Jul 09 13:25:17.099646 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:17.099504 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" event={"ID":"821fc019-e3f5-4a7d-9ec2-04659b2b11df","Type":"ContainerDied","Data":"b8039431f8a3a03574653bf9c8511cbbc1c75ec331594f12650ec6bbac7a0356"} Jul 09 13:25:17.099981 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:17.099952 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:25:17.116506 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:17.116312 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:25:17.897447 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:17.897419 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:17.897904 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:17.897514 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:18.103391 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:18.103360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" event={"ID":"821fc019-e3f5-4a7d-9ec2-04659b2b11df","Type":"ContainerStarted","Data":"5d6582f90bec787736a7c877b83046e7da393ffcd16c6174c3cde3436ecbe6ac"} Jul 09 13:25:18.163142 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:18.163052 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mktm5"] Jul 09 13:25:18.163270 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:18.163193 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:18.163314 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:18.163271 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:18.165936 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:18.165904 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rhhv"] Jul 09 13:25:18.166071 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:18.166020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:18.166159 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:18.166120 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:18.166457 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:18.166437 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q9wtv"] Jul 09 13:25:18.166516 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:18.166505 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:18.166594 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:18.166579 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:19.107909 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:19.107871 2577 generic.go:356] "Generic (PLEG): container finished" podID="821fc019-e3f5-4a7d-9ec2-04659b2b11df" containerID="5d6582f90bec787736a7c877b83046e7da393ffcd16c6174c3cde3436ecbe6ac" exitCode=0 Jul 09 13:25:19.108354 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:19.107960 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" event={"ID":"821fc019-e3f5-4a7d-9ec2-04659b2b11df","Type":"ContainerDied","Data":"5d6582f90bec787736a7c877b83046e7da393ffcd16c6174c3cde3436ecbe6ac"} Jul 09 13:25:19.896142 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:19.896106 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:19.896899 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:19.896106 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:19.896899 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:19.896245 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:19.896899 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:19.896269 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:19.896899 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:19.896106 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:19.896899 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:19.896342 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:21.115893 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:21.115706 2577 generic.go:356] "Generic (PLEG): container finished" podID="821fc019-e3f5-4a7d-9ec2-04659b2b11df" containerID="13663a36230f7c4b699a7a0065e3b3a5a5d9e6258b5e76db46210f53008b04c0" exitCode=0 Jul 09 13:25:21.115893 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:21.115782 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" event={"ID":"821fc019-e3f5-4a7d-9ec2-04659b2b11df","Type":"ContainerDied","Data":"13663a36230f7c4b699a7a0065e3b3a5a5d9e6258b5e76db46210f53008b04c0"} Jul 09 13:25:21.499125 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:21.499021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:21.499125 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:21.499065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:21.499316 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:21.499171 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:25:21.499316 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:21.499173 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:25:21.499316 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:21.499219 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs podName:f445db22-9563-43de-b572-bcbd7d3b604e nodeName:}" failed. No retries permitted until 2026-07-09 13:25:53.49920648 +0000 UTC m=+66.169827620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs") pod "network-metrics-daemon-q9wtv" (UID: "f445db22-9563-43de-b572-bcbd7d3b604e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:25:21.499316 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:21.499252 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret podName:4b3939c7-9b8d-4139-b09c-18df0eab4813 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:53.499240538 +0000 UTC m=+66.169861678 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret") pod "global-pull-secret-syncer-6rhhv" (UID: "4b3939c7-9b8d-4139-b09c-18df0eab4813") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:25:21.600195 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:21.600159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxrd\" (UniqueName: \"kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd\") pod \"network-check-target-mktm5\" (UID: \"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4\") " pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:21.600356 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:21.600323 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:25:21.600356 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:21.600347 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:25:21.600356 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:21.600357 2577 projected.go:196] Error preparing data for projected volume kube-api-access-4wxrd for pod openshift-network-diagnostics/network-check-target-mktm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:25:21.600464 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:21.600411 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd podName:5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:53.600395865 +0000 UTC m=+66.271017005 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4wxrd" (UniqueName: "kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd") pod "network-check-target-mktm5" (UID: "5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:25:21.896553 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:21.896520 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:21.896745 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:21.896520 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:21.896745 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:21.896648 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mktm5" podUID="5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4" Jul 09 13:25:21.896745 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:21.896531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:21.896745 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:21.896735 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rhhv" podUID="4b3939c7-9b8d-4139-b09c-18df0eab4813" Jul 09 13:25:21.896948 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:21.896841 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9wtv" podUID="f445db22-9563-43de-b572-bcbd7d3b604e" Jul 09 13:25:23.150698 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.150614 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-150.ec2.internal" event="NodeReady" Jul 09 13:25:23.151172 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.150754 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 13:25:23.201685 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.201642 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cvvfr"] Jul 09 13:25:23.204099 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.204047 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vgj7q"] Jul 09 13:25:23.204249 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.204175 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cvvfr" Jul 09 13:25:23.206138 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.206119 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.206838 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.206777 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 13:25:23.206838 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.206776 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 13:25:23.206999 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.206776 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jdp26\"" Jul 09 13:25:23.206999 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.206947 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 13:25:23.208126 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.208106 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 13:25:23.209575 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.209531 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8c6wn\"" Jul 09 13:25:23.209690 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.209618 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 13:25:23.217601 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.217577 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cvvfr"] Jul 09 13:25:23.218272 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.218249 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vgj7q"] Jul 09 13:25:23.312729 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.312697 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6rl4\" (UniqueName: \"kubernetes.io/projected/41f9db11-5a3e-498a-b528-99125e01d56a-kube-api-access-j6rl4\") pod \"ingress-canary-cvvfr\" (UID: \"41f9db11-5a3e-498a-b528-99125e01d56a\") " pod="openshift-ingress-canary/ingress-canary-cvvfr" Jul 09 13:25:23.312925 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.312739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41f9db11-5a3e-498a-b528-99125e01d56a-cert\") pod \"ingress-canary-cvvfr\" (UID: \"41f9db11-5a3e-498a-b528-99125e01d56a\") " pod="openshift-ingress-canary/ingress-canary-cvvfr" Jul 09 13:25:23.312925 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.312824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/303c8633-3135-4ae1-a729-f0e986937ae4-config-volume\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.312925 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.312916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z25kz\" (UniqueName: \"kubernetes.io/projected/303c8633-3135-4ae1-a729-f0e986937ae4-kube-api-access-z25kz\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.313069 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.312990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.313069 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.313028 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/303c8633-3135-4ae1-a729-f0e986937ae4-tmp-dir\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.414175 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.414089 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.414175 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.414132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/303c8633-3135-4ae1-a729-f0e986937ae4-tmp-dir\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.414175 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.414159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6rl4\" (UniqueName: \"kubernetes.io/projected/41f9db11-5a3e-498a-b528-99125e01d56a-kube-api-access-j6rl4\") pod \"ingress-canary-cvvfr\" (UID: \"41f9db11-5a3e-498a-b528-99125e01d56a\") " pod="openshift-ingress-canary/ingress-canary-cvvfr" Jul 09 13:25:23.414445 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.414188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41f9db11-5a3e-498a-b528-99125e01d56a-cert\") pod \"ingress-canary-cvvfr\" (UID: \"41f9db11-5a3e-498a-b528-99125e01d56a\") " pod="openshift-ingress-canary/ingress-canary-cvvfr" Jul 09 13:25:23.414445 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.414221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/303c8633-3135-4ae1-a729-f0e986937ae4-config-volume\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.414445 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.414274 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z25kz\" (UniqueName: \"kubernetes.io/projected/303c8633-3135-4ae1-a729-f0e986937ae4-kube-api-access-z25kz\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.414445 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:23.414395 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:23.414640 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:23.414470 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls podName:303c8633-3135-4ae1-a729-f0e986937ae4 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:23.914448962 +0000 UTC m=+36.585070122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls") pod "dns-default-vgj7q" (UID: "303c8633-3135-4ae1-a729-f0e986937ae4") : secret "dns-default-metrics-tls" not found Jul 09 13:25:23.414640 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.414543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/303c8633-3135-4ae1-a729-f0e986937ae4-tmp-dir\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.415001 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.414978 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/303c8633-3135-4ae1-a729-f0e986937ae4-config-volume\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.419056 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.419028 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41f9db11-5a3e-498a-b528-99125e01d56a-cert\") pod \"ingress-canary-cvvfr\" (UID: \"41f9db11-5a3e-498a-b528-99125e01d56a\") " pod="openshift-ingress-canary/ingress-canary-cvvfr" Jul 09 13:25:23.422805 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.422774 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z25kz\" (UniqueName: \"kubernetes.io/projected/303c8633-3135-4ae1-a729-f0e986937ae4-kube-api-access-z25kz\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.422987 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.422969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6rl4\" (UniqueName: \"kubernetes.io/projected/41f9db11-5a3e-498a-b528-99125e01d56a-kube-api-access-j6rl4\") pod \"ingress-canary-cvvfr\" (UID: \"41f9db11-5a3e-498a-b528-99125e01d56a\") " pod="openshift-ingress-canary/ingress-canary-cvvfr" Jul 09 13:25:23.516917 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.516880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cvvfr" Jul 09 13:25:23.670292 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.670213 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cvvfr"] Jul 09 13:25:23.674801 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:25:23.674775 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f9db11_5a3e_498a_b528_99125e01d56a.slice/crio-16a8753065841b43ed691ae0563886ae6e51e45657a0adb3de0ff92a569f7ae4 WatchSource:0}: Error finding container 16a8753065841b43ed691ae0563886ae6e51e45657a0adb3de0ff92a569f7ae4: Status 404 returned error can't find the container with id 16a8753065841b43ed691ae0563886ae6e51e45657a0adb3de0ff92a569f7ae4 Jul 09 13:25:23.897143 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.896902 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:23.897338 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.896903 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:23.897338 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.896979 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:23.900185 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.900166 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 13:25:23.900969 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.900949 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 13:25:23.901093 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.901017 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gn99p\"" Jul 09 13:25:23.901093 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.901024 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:25:23.901093 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.901029 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rpg8s\"" Jul 09 13:25:23.901316 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.901106 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:25:23.918267 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:23.918238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:23.918874 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:23.918853 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:23.918957 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:23.918936 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls podName:303c8633-3135-4ae1-a729-f0e986937ae4 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:24.918915126 +0000 UTC m=+37.589536272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls") pod "dns-default-vgj7q" (UID: "303c8633-3135-4ae1-a729-f0e986937ae4") : secret "dns-default-metrics-tls" not found Jul 09 13:25:24.124453 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:24.124414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cvvfr" event={"ID":"41f9db11-5a3e-498a-b528-99125e01d56a","Type":"ContainerStarted","Data":"16a8753065841b43ed691ae0563886ae6e51e45657a0adb3de0ff92a569f7ae4"} Jul 09 13:25:24.927721 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:24.927676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:24.928631 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:24.927852 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:24.928631 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:24.927940 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls podName:303c8633-3135-4ae1-a729-f0e986937ae4 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:26.927915299 +0000 UTC m=+39.598536439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls") pod "dns-default-vgj7q" (UID: "303c8633-3135-4ae1-a729-f0e986937ae4") : secret "dns-default-metrics-tls" not found Jul 09 13:25:26.941742 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:26.941702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:26.942174 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:26.941870 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:26.942174 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:26.941942 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls podName:303c8633-3135-4ae1-a729-f0e986937ae4 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:30.941923876 +0000 UTC m=+43.612545016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls") pod "dns-default-vgj7q" (UID: "303c8633-3135-4ae1-a729-f0e986937ae4") : secret "dns-default-metrics-tls" not found Jul 09 13:25:28.138322 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:28.138281 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cvvfr" event={"ID":"41f9db11-5a3e-498a-b528-99125e01d56a","Type":"ContainerStarted","Data":"5a557e9b3cdb13ed12ac8770adf80c91232b89a46f64b55b68a338faaa329c37"} Jul 09 13:25:28.141606 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:28.141579 2577 generic.go:356] "Generic (PLEG): container finished" podID="821fc019-e3f5-4a7d-9ec2-04659b2b11df" containerID="fa3522a5db8eb93cc45e55a3f2452dfa667a0a3c13dbe0a0989f0523360eb5cf" exitCode=0 Jul 09 13:25:28.141806 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:28.141637 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" event={"ID":"821fc019-e3f5-4a7d-9ec2-04659b2b11df","Type":"ContainerDied","Data":"fa3522a5db8eb93cc45e55a3f2452dfa667a0a3c13dbe0a0989f0523360eb5cf"} Jul 09 13:25:28.155330 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:28.155288 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cvvfr" podStartSLOduration=1.724996443 podStartE2EDuration="5.155271035s" totalImagesPullingTime="3.430274592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:28.154906669 +0000 UTC m=+40.825527830" watchObservedRunningTime="2026-07-09 13:25:28.155271035 +0000 UTC m=+40.825892196" Jul 09 13:25:29.146871 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:29.146833 2577 generic.go:356] "Generic (PLEG): container finished" podID="821fc019-e3f5-4a7d-9ec2-04659b2b11df" containerID="b412522e381c0776a561a91d02b634fcd4111fa94248e87cad6d4b0f27bb048e" exitCode=0 Jul 09 13:25:29.147373 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:29.146911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" event={"ID":"821fc019-e3f5-4a7d-9ec2-04659b2b11df","Type":"ContainerDied","Data":"b412522e381c0776a561a91d02b634fcd4111fa94248e87cad6d4b0f27bb048e"} Jul 09 13:25:30.152383 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:30.152354 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" event={"ID":"821fc019-e3f5-4a7d-9ec2-04659b2b11df","Type":"ContainerStarted","Data":"825822a5c643bba57115ab57405a4d8690bd21c36d28c875478ffceae4851e83"} Jul 09 13:25:30.189928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:30.189876 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rtbxp" podStartSLOduration=8.973983698 podStartE2EDuration="42.189857818s" totalImagesPullingTime="33.21587412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:30.188335316 +0000 UTC m=+42.858956478" watchObservedRunningTime="2026-07-09 13:25:30.189857818 +0000 UTC m=+42.860478976" Jul 09 13:25:30.976007 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:30.975954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:30.976222 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:30.976146 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:30.976222 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:30.976207 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls podName:303c8633-3135-4ae1-a729-f0e986937ae4 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:38.976189412 +0000 UTC m=+51.646810569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls") pod "dns-default-vgj7q" (UID: "303c8633-3135-4ae1-a729-f0e986937ae4") : secret "dns-default-metrics-tls" not found Jul 09 13:25:31.065528 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.065493 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-g4vlh"] Jul 09 13:25:31.085244 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.085173 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-g4vlh"] Jul 09 13:25:31.085415 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.085320 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.088012 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.087972 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 13:25:31.088012 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.088004 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 13:25:31.088248 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.088091 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 13:25:31.089300 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.089285 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nd572\"" Jul 09 13:25:31.092793 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.092771 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 13:25:31.094717 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.094702 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 13:25:31.174625 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.174589 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ds55z"] Jul 09 13:25:31.178454 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.178420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.178582 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.178458 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-snapshots\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.178582 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.178493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-tmp\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.178582 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.178552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.178689 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.178604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-serving-cert\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.178689 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.178653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttrwf\" (UniqueName: \"kubernetes.io/projected/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-kube-api-access-ttrwf\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.193262 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.193225 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw"] Jul 09 13:25:31.193392 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.193343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ds55z" Jul 09 13:25:31.195830 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.195808 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4p8f6\"" Jul 09 13:25:31.209276 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.209181 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56b6bbf9-gvw22"] Jul 09 13:25:31.209547 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.209191 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" Jul 09 13:25:31.211964 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.211939 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 13:25:31.212156 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.212011 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 13:25:31.212156 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.212059 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v4x8n\"" Jul 09 13:25:31.212156 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.212059 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:25:31.212292 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.212155 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 13:25:31.228966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.228896 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ds55z"] Jul 09 13:25:31.228966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.228928 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw"] Jul 09 13:25:31.228966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.228942 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56b6bbf9-gvw22"] Jul 09 13:25:31.229193 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.229022 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.231654 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.231634 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 13:25:31.231821 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.231735 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 13:25:31.231821 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.231774 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 13:25:31.232089 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.232060 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7vrwn\"" Jul 09 13:25:31.236863 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.236841 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 13:25:31.279374 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.279334 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.279374 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.279370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-serving-cert\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.279598 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.279400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrwf\" (UniqueName: \"kubernetes.io/projected/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-kube-api-access-ttrwf\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.279598 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.279441 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.279779 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.279758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-snapshots\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.279841 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.279809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz8gx\" (UniqueName: \"kubernetes.io/projected/84b479dc-85fd-4beb-ab2e-c4e1a4eeadf2-kube-api-access-nz8gx\") pod \"network-check-source-989f8b8dc-ds55z\" (UID: \"84b479dc-85fd-4beb-ab2e-c4e1a4eeadf2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ds55z" Jul 09 13:25:31.279898 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.279847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-tmp\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.280190 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.280172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.280338 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.280314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-tmp\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.280338 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.280332 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-snapshots\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.280451 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.280437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.283574 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.283551 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-serving-cert\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.287191 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.287169 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrwf\" (UniqueName: \"kubernetes.io/projected/5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1-kube-api-access-ttrwf\") pod \"insights-operator-5c847dcfc4-g4vlh\" (UID: \"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.380434 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-bound-sa-token\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.380434 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-installation-pull-secrets\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.380669 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l84xk\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-kube-api-access-l84xk\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.380669 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88eee4cb-a0b5-48b0-8df3-9e3bd0877983-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4bvpw\" (UID: \"88eee4cb-a0b5-48b0-8df3-9e3bd0877983\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" Jul 09 13:25:31.380669 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-certificates\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.380669 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc646\" (UniqueName: \"kubernetes.io/projected/88eee4cb-a0b5-48b0-8df3-9e3bd0877983-kube-api-access-wc646\") pod \"service-ca-operator-5d46d9ffd4-4bvpw\" (UID: \"88eee4cb-a0b5-48b0-8df3-9e3bd0877983\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" Jul 09 13:25:31.380669 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88eee4cb-a0b5-48b0-8df3-9e3bd0877983-config\") pod \"service-ca-operator-5d46d9ffd4-4bvpw\" (UID: \"88eee4cb-a0b5-48b0-8df3-9e3bd0877983\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" Jul 09 13:25:31.380669 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-ca-trust-extracted\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.380951 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-trusted-ca\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.380951 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-image-registry-private-configuration\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.380951 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz8gx\" (UniqueName: \"kubernetes.io/projected/84b479dc-85fd-4beb-ab2e-c4e1a4eeadf2-kube-api-access-nz8gx\") pod \"network-check-source-989f8b8dc-ds55z\" (UID: \"84b479dc-85fd-4beb-ab2e-c4e1a4eeadf2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ds55z" Jul 09 13:25:31.380951 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.380818 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.388383 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.388353 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz8gx\" (UniqueName: \"kubernetes.io/projected/84b479dc-85fd-4beb-ab2e-c4e1a4eeadf2-kube-api-access-nz8gx\") pod \"network-check-source-989f8b8dc-ds55z\" (UID: \"84b479dc-85fd-4beb-ab2e-c4e1a4eeadf2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ds55z" Jul 09 13:25:31.395167 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.395142 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" Jul 09 13:25:31.481646 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.481573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.481646 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.481605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-bound-sa-token\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.481646 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.481624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-installation-pull-secrets\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.481884 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.481715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l84xk\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-kube-api-access-l84xk\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.481884 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:31.481745 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:31.481884 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:31.481770 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6bbf9-gvw22: secret "image-registry-tls" not found Jul 09 13:25:31.481884 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:31.481838 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls podName:25988f11-eeb5-4c60-b9a1-d45d29e80bfa nodeName:}" failed. No retries permitted until 2026-07-09 13:25:31.9818143 +0000 UTC m=+44.652435448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls") pod "image-registry-56b6bbf9-gvw22" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa") : secret "image-registry-tls" not found Jul 09 13:25:31.481884 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.481863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88eee4cb-a0b5-48b0-8df3-9e3bd0877983-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4bvpw\" (UID: \"88eee4cb-a0b5-48b0-8df3-9e3bd0877983\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" Jul 09 13:25:31.482160 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.481912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-certificates\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.482160 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.481943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc646\" (UniqueName: \"kubernetes.io/projected/88eee4cb-a0b5-48b0-8df3-9e3bd0877983-kube-api-access-wc646\") pod \"service-ca-operator-5d46d9ffd4-4bvpw\" (UID: \"88eee4cb-a0b5-48b0-8df3-9e3bd0877983\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" Jul 09 13:25:31.482160 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.481985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88eee4cb-a0b5-48b0-8df3-9e3bd0877983-config\") pod \"service-ca-operator-5d46d9ffd4-4bvpw\" (UID: \"88eee4cb-a0b5-48b0-8df3-9e3bd0877983\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" Jul 09 13:25:31.482160 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.482034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-ca-trust-extracted\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.482160 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.482108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-trusted-ca\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.482411 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.482176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-image-registry-private-configuration\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.482800 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.482771 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-certificates\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.482976 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.482956 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-ca-trust-extracted\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.483041 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.482976 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88eee4cb-a0b5-48b0-8df3-9e3bd0877983-config\") pod \"service-ca-operator-5d46d9ffd4-4bvpw\" (UID: \"88eee4cb-a0b5-48b0-8df3-9e3bd0877983\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" Jul 09 13:25:31.483483 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.483451 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-trusted-ca\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.484715 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.484689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-installation-pull-secrets\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.484924 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.484904 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88eee4cb-a0b5-48b0-8df3-9e3bd0877983-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4bvpw\" (UID: \"88eee4cb-a0b5-48b0-8df3-9e3bd0877983\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" Jul 09 13:25:31.485165 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.485144 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-image-registry-private-configuration\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.491627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.491598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc646\" (UniqueName: \"kubernetes.io/projected/88eee4cb-a0b5-48b0-8df3-9e3bd0877983-kube-api-access-wc646\") pod \"service-ca-operator-5d46d9ffd4-4bvpw\" (UID: \"88eee4cb-a0b5-48b0-8df3-9e3bd0877983\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" Jul 09 13:25:31.492189 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.492164 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-bound-sa-token\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.492307 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.492269 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l84xk\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-kube-api-access-l84xk\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.503528 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.503494 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ds55z" Jul 09 13:25:31.519410 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.519370 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" Jul 09 13:25:31.557375 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.557341 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-g4vlh"] Jul 09 13:25:31.560699 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:25:31.560666 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f64cc1e_73ca_4def_aa6d_c27dfdedf8e1.slice/crio-2266520eb45469a8deb56af6b5d94ace017e423ce8c71da2ce4bb9c554164bcd WatchSource:0}: Error finding container 2266520eb45469a8deb56af6b5d94ace017e423ce8c71da2ce4bb9c554164bcd: Status 404 returned error can't find the container with id 2266520eb45469a8deb56af6b5d94ace017e423ce8c71da2ce4bb9c554164bcd Jul 09 13:25:31.661139 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.661108 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ds55z"] Jul 09 13:25:31.663983 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:25:31.663953 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b479dc_85fd_4beb_ab2e_c4e1a4eeadf2.slice/crio-11f37555a32198ffde292d41b32eacc1c7810fcaab41130f769d6af10ebcdd13 WatchSource:0}: Error finding container 11f37555a32198ffde292d41b32eacc1c7810fcaab41130f769d6af10ebcdd13: Status 404 returned error can't find the container with id 11f37555a32198ffde292d41b32eacc1c7810fcaab41130f769d6af10ebcdd13 Jul 09 13:25:31.675021 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.674997 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw"] Jul 09 13:25:31.678164 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:25:31.678140 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88eee4cb_a0b5_48b0_8df3_9e3bd0877983.slice/crio-90e65fb11e9f48631d0ff36b22b5b91be28aa90d34551517a44ad2be79915c48 WatchSource:0}: Error finding container 90e65fb11e9f48631d0ff36b22b5b91be28aa90d34551517a44ad2be79915c48: Status 404 returned error can't find the container with id 90e65fb11e9f48631d0ff36b22b5b91be28aa90d34551517a44ad2be79915c48 Jul 09 13:25:31.986034 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:31.985998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:31.986229 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:31.986155 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:31.986229 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:31.986171 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6bbf9-gvw22: secret "image-registry-tls" not found Jul 09 13:25:31.986359 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:31.986235 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls podName:25988f11-eeb5-4c60-b9a1-d45d29e80bfa nodeName:}" failed. No retries permitted until 2026-07-09 13:25:32.986214596 +0000 UTC m=+45.656835748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls") pod "image-registry-56b6bbf9-gvw22" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa") : secret "image-registry-tls" not found Jul 09 13:25:32.158159 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:32.158122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" event={"ID":"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1","Type":"ContainerStarted","Data":"2266520eb45469a8deb56af6b5d94ace017e423ce8c71da2ce4bb9c554164bcd"} Jul 09 13:25:32.159143 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:32.159116 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" event={"ID":"88eee4cb-a0b5-48b0-8df3-9e3bd0877983","Type":"ContainerStarted","Data":"90e65fb11e9f48631d0ff36b22b5b91be28aa90d34551517a44ad2be79915c48"} Jul 09 13:25:32.159968 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:32.159949 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ds55z" event={"ID":"84b479dc-85fd-4beb-ab2e-c4e1a4eeadf2","Type":"ContainerStarted","Data":"11f37555a32198ffde292d41b32eacc1c7810fcaab41130f769d6af10ebcdd13"} Jul 09 13:25:32.995374 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:32.995334 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:32.995842 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:32.995517 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:32.995842 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:32.995543 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6bbf9-gvw22: secret "image-registry-tls" not found Jul 09 13:25:32.995842 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:32.995622 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls podName:25988f11-eeb5-4c60-b9a1-d45d29e80bfa nodeName:}" failed. No retries permitted until 2026-07-09 13:25:34.99559611 +0000 UTC m=+47.666217255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls") pod "image-registry-56b6bbf9-gvw22" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa") : secret "image-registry-tls" not found Jul 09 13:25:35.015028 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:35.014984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:35.015623 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:35.015194 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:35.015623 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:35.015222 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6bbf9-gvw22: secret "image-registry-tls" not found Jul 09 13:25:35.015623 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:35.015303 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls podName:25988f11-eeb5-4c60-b9a1-d45d29e80bfa nodeName:}" failed. No retries permitted until 2026-07-09 13:25:39.015279413 +0000 UTC m=+51.685900557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls") pod "image-registry-56b6bbf9-gvw22" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa") : secret "image-registry-tls" not found Jul 09 13:25:35.460586 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:35.460552 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h"] Jul 09 13:25:35.469445 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:35.469416 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h" Jul 09 13:25:35.472023 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:35.472000 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 13:25:35.472023 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:35.472017 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 13:25:35.472237 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:35.472017 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6vqvd\"" Jul 09 13:25:35.475491 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:35.475468 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h"] Jul 09 13:25:35.620318 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:35.620269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrlph\" (UniqueName: \"kubernetes.io/projected/acd9dc4b-bd23-4d64-8f25-252d5b443483-kube-api-access-xrlph\") pod \"migrator-d57d58cc9-7545h\" (UID: \"acd9dc4b-bd23-4d64-8f25-252d5b443483\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h" Jul 09 13:25:35.721710 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:35.721626 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrlph\" (UniqueName: \"kubernetes.io/projected/acd9dc4b-bd23-4d64-8f25-252d5b443483-kube-api-access-xrlph\") pod \"migrator-d57d58cc9-7545h\" (UID: \"acd9dc4b-bd23-4d64-8f25-252d5b443483\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h" Jul 09 13:25:35.730291 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:35.730264 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrlph\" (UniqueName: \"kubernetes.io/projected/acd9dc4b-bd23-4d64-8f25-252d5b443483-kube-api-access-xrlph\") pod \"migrator-d57d58cc9-7545h\" (UID: \"acd9dc4b-bd23-4d64-8f25-252d5b443483\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h" Jul 09 13:25:35.781229 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:35.781190 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h" Jul 09 13:25:36.345031 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:36.344872 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h"] Jul 09 13:25:36.347242 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:25:36.347217 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd9dc4b_bd23_4d64_8f25_252d5b443483.slice/crio-95ed27c687da7aaba7fa7cbae708a2784c3a9df8266f1619284718eacb763ecc WatchSource:0}: Error finding container 95ed27c687da7aaba7fa7cbae708a2784c3a9df8266f1619284718eacb763ecc: Status 404 returned error can't find the container with id 95ed27c687da7aaba7fa7cbae708a2784c3a9df8266f1619284718eacb763ecc Jul 09 13:25:37.175279 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.175241 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" event={"ID":"88eee4cb-a0b5-48b0-8df3-9e3bd0877983","Type":"ContainerStarted","Data":"f3cd5d4a350840966ac675a5112224302d7a6c34190f07616597f7c562535596"} Jul 09 13:25:37.176666 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.176628 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h" event={"ID":"acd9dc4b-bd23-4d64-8f25-252d5b443483","Type":"ContainerStarted","Data":"95ed27c687da7aaba7fa7cbae708a2784c3a9df8266f1619284718eacb763ecc"} Jul 09 13:25:37.178258 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.178230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ds55z" event={"ID":"84b479dc-85fd-4beb-ab2e-c4e1a4eeadf2","Type":"ContainerStarted","Data":"e6a4cabab510af1d8b6dab43f119b7452225740c3d60cfeb3045d34f94463c35"} Jul 09 13:25:37.179843 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.179818 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" event={"ID":"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1","Type":"ContainerStarted","Data":"143281acdf5c82896f461916f4e194d880dc6ebc819a3af0decfafd6e5c89d5c"} Jul 09 13:25:37.192877 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.192828 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" podStartSLOduration=1.650751971 podStartE2EDuration="6.192810899s" totalImagesPullingTime="4.542058928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:37.19145511 +0000 UTC m=+49.862076270" watchObservedRunningTime="2026-07-09 13:25:37.192810899 +0000 UTC m=+49.863432053" Jul 09 13:25:37.208448 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.208311 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" podStartSLOduration=1.549820928 podStartE2EDuration="6.208291631s" totalImagesPullingTime="4.658470703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:37.207890464 +0000 UTC m=+49.878511622" watchObservedRunningTime="2026-07-09 13:25:37.208291631 +0000 UTC m=+49.878912794" Jul 09 13:25:37.228340 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.228284 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ds55z" podStartSLOduration=1.264092577 podStartE2EDuration="6.228263967s" totalImagesPullingTime="4.96417139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:37.227724091 +0000 UTC m=+49.898345252" watchObservedRunningTime="2026-07-09 13:25:37.228263967 +0000 UTC m=+49.898885133" Jul 09 13:25:37.480351 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.480263 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4s9z2"] Jul 09 13:25:37.495274 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.495235 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4s9z2"] Jul 09 13:25:37.495449 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.495353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.497878 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.497729 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 13:25:37.497878 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.497761 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 13:25:37.498108 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.498073 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fzhd8\"" Jul 09 13:25:37.634829 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.634793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.635019 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.634843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.635019 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.634949 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-data-volume\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.635152 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.635016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-crio-socket\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.635152 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.635063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwcww\" (UniqueName: \"kubernetes.io/projected/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-api-access-cwcww\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.735793 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.735707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-data-volume\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.735793 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.735769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-crio-socket\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.736013 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.735832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwcww\" (UniqueName: \"kubernetes.io/projected/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-api-access-cwcww\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.736013 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.735893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.736013 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.735931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.736212 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:37.736015 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:25:37.736212 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.736125 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-crio-socket\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.736212 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.736133 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-data-volume\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:37.736212 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:37.736145 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm podName:f41f0cf3-3899-41b9-a529-7dd9bdda0bd0 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:38.236128348 +0000 UTC m=+50.906749509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s9z2" (UID: "f41f0cf3-3899-41b9-a529-7dd9bdda0bd0") : configmap "kube-rbac-proxy" not found Jul 09 13:25:37.736212 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:37.736163 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:37.736438 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:37.736237 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls podName:f41f0cf3-3899-41b9-a529-7dd9bdda0bd0 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:38.23622008 +0000 UTC m=+50.906841223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s9z2" (UID: "f41f0cf3-3899-41b9-a529-7dd9bdda0bd0") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:37.744960 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:37.744938 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwcww\" (UniqueName: \"kubernetes.io/projected/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-api-access-cwcww\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:38.239892 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:38.239855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:38.239892 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:38.239898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:38.240161 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:38.239981 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:25:38.240161 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:38.240046 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:38.240161 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:38.240091 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm podName:f41f0cf3-3899-41b9-a529-7dd9bdda0bd0 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:39.240062168 +0000 UTC m=+51.910683308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s9z2" (UID: "f41f0cf3-3899-41b9-a529-7dd9bdda0bd0") : configmap "kube-rbac-proxy" not found Jul 09 13:25:38.240161 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:38.240116 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls podName:f41f0cf3-3899-41b9-a529-7dd9bdda0bd0 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:39.240098035 +0000 UTC m=+51.910719189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s9z2" (UID: "f41f0cf3-3899-41b9-a529-7dd9bdda0bd0") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:39.047189 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:39.047152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:39.047189 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:39.047188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:39.047615 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:39.047293 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:39.047615 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:39.047343 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:39.047615 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:39.047361 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6bbf9-gvw22: secret "image-registry-tls" not found Jul 09 13:25:39.047615 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:39.047339 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls podName:303c8633-3135-4ae1-a729-f0e986937ae4 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:55.0473257 +0000 UTC m=+67.717946840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls") pod "dns-default-vgj7q" (UID: "303c8633-3135-4ae1-a729-f0e986937ae4") : secret "dns-default-metrics-tls" not found Jul 09 13:25:39.047615 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:39.047403 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls podName:25988f11-eeb5-4c60-b9a1-d45d29e80bfa nodeName:}" failed. No retries permitted until 2026-07-09 13:25:47.047392636 +0000 UTC m=+59.718013775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls") pod "image-registry-56b6bbf9-gvw22" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa") : secret "image-registry-tls" not found Jul 09 13:25:39.187861 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:39.187827 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h" event={"ID":"acd9dc4b-bd23-4d64-8f25-252d5b443483","Type":"ContainerStarted","Data":"4aa15da9685e1380bb1940b6c371a86eb9154e4a407ee9c7dcd48d4b38ceebcc"} Jul 09 13:25:39.188123 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:39.187887 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h" event={"ID":"acd9dc4b-bd23-4d64-8f25-252d5b443483","Type":"ContainerStarted","Data":"be91493a183e1758d923e8fa21141a753f4dbed25018089433a0391c602a0381"} Jul 09 13:25:39.205717 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:39.205664 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7545h" podStartSLOduration=2.281429379 podStartE2EDuration="4.205646913s" totalImagesPullingTime="1.924217534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:39.204749599 +0000 UTC m=+51.875370760" watchObservedRunningTime="2026-07-09 13:25:39.205646913 +0000 UTC m=+51.876268073" Jul 09 13:25:39.248751 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:39.248721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:39.248939 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:39.248832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:39.248939 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:39.248873 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:39.248939 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:39.248901 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:25:39.248939 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:39.248936 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls podName:f41f0cf3-3899-41b9-a529-7dd9bdda0bd0 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:41.248920147 +0000 UTC m=+53.919541292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s9z2" (UID: "f41f0cf3-3899-41b9-a529-7dd9bdda0bd0") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:39.249167 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:39.248950 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm podName:f41f0cf3-3899-41b9-a529-7dd9bdda0bd0 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:41.24894371 +0000 UTC m=+53.919564850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s9z2" (UID: "f41f0cf3-3899-41b9-a529-7dd9bdda0bd0") : configmap "kube-rbac-proxy" not found Jul 09 13:25:40.061769 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:40.061735 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2bxw7_bf332382-6a36-4625-9ce5-691f6e74a58d/dns-node-resolver/0.log" Jul 09 13:25:41.265503 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:41.265471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:41.265982 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:41.265513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:41.265982 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:41.265593 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:25:41.265982 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:41.265673 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:41.265982 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:41.265681 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm podName:f41f0cf3-3899-41b9-a529-7dd9bdda0bd0 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:45.265663904 +0000 UTC m=+57.936285057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s9z2" (UID: "f41f0cf3-3899-41b9-a529-7dd9bdda0bd0") : configmap "kube-rbac-proxy" not found Jul 09 13:25:41.265982 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:41.265716 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls podName:f41f0cf3-3899-41b9-a529-7dd9bdda0bd0 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:45.265705988 +0000 UTC m=+57.936327127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s9z2" (UID: "f41f0cf3-3899-41b9-a529-7dd9bdda0bd0") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:41.279416 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:41.279391 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6tvhm_f7967fba-b519-4892-a817-330df52c8d2a/node-ca/0.log" Jul 09 13:25:42.261672 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:42.261643 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cvvfr_41f9db11-5a3e-498a-b528-99125e01d56a/serve-healthcheck-canary/0.log" Jul 09 13:25:42.461698 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:42.461669 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7545h_acd9dc4b-bd23-4d64-8f25-252d5b443483/migrator/0.log" Jul 09 13:25:42.662022 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:42.661998 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7545h_acd9dc4b-bd23-4d64-8f25-252d5b443483/graceful-termination/0.log" Jul 09 13:25:45.299840 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:45.299804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:45.299840 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:45.299852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:45.300362 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:45.299926 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:25:45.300362 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:45.299985 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm podName:f41f0cf3-3899-41b9-a529-7dd9bdda0bd0 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:53.299969638 +0000 UTC m=+65.970590777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s9z2" (UID: "f41f0cf3-3899-41b9-a529-7dd9bdda0bd0") : configmap "kube-rbac-proxy" not found Jul 09 13:25:45.300362 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:45.299998 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:45.300362 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:45.300070 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls podName:f41f0cf3-3899-41b9-a529-7dd9bdda0bd0 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:53.300058234 +0000 UTC m=+65.970679374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s9z2" (UID: "f41f0cf3-3899-41b9-a529-7dd9bdda0bd0") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:47.112724 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:47.112687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:25:47.113152 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:47.112819 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:47.113152 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:47.112832 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56b6bbf9-gvw22: secret "image-registry-tls" not found Jul 09 13:25:47.113152 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:47.112897 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls podName:25988f11-eeb5-4c60-b9a1-d45d29e80bfa nodeName:}" failed. No retries permitted until 2026-07-09 13:26:03.112880354 +0000 UTC m=+75.783501510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls") pod "image-registry-56b6bbf9-gvw22" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa") : secret "image-registry-tls" not found Jul 09 13:25:49.129275 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:49.129234 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sx8bc" Jul 09 13:25:53.360190 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.360155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:53.360671 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.360202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:53.360671 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:53.360378 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:53.360671 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:25:53.360458 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls podName:f41f0cf3-3899-41b9-a529-7dd9bdda0bd0 nodeName:}" failed. No retries permitted until 2026-07-09 13:26:09.360441279 +0000 UTC m=+82.031062419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s9z2" (UID: "f41f0cf3-3899-41b9-a529-7dd9bdda0bd0") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:53.360796 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.360712 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:25:53.561261 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.561211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:53.561261 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.561268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:53.566874 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.566858 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:25:53.567485 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.567469 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:25:53.573848 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.573825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3939c7-9b8d-4139-b09c-18df0eab4813-original-pull-secret\") pod \"global-pull-secret-syncer-6rhhv\" (UID: \"4b3939c7-9b8d-4139-b09c-18df0eab4813\") " pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:53.573960 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.573830 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f445db22-9563-43de-b572-bcbd7d3b604e-metrics-certs\") pod \"network-metrics-daemon-q9wtv\" (UID: \"f445db22-9563-43de-b572-bcbd7d3b604e\") " pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:53.611033 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.610957 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rhhv" Jul 09 13:25:53.626953 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.626928 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gn99p\"" Jul 09 13:25:53.634596 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.634570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9wtv" Jul 09 13:25:53.661953 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.661725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxrd\" (UniqueName: \"kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd\") pod \"network-check-target-mktm5\" (UID: \"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4\") " pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:53.664477 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.664455 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wxrd\" (UniqueName: \"kubernetes.io/projected/5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4-kube-api-access-4wxrd\") pod \"network-check-target-mktm5\" (UID: \"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4\") " pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:53.746213 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.746185 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rhhv"] Jul 09 13:25:53.748970 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:25:53.748944 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3939c7_9b8d_4139_b09c_18df0eab4813.slice/crio-e03b6ebdc2824a7febb1fcb97e179623e62018f690f2cc95c6871e0f5e0690d8 WatchSource:0}: Error finding container e03b6ebdc2824a7febb1fcb97e179623e62018f690f2cc95c6871e0f5e0690d8: Status 404 returned error can't find the container with id e03b6ebdc2824a7febb1fcb97e179623e62018f690f2cc95c6871e0f5e0690d8 Jul 09 13:25:53.762158 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.762136 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q9wtv"] Jul 09 13:25:53.764159 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:25:53.764136 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf445db22_9563_43de_b572_bcbd7d3b604e.slice/crio-74038e3935effabfc95afff5aa292777ef437c61e80bd648b1e9f75565c032c3 WatchSource:0}: Error finding container 74038e3935effabfc95afff5aa292777ef437c61e80bd648b1e9f75565c032c3: Status 404 returned error can't find the container with id 74038e3935effabfc95afff5aa292777ef437c61e80bd648b1e9f75565c032c3 Jul 09 13:25:53.921061 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.920979 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rpg8s\"" Jul 09 13:25:53.928418 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:53.928397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:54.051148 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:54.051012 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mktm5"] Jul 09 13:25:54.053529 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:25:54.053505 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca86e4f_3aa8_43cf_b4db_2d6e8abb4af4.slice/crio-5e2c058d7ca1328d4bfdf6f963608fcb624ae7258ed2d6bbb93f368ab6d2bad8 WatchSource:0}: Error finding container 5e2c058d7ca1328d4bfdf6f963608fcb624ae7258ed2d6bbb93f368ab6d2bad8: Status 404 returned error can't find the container with id 5e2c058d7ca1328d4bfdf6f963608fcb624ae7258ed2d6bbb93f368ab6d2bad8 Jul 09 13:25:54.236687 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:54.236599 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mktm5" event={"ID":"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4","Type":"ContainerStarted","Data":"51e06eb6ba2e7aacb39b71516716b5bcad36724d94834f730f5e899161c5702f"} Jul 09 13:25:54.236687 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:54.236654 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mktm5" event={"ID":"5ca86e4f-3aa8-43cf-b4db-2d6e8abb4af4","Type":"ContainerStarted","Data":"5e2c058d7ca1328d4bfdf6f963608fcb624ae7258ed2d6bbb93f368ab6d2bad8"} Jul 09 13:25:54.236905 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:54.236733 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:25:54.237966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:54.237943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6rhhv" event={"ID":"4b3939c7-9b8d-4139-b09c-18df0eab4813","Type":"ContainerStarted","Data":"e03b6ebdc2824a7febb1fcb97e179623e62018f690f2cc95c6871e0f5e0690d8"} Jul 09 13:25:54.239190 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:54.239169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9wtv" event={"ID":"f445db22-9563-43de-b572-bcbd7d3b604e","Type":"ContainerStarted","Data":"74038e3935effabfc95afff5aa292777ef437c61e80bd648b1e9f75565c032c3"} Jul 09 13:25:54.259361 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:54.259308 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mktm5" podStartSLOduration=66.259288502 podStartE2EDuration="1m6.259288502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:54.258029355 +0000 UTC m=+66.928650519" watchObservedRunningTime="2026-07-09 13:25:54.259288502 +0000 UTC m=+66.929909665" Jul 09 13:25:55.075149 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:55.075104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:55.078289 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:55.078257 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/303c8633-3135-4ae1-a729-f0e986937ae4-metrics-tls\") pod \"dns-default-vgj7q\" (UID: \"303c8633-3135-4ae1-a729-f0e986937ae4\") " pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:55.245180 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:55.245142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9wtv" event={"ID":"f445db22-9563-43de-b572-bcbd7d3b604e","Type":"ContainerStarted","Data":"591203ec0cb5f1df3b1bd2c8f57609235dc272025e2f9e501ee654fb949f53a0"} Jul 09 13:25:55.327029 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:55.326970 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8c6wn\"" Jul 09 13:25:55.334741 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:55.334708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:55.472914 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:55.472880 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vgj7q"] Jul 09 13:25:55.475585 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:25:55.475551 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303c8633_3135_4ae1_a729_f0e986937ae4.slice/crio-1c4a59165759f5977623850aeecc0345011a82d3b8bc446038bb199cb0baba48 WatchSource:0}: Error finding container 1c4a59165759f5977623850aeecc0345011a82d3b8bc446038bb199cb0baba48: Status 404 returned error can't find the container with id 1c4a59165759f5977623850aeecc0345011a82d3b8bc446038bb199cb0baba48 Jul 09 13:25:56.253782 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:56.253387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgj7q" event={"ID":"303c8633-3135-4ae1-a729-f0e986937ae4","Type":"ContainerStarted","Data":"1c4a59165759f5977623850aeecc0345011a82d3b8bc446038bb199cb0baba48"} Jul 09 13:25:56.257371 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:56.257293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9wtv" event={"ID":"f445db22-9563-43de-b572-bcbd7d3b604e","Type":"ContainerStarted","Data":"90248ac055bbd60a71964927ca37aab62aa5cc4963e0b1c4cee6f55a795c2c38"} Jul 09 13:25:56.274922 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:56.274857 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q9wtv" podStartSLOduration=66.908844978 podStartE2EDuration="1m8.274836317s" totalImagesPullingTime="1.365991339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:56.273600339 +0000 UTC m=+68.944221501" watchObservedRunningTime="2026-07-09 13:25:56.274836317 +0000 UTC m=+68.945457479" Jul 09 13:25:59.271693 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:59.271657 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgj7q" event={"ID":"303c8633-3135-4ae1-a729-f0e986937ae4","Type":"ContainerStarted","Data":"e6cd6ea4994e5aebb9e977d5133994f1d823175ebbc56e9416e73b8453929262"} Jul 09 13:25:59.272185 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:59.271719 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgj7q" event={"ID":"303c8633-3135-4ae1-a729-f0e986937ae4","Type":"ContainerStarted","Data":"2f2cf2b3e633b825fa037bf53b589df1b542a6f0ce6fbb433500e37383e69358"} Jul 09 13:25:59.272185 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:59.271748 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vgj7q" Jul 09 13:25:59.273189 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:59.273158 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6rhhv" event={"ID":"4b3939c7-9b8d-4139-b09c-18df0eab4813","Type":"ContainerStarted","Data":"adc905d438388421ce6c48c2b5ef5609c1d85d4656bd209ad7e45a6233ebdd7e"} Jul 09 13:25:59.291549 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:59.291499 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vgj7q" podStartSLOduration=33.129246883 podStartE2EDuration="36.291480246s" totalImagesPullingTime="3.162233363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:59.290175002 +0000 UTC m=+71.960796164" watchObservedRunningTime="2026-07-09 13:25:59.291480246 +0000 UTC m=+71.962101408" Jul 09 13:25:59.309937 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:25:59.309887 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6rhhv" podStartSLOduration=66.414480545 podStartE2EDuration="1m11.309870118s" totalImagesPullingTime="4.895389573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:59.309566852 +0000 UTC m=+71.980188009" watchObservedRunningTime="2026-07-09 13:25:59.309870118 +0000 UTC m=+71.980491278" Jul 09 13:26:02.858213 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.858176 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q"] Jul 09 13:26:02.860330 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.860312 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q" Jul 09 13:26:02.863637 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.863605 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 13:26:02.863967 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.863950 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 13:26:02.864855 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.864841 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 13:26:02.864945 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.864897 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 13:26:02.865173 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.865157 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4nj5t\"" Jul 09 13:26:02.874890 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.874860 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q"] Jul 09 13:26:02.889221 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.889174 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56b6bbf9-gvw22"] Jul 09 13:26:02.889502 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:26:02.889476 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" podUID="25988f11-eeb5-4c60-b9a1-d45d29e80bfa" Jul 09 13:26:02.935533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.935501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6190fc70-8672-4829-a861-3ae6d1a7a9c4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-847498d4f6-wlq6q\" (UID: \"6190fc70-8672-4829-a861-3ae6d1a7a9c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q" Jul 09 13:26:02.935700 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.935544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s4lr\" (UniqueName: \"kubernetes.io/projected/6190fc70-8672-4829-a861-3ae6d1a7a9c4-kube-api-access-2s4lr\") pod \"managed-serviceaccount-addon-agent-847498d4f6-wlq6q\" (UID: \"6190fc70-8672-4829-a861-3ae6d1a7a9c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q" Jul 09 13:26:02.958128 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.958096 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-xrc6r"] Jul 09 13:26:02.959998 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.959983 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-xrc6r" Jul 09 13:26:02.962530 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.962511 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jldvv\"" Jul 09 13:26:02.962740 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.962727 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 13:26:02.963051 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.963037 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 13:26:02.973802 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:02.973771 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-xrc6r"] Jul 09 13:26:03.036726 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.036695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qlvz\" (UniqueName: \"kubernetes.io/projected/b3fcc641-47af-4790-94f1-a1610299ba1d-kube-api-access-6qlvz\") pod \"downloads-685bfb5f64-xrc6r\" (UID: \"b3fcc641-47af-4790-94f1-a1610299ba1d\") " pod="openshift-console/downloads-685bfb5f64-xrc6r" Jul 09 13:26:03.036888 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.036766 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6190fc70-8672-4829-a861-3ae6d1a7a9c4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-847498d4f6-wlq6q\" (UID: \"6190fc70-8672-4829-a861-3ae6d1a7a9c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q" Jul 09 13:26:03.036888 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.036815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s4lr\" (UniqueName: \"kubernetes.io/projected/6190fc70-8672-4829-a861-3ae6d1a7a9c4-kube-api-access-2s4lr\") pod \"managed-serviceaccount-addon-agent-847498d4f6-wlq6q\" (UID: \"6190fc70-8672-4829-a861-3ae6d1a7a9c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q" Jul 09 13:26:03.039253 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.039222 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6190fc70-8672-4829-a861-3ae6d1a7a9c4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-847498d4f6-wlq6q\" (UID: \"6190fc70-8672-4829-a861-3ae6d1a7a9c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q" Jul 09 13:26:03.047338 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.047314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s4lr\" (UniqueName: \"kubernetes.io/projected/6190fc70-8672-4829-a861-3ae6d1a7a9c4-kube-api-access-2s4lr\") pod \"managed-serviceaccount-addon-agent-847498d4f6-wlq6q\" (UID: \"6190fc70-8672-4829-a861-3ae6d1a7a9c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q" Jul 09 13:26:03.137729 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.137638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:26:03.137869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.137729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qlvz\" (UniqueName: \"kubernetes.io/projected/b3fcc641-47af-4790-94f1-a1610299ba1d-kube-api-access-6qlvz\") pod \"downloads-685bfb5f64-xrc6r\" (UID: \"b3fcc641-47af-4790-94f1-a1610299ba1d\") " pod="openshift-console/downloads-685bfb5f64-xrc6r" Jul 09 13:26:03.139993 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.139961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls\") pod \"image-registry-56b6bbf9-gvw22\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:26:03.149468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.149435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qlvz\" (UniqueName: \"kubernetes.io/projected/b3fcc641-47af-4790-94f1-a1610299ba1d-kube-api-access-6qlvz\") pod \"downloads-685bfb5f64-xrc6r\" (UID: \"b3fcc641-47af-4790-94f1-a1610299ba1d\") " pod="openshift-console/downloads-685bfb5f64-xrc6r" Jul 09 13:26:03.182607 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.182568 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q" Jul 09 13:26:03.269429 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.269399 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-xrc6r" Jul 09 13:26:03.293295 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.293257 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:26:03.299930 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.299907 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:26:03.317769 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.317737 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q"] Jul 09 13:26:03.321776 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:03.321702 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6190fc70_8672_4829_a861_3ae6d1a7a9c4.slice/crio-9abae2d0302d47dd90a13acd8d7e019d1158479e620e8693f99485eda8e69d12 WatchSource:0}: Error finding container 9abae2d0302d47dd90a13acd8d7e019d1158479e620e8693f99485eda8e69d12: Status 404 returned error can't find the container with id 9abae2d0302d47dd90a13acd8d7e019d1158479e620e8693f99485eda8e69d12 Jul 09 13:26:03.434070 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.433996 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-xrc6r"] Jul 09 13:26:03.437646 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:03.437619 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3fcc641_47af_4790_94f1_a1610299ba1d.slice/crio-bebbd7fdc6db72f175dd70f8c2319d4916c74f626bf948c0dc7e51fc095cd316 WatchSource:0}: Error finding container bebbd7fdc6db72f175dd70f8c2319d4916c74f626bf948c0dc7e51fc095cd316: Status 404 returned error can't find the container with id bebbd7fdc6db72f175dd70f8c2319d4916c74f626bf948c0dc7e51fc095cd316 Jul 09 13:26:03.442019 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.442001 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-image-registry-private-configuration\") pod \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " Jul 09 13:26:03.442094 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.442045 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-installation-pull-secrets\") pod \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " Jul 09 13:26:03.442094 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.442075 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls\") pod \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " Jul 09 13:26:03.442219 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.442201 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-bound-sa-token\") pod \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " Jul 09 13:26:03.442271 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.442242 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l84xk\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-kube-api-access-l84xk\") pod \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " Jul 09 13:26:03.442321 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.442273 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-trusted-ca\") pod \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " Jul 09 13:26:03.442321 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.442302 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-certificates\") pod \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " Jul 09 13:26:03.442427 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.442330 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-ca-trust-extracted\") pod \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\" (UID: \"25988f11-eeb5-4c60-b9a1-d45d29e80bfa\") " Jul 09 13:26:03.442747 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.442639 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "25988f11-eeb5-4c60-b9a1-d45d29e80bfa" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:26:03.442872 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.442743 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "25988f11-eeb5-4c60-b9a1-d45d29e80bfa" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:26:03.442872 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.442772 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "25988f11-eeb5-4c60-b9a1-d45d29e80bfa" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:26:03.444868 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.444832 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "25988f11-eeb5-4c60-b9a1-d45d29e80bfa" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:26:03.444868 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.444851 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "25988f11-eeb5-4c60-b9a1-d45d29e80bfa" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:26:03.444868 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.444859 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "25988f11-eeb5-4c60-b9a1-d45d29e80bfa" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:26:03.445052 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.444887 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "25988f11-eeb5-4c60-b9a1-d45d29e80bfa" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:26:03.445052 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.444958 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-kube-api-access-l84xk" (OuterVolumeSpecName: "kube-api-access-l84xk") pod "25988f11-eeb5-4c60-b9a1-d45d29e80bfa" (UID: "25988f11-eeb5-4c60-b9a1-d45d29e80bfa"). InnerVolumeSpecName "kube-api-access-l84xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:26:03.543331 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.543292 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-trusted-ca\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:03.543331 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.543322 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-certificates\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:03.543331 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.543331 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-ca-trust-extracted\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:03.543331 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.543340 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-image-registry-private-configuration\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:03.543576 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.543350 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-installation-pull-secrets\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:03.543576 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.543360 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-registry-tls\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:03.543576 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.543368 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-bound-sa-token\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:03.543576 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:03.543375 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l84xk\" (UniqueName: \"kubernetes.io/projected/25988f11-eeb5-4c60-b9a1-d45d29e80bfa-kube-api-access-l84xk\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:04.302176 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:04.302068 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-xrc6r" event={"ID":"b3fcc641-47af-4790-94f1-a1610299ba1d","Type":"ContainerStarted","Data":"bebbd7fdc6db72f175dd70f8c2319d4916c74f626bf948c0dc7e51fc095cd316"} Jul 09 13:26:04.303621 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:04.303597 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b6bbf9-gvw22" Jul 09 13:26:04.304398 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:04.304360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q" event={"ID":"6190fc70-8672-4829-a861-3ae6d1a7a9c4","Type":"ContainerStarted","Data":"9abae2d0302d47dd90a13acd8d7e019d1158479e620e8693f99485eda8e69d12"} Jul 09 13:26:04.343633 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:04.343574 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56b6bbf9-gvw22"] Jul 09 13:26:04.355018 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:04.350338 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56b6bbf9-gvw22"] Jul 09 13:26:05.902118 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:05.901909 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25988f11-eeb5-4c60-b9a1-d45d29e80bfa" path="/var/lib/kubelet/pods/25988f11-eeb5-4c60-b9a1-d45d29e80bfa/volumes" Jul 09 13:26:06.313337 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.313261 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q" event={"ID":"6190fc70-8672-4829-a861-3ae6d1a7a9c4","Type":"ContainerStarted","Data":"6c5eb3b73022af17190509a1694cbdc3ff14bd58af0a7ca056d10173dad1dc2a"} Jul 09 13:26:06.329933 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.329870 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-847498d4f6-wlq6q" podStartSLOduration=1.5126051600000001 podStartE2EDuration="4.329849873s" totalImagesPullingTime="2.817244713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:06.329477785 +0000 UTC m=+79.000098946" watchObservedRunningTime="2026-07-09 13:26:06.329849873 +0000 UTC m=+79.000471037" Jul 09 13:26:06.666700 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.666665 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d5f4c56f9-kdkqd"] Jul 09 13:26:06.668901 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.668880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.671557 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.671529 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 13:26:06.671557 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.671529 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 13:26:06.672541 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.672419 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z5ft7\"" Jul 09 13:26:06.672541 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.672430 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 13:26:06.672541 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.672448 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 13:26:06.672541 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.672434 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 13:26:06.681831 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.681805 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5f4c56f9-kdkqd"] Jul 09 13:26:06.773105 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.773046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-serving-cert\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.773267 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.773155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-oauth-serving-cert\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.773267 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.773192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-service-ca\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.773267 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.773224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gbc9\" (UniqueName: \"kubernetes.io/projected/590a0262-d491-435d-a8d5-d1eb3a12b614-kube-api-access-8gbc9\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.773415 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.773283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-oauth-config\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.773415 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.773320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-console-config\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.874536 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.874497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gbc9\" (UniqueName: \"kubernetes.io/projected/590a0262-d491-435d-a8d5-d1eb3a12b614-kube-api-access-8gbc9\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.874732 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.874567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-oauth-config\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.874732 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.874594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-console-config\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.874732 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.874663 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-serving-cert\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.874732 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.874692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-oauth-serving-cert\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.874732 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.874719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-service-ca\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.875624 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.875521 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-service-ca\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.875624 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.875543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-console-config\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.875624 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.875583 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-oauth-serving-cert\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.877556 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.877535 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-oauth-config\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.877678 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.877556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-serving-cert\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.883052 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.883032 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gbc9\" (UniqueName: \"kubernetes.io/projected/590a0262-d491-435d-a8d5-d1eb3a12b614-kube-api-access-8gbc9\") pod \"console-5d5f4c56f9-kdkqd\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:06.978921 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:06.978840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:07.131695 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:07.131658 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5f4c56f9-kdkqd"] Jul 09 13:26:07.135356 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:07.135324 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod590a0262_d491_435d_a8d5_d1eb3a12b614.slice/crio-132f59bd2937bb556ef24e55c63f18b1c4cf92905d7bb1ff555342e049488262 WatchSource:0}: Error finding container 132f59bd2937bb556ef24e55c63f18b1c4cf92905d7bb1ff555342e049488262: Status 404 returned error can't find the container with id 132f59bd2937bb556ef24e55c63f18b1c4cf92905d7bb1ff555342e049488262 Jul 09 13:26:07.318399 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:07.318357 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5f4c56f9-kdkqd" event={"ID":"590a0262-d491-435d-a8d5-d1eb3a12b614","Type":"ContainerStarted","Data":"132f59bd2937bb556ef24e55c63f18b1c4cf92905d7bb1ff555342e049488262"} Jul 09 13:26:07.689431 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:07.689350 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm"] Jul 09 13:26:07.691767 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:07.691747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm" Jul 09 13:26:07.694375 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:07.694351 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jmcxl\"" Jul 09 13:26:07.694501 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:07.694351 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 13:26:07.701540 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:07.701512 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm"] Jul 09 13:26:07.781821 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:07.781787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed3f5122-c6c7-4806-be8b-05386fb41602-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dzjtm\" (UID: \"ed3f5122-c6c7-4806-be8b-05386fb41602\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm" Jul 09 13:26:07.882761 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:07.882728 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed3f5122-c6c7-4806-be8b-05386fb41602-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dzjtm\" (UID: \"ed3f5122-c6c7-4806-be8b-05386fb41602\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm" Jul 09 13:26:07.885701 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:07.885633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed3f5122-c6c7-4806-be8b-05386fb41602-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dzjtm\" (UID: \"ed3f5122-c6c7-4806-be8b-05386fb41602\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm" Jul 09 13:26:08.002102 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:08.002004 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm" Jul 09 13:26:08.155113 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:08.155067 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm"] Jul 09 13:26:08.159293 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:08.159262 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3f5122_c6c7_4806_be8b_05386fb41602.slice/crio-46282bb8dac8067c047d7cd62a678253fe1e007149c72393e88b24d565a7fadd WatchSource:0}: Error finding container 46282bb8dac8067c047d7cd62a678253fe1e007149c72393e88b24d565a7fadd: Status 404 returned error can't find the container with id 46282bb8dac8067c047d7cd62a678253fe1e007149c72393e88b24d565a7fadd Jul 09 13:26:08.324148 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:08.324061 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm" event={"ID":"ed3f5122-c6c7-4806-be8b-05386fb41602","Type":"ContainerStarted","Data":"46282bb8dac8067c047d7cd62a678253fe1e007149c72393e88b24d565a7fadd"} Jul 09 13:26:09.282212 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:09.281765 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vgj7q" Jul 09 13:26:09.395704 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:09.395667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:26:09.400097 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:09.400053 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f41f0cf3-3899-41b9-a529-7dd9bdda0bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s9z2\" (UID: \"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0\") " pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:26:09.609839 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:09.609799 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fzhd8\"" Jul 09 13:26:09.617995 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:09.617966 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4s9z2" Jul 09 13:26:10.337826 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.337748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm" event={"ID":"ed3f5122-c6c7-4806-be8b-05386fb41602","Type":"ContainerStarted","Data":"ca0a52c98184f5eb62ff73ef9d44f8910b373d9a1d843d3808e43308ea5e65b0"} Jul 09 13:26:10.338339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.337985 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm" Jul 09 13:26:10.343836 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.343808 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm" Jul 09 13:26:10.372196 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.372067 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dzjtm" podStartSLOduration=2.040597245 podStartE2EDuration="3.372021813s" totalImagesPullingTime="1.331424568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:10.356445404 +0000 UTC m=+83.027066569" watchObservedRunningTime="2026-07-09 13:26:10.372021813 +0000 UTC m=+83.042642975" Jul 09 13:26:10.764235 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.764160 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b"] Jul 09 13:26:10.834131 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.834102 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b"] Jul 09 13:26:10.834291 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.834206 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:10.837327 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.837279 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 13:26:10.837450 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.837388 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 13:26:10.837585 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.837520 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 13:26:10.838354 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.838330 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2h6z6\"" Jul 09 13:26:10.838471 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.838449 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 13:26:10.838571 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.838463 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 13:26:10.906961 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.906927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83821609-14cc-400c-aed7-c8aca8ab8a72-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:10.907146 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.906973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83821609-14cc-400c-aed7-c8aca8ab8a72-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:10.907146 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.907057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83821609-14cc-400c-aed7-c8aca8ab8a72-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:10.907146 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:10.907122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnfg2\" (UniqueName: \"kubernetes.io/projected/83821609-14cc-400c-aed7-c8aca8ab8a72-kube-api-access-wnfg2\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:11.007580 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.007547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83821609-14cc-400c-aed7-c8aca8ab8a72-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:11.007721 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.007587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnfg2\" (UniqueName: \"kubernetes.io/projected/83821609-14cc-400c-aed7-c8aca8ab8a72-kube-api-access-wnfg2\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:11.007721 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.007647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83821609-14cc-400c-aed7-c8aca8ab8a72-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:11.007721 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.007683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83821609-14cc-400c-aed7-c8aca8ab8a72-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:11.007885 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:26:11.007782 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 09 13:26:11.007885 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:26:11.007849 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83821609-14cc-400c-aed7-c8aca8ab8a72-prometheus-operator-tls podName:83821609-14cc-400c-aed7-c8aca8ab8a72 nodeName:}" failed. No retries permitted until 2026-07-09 13:26:11.507826503 +0000 UTC m=+84.178447656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/83821609-14cc-400c-aed7-c8aca8ab8a72-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-7cr9b" (UID: "83821609-14cc-400c-aed7-c8aca8ab8a72") : secret "prometheus-operator-tls" not found Jul 09 13:26:11.008369 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.008346 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83821609-14cc-400c-aed7-c8aca8ab8a72-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:11.009963 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.009941 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83821609-14cc-400c-aed7-c8aca8ab8a72-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:11.012418 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.012393 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4s9z2"] Jul 09 13:26:11.018342 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.018324 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnfg2\" (UniqueName: \"kubernetes.io/projected/83821609-14cc-400c-aed7-c8aca8ab8a72-kube-api-access-wnfg2\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:11.018950 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:11.018927 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41f0cf3_3899_41b9_a529_7dd9bdda0bd0.slice/crio-6a5ae83552a5a29fe32d43e16f53b4bc97d0323b48b808683262ede53dfd1ffa WatchSource:0}: Error finding container 6a5ae83552a5a29fe32d43e16f53b4bc97d0323b48b808683262ede53dfd1ffa: Status 404 returned error can't find the container with id 6a5ae83552a5a29fe32d43e16f53b4bc97d0323b48b808683262ede53dfd1ffa Jul 09 13:26:11.344544 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.344517 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s9z2" event={"ID":"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0","Type":"ContainerStarted","Data":"6a5ae83552a5a29fe32d43e16f53b4bc97d0323b48b808683262ede53dfd1ffa"} Jul 09 13:26:11.513120 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.513059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83821609-14cc-400c-aed7-c8aca8ab8a72-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:11.515761 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.515732 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83821609-14cc-400c-aed7-c8aca8ab8a72-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7cr9b\" (UID: \"83821609-14cc-400c-aed7-c8aca8ab8a72\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:11.746492 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.746455 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" Jul 09 13:26:11.924345 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:11.923654 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b"] Jul 09 13:26:12.351185 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:12.351143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5f4c56f9-kdkqd" event={"ID":"590a0262-d491-435d-a8d5-d1eb3a12b614","Type":"ContainerStarted","Data":"55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba"} Jul 09 13:26:12.353130 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:12.353099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" event={"ID":"83821609-14cc-400c-aed7-c8aca8ab8a72","Type":"ContainerStarted","Data":"24ea602eb1b4b727494552e89fdbe7d735274c0ce07aae6b4f0896db5cf60b0f"} Jul 09 13:26:12.373744 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:12.373687 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d5f4c56f9-kdkqd" podStartSLOduration=2.284621172 podStartE2EDuration="6.373668374s" totalImagesPullingTime="4.089047202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:12.37343217 +0000 UTC m=+85.044053335" watchObservedRunningTime="2026-07-09 13:26:12.373668374 +0000 UTC m=+85.044289534" Jul 09 13:26:14.249541 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.249452 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9dd46b564-rdd2d"] Jul 09 13:26:14.251771 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.251747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.260712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.260630 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 13:26:14.265898 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.265846 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9dd46b564-rdd2d"] Jul 09 13:26:14.338761 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.338656 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-oauth-config\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.338761 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.338698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-service-ca\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.338761 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.338734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk9hg\" (UniqueName: \"kubernetes.io/projected/89ce0212-81b5-434e-a25b-a2cc280bff8f-kube-api-access-dk9hg\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.338761 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.338768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-serving-cert\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.339129 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.338798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-config\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.339129 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.338841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-oauth-serving-cert\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.339129 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.338898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-trusted-ca-bundle\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.439758 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.439715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-trusted-ca-bundle\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.439966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.439794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-oauth-config\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.439966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.439815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-service-ca\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.439966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.439846 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk9hg\" (UniqueName: \"kubernetes.io/projected/89ce0212-81b5-434e-a25b-a2cc280bff8f-kube-api-access-dk9hg\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.439966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.439866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-serving-cert\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.439966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.439893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-config\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.439966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.439914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-oauth-serving-cert\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.440761 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.440726 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-oauth-serving-cert\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.440761 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.440743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-trusted-ca-bundle\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.440933 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.440765 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-config\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.441113 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.441072 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-service-ca\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.442935 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.442904 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-oauth-config\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.443233 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.443212 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-serving-cert\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.449481 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.449432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk9hg\" (UniqueName: \"kubernetes.io/projected/89ce0212-81b5-434e-a25b-a2cc280bff8f-kube-api-access-dk9hg\") pod \"console-9dd46b564-rdd2d\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:14.564322 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:14.564201 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:16.979901 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:16.979853 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:16.980428 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:16.979944 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:16.985381 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:16.985357 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:17.378240 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:17.378207 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:23.042667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.042569 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9dd46b564-rdd2d"] Jul 09 13:26:23.045735 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:23.045683 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ce0212_81b5_434e_a25b_a2cc280bff8f.slice/crio-108d2a60983b5365a5f9d7adb27454a346743501765cf377091fede038e2873b WatchSource:0}: Error finding container 108d2a60983b5365a5f9d7adb27454a346743501765cf377091fede038e2873b: Status 404 returned error can't find the container with id 108d2a60983b5365a5f9d7adb27454a346743501765cf377091fede038e2873b Jul 09 13:26:23.399477 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.399438 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s9z2" event={"ID":"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0","Type":"ContainerStarted","Data":"a445db3c1e8c17040d5dbb742550cdbe87f8f7590825472e883455d16e06e705"} Jul 09 13:26:23.401808 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.401766 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" event={"ID":"83821609-14cc-400c-aed7-c8aca8ab8a72","Type":"ContainerStarted","Data":"cd7a9202266d255583af733cd4db2394a6d44d956381f29bca64412eb9af0eb1"} Jul 09 13:26:23.401984 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.401856 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" event={"ID":"83821609-14cc-400c-aed7-c8aca8ab8a72","Type":"ContainerStarted","Data":"7952b4230713c5d47f7cc2dcb4776927302cdbce3af6403026b33a2007613545"} Jul 09 13:26:23.403686 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.403638 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9dd46b564-rdd2d" event={"ID":"89ce0212-81b5-434e-a25b-a2cc280bff8f","Type":"ContainerStarted","Data":"787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be"} Jul 09 13:26:23.403833 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.403692 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9dd46b564-rdd2d" event={"ID":"89ce0212-81b5-434e-a25b-a2cc280bff8f","Type":"ContainerStarted","Data":"108d2a60983b5365a5f9d7adb27454a346743501765cf377091fede038e2873b"} Jul 09 13:26:23.405697 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.405669 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-xrc6r" event={"ID":"b3fcc641-47af-4790-94f1-a1610299ba1d","Type":"ContainerStarted","Data":"d1795f0ead38292c73cb4ff77aa1b0d25bfb18076663fa36b61a308cf2c8b917"} Jul 09 13:26:23.405913 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.405888 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-xrc6r" Jul 09 13:26:23.421940 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.421858 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7cr9b" podStartSLOduration=2.467484574 podStartE2EDuration="13.421841287s" totalImagesPullingTime="10.954356713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:23.421161451 +0000 UTC m=+96.091782618" watchObservedRunningTime="2026-07-09 13:26:23.421841287 +0000 UTC m=+96.092462461" Jul 09 13:26:23.422450 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.422427 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-xrc6r" Jul 09 13:26:23.440499 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.440439 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-xrc6r" podStartSLOduration=1.932682186 podStartE2EDuration="21.440415865s" totalImagesPullingTime="19.507733679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:23.439886684 +0000 UTC m=+96.110507850" watchObservedRunningTime="2026-07-09 13:26:23.440415865 +0000 UTC m=+96.111037030" Jul 09 13:26:23.482427 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:23.482361 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9dd46b564-rdd2d" podStartSLOduration=9.482339988 podStartE2EDuration="9.482339988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:23.462033945 +0000 UTC m=+96.132655106" watchObservedRunningTime="2026-07-09 13:26:23.482339988 +0000 UTC m=+96.152961163" Jul 09 13:26:24.412736 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:24.412646 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s9z2" event={"ID":"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0","Type":"ContainerStarted","Data":"320f4086d38864210d5d2f25e58e102b37e7c54b8f6c0ae94c6a21eed0d322a1"} Jul 09 13:26:24.564975 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:24.564932 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:24.565172 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:24.565007 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:24.570786 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:24.570757 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:25.136311 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.136255 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d"] Jul 09 13:26:25.169153 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.168399 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xh44k"] Jul 09 13:26:25.171461 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.170578 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.176910 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.175599 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-64dkr\"" Jul 09 13:26:25.176910 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.175856 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 13:26:25.176910 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.176101 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 13:26:25.202479 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.202443 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d"] Jul 09 13:26:25.202679 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.202615 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.206974 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.206943 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z9zql\"" Jul 09 13:26:25.207164 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.207004 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 13:26:25.207232 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.207218 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 13:26:25.207477 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.207445 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 13:26:25.248017 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.247991 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mktm5" Jul 09 13:26:25.335777 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.335680 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67073693-85bf-49b3-8d5a-6bb2d4289f88-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.335777 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.335744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-tls\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.335777 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.335773 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c35fa013-1973-4125-94e9-a0752ac0ec6b-metrics-client-ca\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.336132 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.335806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c35fa013-1973-4125-94e9-a0752ac0ec6b-sys\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.336132 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.335837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-textfile\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.336132 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.335868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59xl6\" (UniqueName: \"kubernetes.io/projected/67073693-85bf-49b3-8d5a-6bb2d4289f88-kube-api-access-59xl6\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.336132 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.335896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.336132 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.335929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67073693-85bf-49b3-8d5a-6bb2d4289f88-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.336132 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.335985 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c35fa013-1973-4125-94e9-a0752ac0ec6b-root\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.336132 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.336026 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.336132 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.336060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8ggs\" (UniqueName: \"kubernetes.io/projected/c35fa013-1973-4125-94e9-a0752ac0ec6b-kube-api-access-c8ggs\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.336568 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.336358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67073693-85bf-49b3-8d5a-6bb2d4289f88-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.336568 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.336398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-wtmp\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.424272 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.424027 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:26:25.437298 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.437507 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ggs\" (UniqueName: \"kubernetes.io/projected/c35fa013-1973-4125-94e9-a0752ac0ec6b-kube-api-access-c8ggs\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.437507 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67073693-85bf-49b3-8d5a-6bb2d4289f88-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.437507 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-wtmp\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.437507 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67073693-85bf-49b3-8d5a-6bb2d4289f88-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.437507 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-tls\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.437507 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c35fa013-1973-4125-94e9-a0752ac0ec6b-metrics-client-ca\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.437803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c35fa013-1973-4125-94e9-a0752ac0ec6b-sys\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.437803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-textfile\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.437803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59xl6\" (UniqueName: \"kubernetes.io/projected/67073693-85bf-49b3-8d5a-6bb2d4289f88-kube-api-access-59xl6\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.437803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.437803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437650 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67073693-85bf-49b3-8d5a-6bb2d4289f88-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.437803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c35fa013-1973-4125-94e9-a0752ac0ec6b-root\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.437803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.437765 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c35fa013-1973-4125-94e9-a0752ac0ec6b-root\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.438586 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.438559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-textfile\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.439138 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.439117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c35fa013-1973-4125-94e9-a0752ac0ec6b-metrics-client-ca\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.439235 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.439195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c35fa013-1973-4125-94e9-a0752ac0ec6b-sys\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.439381 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.439365 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-wtmp\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.439848 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.439821 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67073693-85bf-49b3-8d5a-6bb2d4289f88-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.440265 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:26:25.440243 2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 13:26:25.440373 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:26:25.440325 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67073693-85bf-49b3-8d5a-6bb2d4289f88-openshift-state-metrics-tls podName:67073693-85bf-49b3-8d5a-6bb2d4289f88 nodeName:}" failed. No retries permitted until 2026-07-09 13:26:25.940291701 +0000 UTC m=+98.610912845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/67073693-85bf-49b3-8d5a-6bb2d4289f88-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-bjn7d" (UID: "67073693-85bf-49b3-8d5a-6bb2d4289f88") : secret "openshift-state-metrics-tls" not found Jul 09 13:26:25.440666 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.440583 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.441164 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.441123 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-tls\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.442245 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.442220 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67073693-85bf-49b3-8d5a-6bb2d4289f88-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.442905 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.442887 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c35fa013-1973-4125-94e9-a0752ac0ec6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.452531 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.452461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8ggs\" (UniqueName: \"kubernetes.io/projected/c35fa013-1973-4125-94e9-a0752ac0ec6b-kube-api-access-c8ggs\") pod \"node-exporter-xh44k\" (UID: \"c35fa013-1973-4125-94e9-a0752ac0ec6b\") " pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.459288 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.459227 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59xl6\" (UniqueName: \"kubernetes.io/projected/67073693-85bf-49b3-8d5a-6bb2d4289f88-kube-api-access-59xl6\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.476778 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.475981 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5f4c56f9-kdkqd"] Jul 09 13:26:25.516344 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.516312 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xh44k" Jul 09 13:26:25.566668 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:25.566622 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35fa013_1973_4125_94e9_a0752ac0ec6b.slice/crio-d96aa13a5a4fee6553c1f35d9870e6282fb78d553d2c6712fac84f4f108f1382 WatchSource:0}: Error finding container d96aa13a5a4fee6553c1f35d9870e6282fb78d553d2c6712fac84f4f108f1382: Status 404 returned error can't find the container with id d96aa13a5a4fee6553c1f35d9870e6282fb78d553d2c6712fac84f4f108f1382 Jul 09 13:26:25.942726 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.942687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67073693-85bf-49b3-8d5a-6bb2d4289f88-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:25.945740 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:25.945702 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67073693-85bf-49b3-8d5a-6bb2d4289f88-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-bjn7d\" (UID: \"67073693-85bf-49b3-8d5a-6bb2d4289f88\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:26.085246 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:26.085209 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" Jul 09 13:26:26.275604 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:26.275570 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d"] Jul 09 13:26:26.431296 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:26.431252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xh44k" event={"ID":"c35fa013-1973-4125-94e9-a0752ac0ec6b","Type":"ContainerStarted","Data":"d96aa13a5a4fee6553c1f35d9870e6282fb78d553d2c6712fac84f4f108f1382"} Jul 09 13:26:27.236900 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.236865 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-784b8978c7-mdct8"] Jul 09 13:26:27.377380 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.377329 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-784b8978c7-mdct8"] Jul 09 13:26:27.377666 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.377612 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.381480 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.380278 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 13:26:27.381480 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.380490 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 13:26:27.381480 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.380755 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 13:26:27.381480 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.381096 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 13:26:27.381480 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.381307 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1ipiva38ld9t6\"" Jul 09 13:26:27.381830 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.381813 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 13:26:27.382030 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.382016 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pk99v\"" Jul 09 13:26:27.558606 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.558564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.559121 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.558620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.559121 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.558798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb659efd-84ba-417a-b5cc-1207b54e963f-metrics-client-ca\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.559121 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.558828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-tls\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.559121 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.558861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.559121 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.558894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.559121 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.558946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-grpc-tls\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.559121 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.558980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7z9x\" (UniqueName: \"kubernetes.io/projected/fb659efd-84ba-417a-b5cc-1207b54e963f-kube-api-access-v7z9x\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.570979 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:27.570943 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67073693_85bf_49b3_8d5a_6bb2d4289f88.slice/crio-cbbf763ab6981a74daf6ad437eecb7d0d4c2fe1ea95e98f751caf625526a6859 WatchSource:0}: Error finding container cbbf763ab6981a74daf6ad437eecb7d0d4c2fe1ea95e98f751caf625526a6859: Status 404 returned error can't find the container with id cbbf763ab6981a74daf6ad437eecb7d0d4c2fe1ea95e98f751caf625526a6859 Jul 09 13:26:27.659803 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.659765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.659992 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.659816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-grpc-tls\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.659992 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.659854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7z9x\" (UniqueName: \"kubernetes.io/projected/fb659efd-84ba-417a-b5cc-1207b54e963f-kube-api-access-v7z9x\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.659992 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.659896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.660211 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.660008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.660211 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.660069 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb659efd-84ba-417a-b5cc-1207b54e963f-metrics-client-ca\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.660211 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.660114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-tls\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.660211 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.660181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.661169 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.661063 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb659efd-84ba-417a-b5cc-1207b54e963f-metrics-client-ca\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.663002 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.662949 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-grpc-tls\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.663224 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.663194 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.663346 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.663251 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.664434 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.664402 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-tls\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.664605 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.664586 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.664775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.664754 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb659efd-84ba-417a-b5cc-1207b54e963f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.669658 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.669634 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7z9x\" (UniqueName: \"kubernetes.io/projected/fb659efd-84ba-417a-b5cc-1207b54e963f-kube-api-access-v7z9x\") pod \"thanos-querier-784b8978c7-mdct8\" (UID: \"fb659efd-84ba-417a-b5cc-1207b54e963f\") " pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.694105 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.694050 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:27.894577 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:27.894543 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-784b8978c7-mdct8"] Jul 09 13:26:27.993153 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:27.993121 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb659efd_84ba_417a_b5cc_1207b54e963f.slice/crio-c6e7c9c3b661e38907691e5fe8e3102a7369b8c9ab6da8504cdf8fffcaa1d1dd WatchSource:0}: Error finding container c6e7c9c3b661e38907691e5fe8e3102a7369b8c9ab6da8504cdf8fffcaa1d1dd: Status 404 returned error can't find the container with id c6e7c9c3b661e38907691e5fe8e3102a7369b8c9ab6da8504cdf8fffcaa1d1dd Jul 09 13:26:28.444509 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:28.444411 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s9z2" event={"ID":"f41f0cf3-3899-41b9-a529-7dd9bdda0bd0","Type":"ContainerStarted","Data":"6ab343955a28fa98588a5ded23fa6a24523d6f0d489e110d8f2abd11dc84ffde"} Jul 09 13:26:28.446379 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:28.446295 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" event={"ID":"fb659efd-84ba-417a-b5cc-1207b54e963f","Type":"ContainerStarted","Data":"c6e7c9c3b661e38907691e5fe8e3102a7369b8c9ab6da8504cdf8fffcaa1d1dd"} Jul 09 13:26:28.449071 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:28.449035 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" event={"ID":"67073693-85bf-49b3-8d5a-6bb2d4289f88","Type":"ContainerStarted","Data":"8f2df4de7222a138346e35e9ea2a6d35be9fb45c8be88603fd2f1c83bef6cdbd"} Jul 09 13:26:28.449206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:28.449127 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" event={"ID":"67073693-85bf-49b3-8d5a-6bb2d4289f88","Type":"ContainerStarted","Data":"35fc811b5083b7d1f924ea15cac0293602e96d3707528c3d4bfcdb4d94ad0663"} Jul 09 13:26:28.449206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:28.449158 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" event={"ID":"67073693-85bf-49b3-8d5a-6bb2d4289f88","Type":"ContainerStarted","Data":"cbbf763ab6981a74daf6ad437eecb7d0d4c2fe1ea95e98f751caf625526a6859"} Jul 09 13:26:28.472710 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:28.472653 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4s9z2" podStartSLOduration=34.668941435 podStartE2EDuration="51.472629266s" totalImagesPullingTime="16.803687831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:25:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:28.471212789 +0000 UTC m=+101.141833952" watchObservedRunningTime="2026-07-09 13:26:28.472629266 +0000 UTC m=+101.143250428" Jul 09 13:26:29.457104 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.456891 2577 generic.go:356] "Generic (PLEG): container finished" podID="c35fa013-1973-4125-94e9-a0752ac0ec6b" containerID="26cde18762f190bc156ce8000935f36b01623477a47502268663640e9f6ba640" exitCode=0 Jul 09 13:26:29.457627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.457157 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xh44k" event={"ID":"c35fa013-1973-4125-94e9-a0752ac0ec6b","Type":"ContainerDied","Data":"26cde18762f190bc156ce8000935f36b01623477a47502268663640e9f6ba640"} Jul 09 13:26:29.942044 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.942005 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7558f4ff9f-jd2ql"] Jul 09 13:26:29.958008 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.957738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:29.961312 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.961277 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7558f4ff9f-jd2ql"] Jul 09 13:26:29.978293 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.978254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-oauth-config\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:29.978471 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.978306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-serving-cert\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:29.978471 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.978408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-trusted-ca-bundle\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:29.978471 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.978436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stp4c\" (UniqueName: \"kubernetes.io/projected/da90aea4-d79b-44f5-852c-cace56d90bac-kube-api-access-stp4c\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:29.978471 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.978461 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-service-ca\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:29.978668 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.978489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-console-config\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:29.978668 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:29.978515 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-oauth-serving-cert\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.079018 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.078941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-serving-cert\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.079205 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.079022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-trusted-ca-bundle\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.079205 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.079051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stp4c\" (UniqueName: \"kubernetes.io/projected/da90aea4-d79b-44f5-852c-cace56d90bac-kube-api-access-stp4c\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.079205 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.079092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-service-ca\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.079205 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.079117 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-console-config\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.079205 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.079142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-oauth-serving-cert\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.079205 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.079200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-oauth-config\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.080546 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.080253 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-service-ca\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.080546 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.080495 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-trusted-ca-bundle\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.080730 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.080549 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-oauth-serving-cert\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.081449 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.081391 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-console-config\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.081941 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.081920 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-oauth-config\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.082456 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.082433 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-serving-cert\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.090285 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.090233 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stp4c\" (UniqueName: \"kubernetes.io/projected/da90aea4-d79b-44f5-852c-cace56d90bac-kube-api-access-stp4c\") pod \"console-7558f4ff9f-jd2ql\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.274913 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.274890 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:30.387246 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.387158 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8fdbdf867-4k675"] Jul 09 13:26:30.420193 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.419199 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8fdbdf867-4k675"] Jul 09 13:26:30.420193 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.419343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.422747 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.422681 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 13:26:30.423152 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.423009 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 13:26:30.423264 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.423226 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 13:26:30.423574 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.423558 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 13:26:30.424471 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.424452 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 13:26:30.425147 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.425125 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f9g4k\"" Jul 09 13:26:30.434809 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.434785 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 13:26:30.465229 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.465161 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xh44k" event={"ID":"c35fa013-1973-4125-94e9-a0752ac0ec6b","Type":"ContainerStarted","Data":"884712ee80772a888c8d395457ee88d5ac6f84dad47b5110d6556e4ecfdb7a94"} Jul 09 13:26:30.465823 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.465794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xh44k" event={"ID":"c35fa013-1973-4125-94e9-a0752ac0ec6b","Type":"ContainerStarted","Data":"2c390c0e3b3b385958572fb5f9e9fc7b91c22624608e36e4751da5b20ab0b508"} Jul 09 13:26:30.484342 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.484300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-federate-client-tls\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.484550 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.484390 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-997ss\" (UniqueName: \"kubernetes.io/projected/1541ce9c-50ea-41e6-a099-7478d8e22b19-kube-api-access-997ss\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.484550 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.484494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-telemeter-client-tls\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.484550 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.484519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.484716 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.484588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1541ce9c-50ea-41e6-a099-7478d8e22b19-metrics-client-ca\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.484716 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.484617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-secret-telemeter-client\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.484716 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.484673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1541ce9c-50ea-41e6-a099-7478d8e22b19-serving-certs-ca-bundle\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.484716 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.484707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1541ce9c-50ea-41e6-a099-7478d8e22b19-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.487483 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.487421 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xh44k" podStartSLOduration=2.026055409 podStartE2EDuration="5.487399549s" totalImagesPullingTime="3.350803277s" totalInitContainerRuntime="110.540863ms" isStatefulPod=true podCreationTimestamp="2026-07-09 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:30.485938651 +0000 UTC m=+103.156559814" watchObservedRunningTime="2026-07-09 13:26:30.487399549 +0000 UTC m=+103.158020732" Jul 09 13:26:30.586262 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.586171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-federate-client-tls\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.586262 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.586249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-997ss\" (UniqueName: \"kubernetes.io/projected/1541ce9c-50ea-41e6-a099-7478d8e22b19-kube-api-access-997ss\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.586582 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.586313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-telemeter-client-tls\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.586582 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.586330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.586582 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.586369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1541ce9c-50ea-41e6-a099-7478d8e22b19-metrics-client-ca\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.586582 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.586396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-secret-telemeter-client\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.586582 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.586422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1541ce9c-50ea-41e6-a099-7478d8e22b19-serving-certs-ca-bundle\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.586582 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.586449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1541ce9c-50ea-41e6-a099-7478d8e22b19-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.590045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.587511 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1541ce9c-50ea-41e6-a099-7478d8e22b19-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.590045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.589159 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1541ce9c-50ea-41e6-a099-7478d8e22b19-serving-certs-ca-bundle\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.590045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.589534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-federate-client-tls\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.590045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.589659 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1541ce9c-50ea-41e6-a099-7478d8e22b19-metrics-client-ca\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.590045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.589955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.592378 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.592334 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-telemeter-client-tls\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.592378 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.592352 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1541ce9c-50ea-41e6-a099-7478d8e22b19-secret-telemeter-client\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.597957 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.597929 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-997ss\" (UniqueName: \"kubernetes.io/projected/1541ce9c-50ea-41e6-a099-7478d8e22b19-kube-api-access-997ss\") pod \"telemeter-client-8fdbdf867-4k675\" (UID: \"1541ce9c-50ea-41e6-a099-7478d8e22b19\") " pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:30.741665 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:30.741579 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" Jul 09 13:26:31.187537 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:31.187507 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8fdbdf867-4k675"] Jul 09 13:26:31.196720 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:31.190749 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1541ce9c_50ea_41e6_a099_7478d8e22b19.slice/crio-d7032e45a09c4d42ba573787076e39a646080e3e6fa9ffbe098b3d84130139e3 WatchSource:0}: Error finding container d7032e45a09c4d42ba573787076e39a646080e3e6fa9ffbe098b3d84130139e3: Status 404 returned error can't find the container with id d7032e45a09c4d42ba573787076e39a646080e3e6fa9ffbe098b3d84130139e3 Jul 09 13:26:31.206972 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:31.206910 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7558f4ff9f-jd2ql"] Jul 09 13:26:31.210108 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:31.210006 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda90aea4_d79b_44f5_852c_cace56d90bac.slice/crio-4e35bc725dac7473bb83ba59b1d801266653dddbb815ce9c3f7c2d0ab3cab7e2 WatchSource:0}: Error finding container 4e35bc725dac7473bb83ba59b1d801266653dddbb815ce9c3f7c2d0ab3cab7e2: Status 404 returned error can't find the container with id 4e35bc725dac7473bb83ba59b1d801266653dddbb815ce9c3f7c2d0ab3cab7e2 Jul 09 13:26:31.474261 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:31.474226 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" event={"ID":"67073693-85bf-49b3-8d5a-6bb2d4289f88","Type":"ContainerStarted","Data":"c2559efe45aa3e8a7389275a262b16c5f495b541a239c2c3ecb73f58267bdad7"} Jul 09 13:26:31.477162 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:31.477128 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" event={"ID":"1541ce9c-50ea-41e6-a099-7478d8e22b19","Type":"ContainerStarted","Data":"d7032e45a09c4d42ba573787076e39a646080e3e6fa9ffbe098b3d84130139e3"} Jul 09 13:26:31.478983 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:31.478959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7558f4ff9f-jd2ql" event={"ID":"da90aea4-d79b-44f5-852c-cace56d90bac","Type":"ContainerStarted","Data":"4e35bc725dac7473bb83ba59b1d801266653dddbb815ce9c3f7c2d0ab3cab7e2"} Jul 09 13:26:31.508363 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:31.508309 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bjn7d" podStartSLOduration=4.229673041 podStartE2EDuration="6.508287749s" totalImagesPullingTime="2.278614708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:31.507706396 +0000 UTC m=+104.178327560" watchObservedRunningTime="2026-07-09 13:26:31.508287749 +0000 UTC m=+104.178908912" Jul 09 13:26:32.486643 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:32.486541 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" event={"ID":"fb659efd-84ba-417a-b5cc-1207b54e963f","Type":"ContainerStarted","Data":"d2fd07235e82e16475a4f5a2dc961fbf1027dd3e5050a086a640660cccc9a138"} Jul 09 13:26:32.487151 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:32.486665 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" event={"ID":"fb659efd-84ba-417a-b5cc-1207b54e963f","Type":"ContainerStarted","Data":"bede9abdbe55a60739753ef784e0625db57d8f9bb8a35e674bb7943119b99105"} Jul 09 13:26:32.487151 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:32.486713 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" event={"ID":"fb659efd-84ba-417a-b5cc-1207b54e963f","Type":"ContainerStarted","Data":"da2550d740fb3be553c0aa677df9475eabf132bdfa065b90371ced766a29f6fe"} Jul 09 13:26:32.488937 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:32.488752 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7558f4ff9f-jd2ql" event={"ID":"da90aea4-d79b-44f5-852c-cace56d90bac","Type":"ContainerStarted","Data":"e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b"} Jul 09 13:26:32.512414 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:32.512353 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7558f4ff9f-jd2ql" podStartSLOduration=3.512332647 podStartE2EDuration="3.512332647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:32.510703183 +0000 UTC m=+105.181324346" watchObservedRunningTime="2026-07-09 13:26:32.512332647 +0000 UTC m=+105.182953811" Jul 09 13:26:34.503134 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:34.503025 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" event={"ID":"fb659efd-84ba-417a-b5cc-1207b54e963f","Type":"ContainerStarted","Data":"dae964dfcbc0b8f2683f59810bc52fbb2938ef5d46eb3b33a463a6c0add81622"} Jul 09 13:26:34.503134 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:34.503125 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" event={"ID":"fb659efd-84ba-417a-b5cc-1207b54e963f","Type":"ContainerStarted","Data":"47d5955cdac220c7dc87e85a41b6d19d6fab0ceca4cd7212aef8e806feb25496"} Jul 09 13:26:34.503670 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:34.503167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" event={"ID":"fb659efd-84ba-417a-b5cc-1207b54e963f","Type":"ContainerStarted","Data":"e166204d212c8dd395f22c8f7300e5355781ee739a695b7685bcc181862b02b5"} Jul 09 13:26:34.503670 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:34.503201 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:34.504608 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:34.504584 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" event={"ID":"1541ce9c-50ea-41e6-a099-7478d8e22b19","Type":"ContainerStarted","Data":"baaedd1afe2c70ccaf82dd7cebe97a75cdc2469af22634364519c086513a4aa2"} Jul 09 13:26:34.530813 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:34.530762 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" podStartSLOduration=2.142860776 podStartE2EDuration="7.530718198s" totalImagesPullingTime="5.387857422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:34.52869591 +0000 UTC m=+107.199317074" watchObservedRunningTime="2026-07-09 13:26:34.530718198 +0000 UTC m=+107.201339359" Jul 09 13:26:36.518684 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:36.518649 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" event={"ID":"1541ce9c-50ea-41e6-a099-7478d8e22b19","Type":"ContainerStarted","Data":"6ff9de2909d3ed93b9d91924b8accddf68ecd6b8ab62a9abfeabee38b40578d7"} Jul 09 13:26:36.519115 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:36.518706 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" event={"ID":"1541ce9c-50ea-41e6-a099-7478d8e22b19","Type":"ContainerStarted","Data":"b242416b20b5a5d430e1a4a84c75f08c3ec093cb5dcbd948fc6f1e91af159625"} Jul 09 13:26:36.547677 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:36.547625 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8fdbdf867-4k675" podStartSLOduration=2.154961067 podStartE2EDuration="6.547604826s" totalImagesPullingTime="4.392643759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:36.546163962 +0000 UTC m=+109.216785115" watchObservedRunningTime="2026-07-09 13:26:36.547604826 +0000 UTC m=+109.218225989" Jul 09 13:26:37.617450 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.616768 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7558f4ff9f-jd2ql"] Jul 09 13:26:37.659854 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.659815 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb9d95f96-w5rlw"] Jul 09 13:26:37.675630 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.675595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.678221 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.678194 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb9d95f96-w5rlw"] Jul 09 13:26:37.753741 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.753706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-oauth-config\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.754013 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.753974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-console-config\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.754151 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.754138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-service-ca\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.754302 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.754289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-trusted-ca-bundle\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.754434 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.754421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8ctq\" (UniqueName: \"kubernetes.io/projected/849355b4-6ba2-4393-a371-d8023782e421-kube-api-access-l8ctq\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.754580 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.754557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-serving-cert\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.754711 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.754596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-oauth-serving-cert\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.856045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.856007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-oauth-config\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.856045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.856045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-console-config\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.856304 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.856070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-service-ca\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.856304 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.856139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-trusted-ca-bundle\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.856304 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.856167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8ctq\" (UniqueName: \"kubernetes.io/projected/849355b4-6ba2-4393-a371-d8023782e421-kube-api-access-l8ctq\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.856304 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.856195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-serving-cert\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.856304 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.856232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-oauth-serving-cert\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.856864 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.856843 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-console-config\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.857134 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.857109 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-trusted-ca-bundle\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.858677 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.858649 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-oauth-config\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.858848 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.858827 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-service-ca\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.858896 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.858855 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-serving-cert\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.858896 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.858827 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-oauth-serving-cert\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.865154 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.865127 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8ctq\" (UniqueName: \"kubernetes.io/projected/849355b4-6ba2-4393-a371-d8023782e421-kube-api-access-l8ctq\") pod \"console-5cb9d95f96-w5rlw\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:37.988873 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:37.988764 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:38.145889 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:38.145865 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb9d95f96-w5rlw"] Jul 09 13:26:38.147627 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:26:38.147599 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849355b4_6ba2_4393_a371_d8023782e421.slice/crio-6ea1486138ec32de9d5345007cd3831a8de84ce9a3bd2fcda347e4701e3eb9c4 WatchSource:0}: Error finding container 6ea1486138ec32de9d5345007cd3831a8de84ce9a3bd2fcda347e4701e3eb9c4: Status 404 returned error can't find the container with id 6ea1486138ec32de9d5345007cd3831a8de84ce9a3bd2fcda347e4701e3eb9c4 Jul 09 13:26:38.529720 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:38.529623 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb9d95f96-w5rlw" event={"ID":"849355b4-6ba2-4393-a371-d8023782e421","Type":"ContainerStarted","Data":"fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276"} Jul 09 13:26:38.529720 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:38.529711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb9d95f96-w5rlw" event={"ID":"849355b4-6ba2-4393-a371-d8023782e421","Type":"ContainerStarted","Data":"6ea1486138ec32de9d5345007cd3831a8de84ce9a3bd2fcda347e4701e3eb9c4"} Jul 09 13:26:38.550828 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:38.550775 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb9d95f96-w5rlw" podStartSLOduration=1.550760468 podStartE2EDuration="1.550760468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:38.549285031 +0000 UTC m=+111.219906207" watchObservedRunningTime="2026-07-09 13:26:38.550760468 +0000 UTC m=+111.221381630" Jul 09 13:26:40.275752 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:40.275711 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:26:40.516209 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:40.516183 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-784b8978c7-mdct8" Jul 09 13:26:47.989013 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:47.988969 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:47.989534 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:47.989048 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:47.993844 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:47.993820 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:48.575224 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:48.575197 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:26:48.658405 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:48.658376 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9dd46b564-rdd2d"] Jul 09 13:26:50.508101 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.508016 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d5f4c56f9-kdkqd" podUID="590a0262-d491-435d-a8d5-d1eb3a12b614" containerName="console" containerID="cri-o://55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba" gracePeriod=15 Jul 09 13:26:50.793400 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.793318 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:50.864008 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.863965 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-oauth-config\") pod \"590a0262-d491-435d-a8d5-d1eb3a12b614\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " Jul 09 13:26:50.864008 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.864011 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-oauth-serving-cert\") pod \"590a0262-d491-435d-a8d5-d1eb3a12b614\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " Jul 09 13:26:50.864247 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.864039 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-service-ca\") pod \"590a0262-d491-435d-a8d5-d1eb3a12b614\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " Jul 09 13:26:50.864247 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.864146 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gbc9\" (UniqueName: \"kubernetes.io/projected/590a0262-d491-435d-a8d5-d1eb3a12b614-kube-api-access-8gbc9\") pod \"590a0262-d491-435d-a8d5-d1eb3a12b614\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " Jul 09 13:26:50.864247 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.864201 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-serving-cert\") pod \"590a0262-d491-435d-a8d5-d1eb3a12b614\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " Jul 09 13:26:50.864247 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.864224 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-console-config\") pod \"590a0262-d491-435d-a8d5-d1eb3a12b614\" (UID: \"590a0262-d491-435d-a8d5-d1eb3a12b614\") " Jul 09 13:26:50.864553 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.864519 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-service-ca" (OuterVolumeSpecName: "service-ca") pod "590a0262-d491-435d-a8d5-d1eb3a12b614" (UID: "590a0262-d491-435d-a8d5-d1eb3a12b614"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:26:50.864677 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.864629 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "590a0262-d491-435d-a8d5-d1eb3a12b614" (UID: "590a0262-d491-435d-a8d5-d1eb3a12b614"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:26:50.864824 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.864796 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-console-config" (OuterVolumeSpecName: "console-config") pod "590a0262-d491-435d-a8d5-d1eb3a12b614" (UID: "590a0262-d491-435d-a8d5-d1eb3a12b614"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:26:50.866460 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.866438 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "590a0262-d491-435d-a8d5-d1eb3a12b614" (UID: "590a0262-d491-435d-a8d5-d1eb3a12b614"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:26:50.866659 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.866642 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "590a0262-d491-435d-a8d5-d1eb3a12b614" (UID: "590a0262-d491-435d-a8d5-d1eb3a12b614"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:26:50.866696 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.866656 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/590a0262-d491-435d-a8d5-d1eb3a12b614-kube-api-access-8gbc9" (OuterVolumeSpecName: "kube-api-access-8gbc9") pod "590a0262-d491-435d-a8d5-d1eb3a12b614" (UID: "590a0262-d491-435d-a8d5-d1eb3a12b614"). InnerVolumeSpecName "kube-api-access-8gbc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:26:50.965874 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.965836 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-oauth-config\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.965874 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.965867 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-oauth-serving-cert\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.965874 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.965878 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-service-ca\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.966181 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.965887 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gbc9\" (UniqueName: \"kubernetes.io/projected/590a0262-d491-435d-a8d5-d1eb3a12b614-kube-api-access-8gbc9\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.966181 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.965896 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/590a0262-d491-435d-a8d5-d1eb3a12b614-console-serving-cert\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.966181 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:50.965905 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/590a0262-d491-435d-a8d5-d1eb3a12b614-console-config\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:26:51.584574 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:51.584534 2577 generic.go:356] "Generic (PLEG): container finished" podID="590a0262-d491-435d-a8d5-d1eb3a12b614" containerID="55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba" exitCode=0 Jul 09 13:26:51.585060 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:51.584581 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5f4c56f9-kdkqd" Jul 09 13:26:51.585060 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:51.584613 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5f4c56f9-kdkqd" event={"ID":"590a0262-d491-435d-a8d5-d1eb3a12b614","Type":"ContainerDied","Data":"55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba"} Jul 09 13:26:51.585060 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:51.584663 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5f4c56f9-kdkqd" event={"ID":"590a0262-d491-435d-a8d5-d1eb3a12b614","Type":"ContainerDied","Data":"132f59bd2937bb556ef24e55c63f18b1c4cf92905d7bb1ff555342e049488262"} Jul 09 13:26:51.585060 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:51.584697 2577 scope.go:117] "RemoveContainer" containerID="55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba" Jul 09 13:26:51.605160 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:51.605133 2577 scope.go:117] "RemoveContainer" containerID="55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba" Jul 09 13:26:51.605716 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:26:51.605692 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba\": container with ID starting with 55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba not found: ID does not exist" containerID="55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba" Jul 09 13:26:51.605777 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:51.605724 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba"} err="failed to get container status \"55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba\": rpc error: code = NotFound desc = could not find container \"55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba\": container with ID starting with 55b7a2b1050cd77deed130f83a18d5b6cce0d8a39fcca3d36f0b947380f9cdba not found: ID does not exist" Jul 09 13:26:51.610012 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:51.609989 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5f4c56f9-kdkqd"] Jul 09 13:26:51.617113 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:51.617091 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d5f4c56f9-kdkqd"] Jul 09 13:26:51.901347 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:51.901270 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="590a0262-d491-435d-a8d5-d1eb3a12b614" path="/var/lib/kubelet/pods/590a0262-d491-435d-a8d5-d1eb3a12b614/volumes" Jul 09 13:26:57.610869 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:57.610839 2577 generic.go:356] "Generic (PLEG): container finished" podID="5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1" containerID="143281acdf5c82896f461916f4e194d880dc6ebc819a3af0decfafd6e5c89d5c" exitCode=0 Jul 09 13:26:57.611256 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:57.610907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" event={"ID":"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1","Type":"ContainerDied","Data":"143281acdf5c82896f461916f4e194d880dc6ebc819a3af0decfafd6e5c89d5c"} Jul 09 13:26:57.611310 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:57.611266 2577 scope.go:117] "RemoveContainer" containerID="143281acdf5c82896f461916f4e194d880dc6ebc819a3af0decfafd6e5c89d5c" Jul 09 13:26:58.616339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:26:58.616303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-g4vlh" event={"ID":"5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1","Type":"ContainerStarted","Data":"00066751a4f2318307f37618e43a17ac82754b05d46d3d666a9e483c02b81c27"} Jul 09 13:27:02.633370 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:02.633332 2577 generic.go:356] "Generic (PLEG): container finished" podID="88eee4cb-a0b5-48b0-8df3-9e3bd0877983" containerID="f3cd5d4a350840966ac675a5112224302d7a6c34190f07616597f7c562535596" exitCode=0 Jul 09 13:27:02.633778 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:02.633387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" event={"ID":"88eee4cb-a0b5-48b0-8df3-9e3bd0877983","Type":"ContainerDied","Data":"f3cd5d4a350840966ac675a5112224302d7a6c34190f07616597f7c562535596"} Jul 09 13:27:02.633778 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:02.633699 2577 scope.go:117] "RemoveContainer" containerID="f3cd5d4a350840966ac675a5112224302d7a6c34190f07616597f7c562535596" Jul 09 13:27:02.641276 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:02.641241 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7558f4ff9f-jd2ql" podUID="da90aea4-d79b-44f5-852c-cace56d90bac" containerName="console" containerID="cri-o://e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b" gracePeriod=15 Jul 09 13:27:02.927038 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:02.927005 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:27:03.073170 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.073136 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-serving-cert\") pod \"da90aea4-d79b-44f5-852c-cace56d90bac\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " Jul 09 13:27:03.073359 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.073182 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-console-config\") pod \"da90aea4-d79b-44f5-852c-cace56d90bac\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " Jul 09 13:27:03.073359 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.073207 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-oauth-config\") pod \"da90aea4-d79b-44f5-852c-cace56d90bac\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " Jul 09 13:27:03.073359 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.073250 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-oauth-serving-cert\") pod \"da90aea4-d79b-44f5-852c-cace56d90bac\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " Jul 09 13:27:03.073359 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.073301 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-service-ca\") pod \"da90aea4-d79b-44f5-852c-cace56d90bac\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " Jul 09 13:27:03.073359 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.073329 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-trusted-ca-bundle\") pod \"da90aea4-d79b-44f5-852c-cace56d90bac\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " Jul 09 13:27:03.073607 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.073448 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stp4c\" (UniqueName: \"kubernetes.io/projected/da90aea4-d79b-44f5-852c-cace56d90bac-kube-api-access-stp4c\") pod \"da90aea4-d79b-44f5-852c-cace56d90bac\" (UID: \"da90aea4-d79b-44f5-852c-cace56d90bac\") " Jul 09 13:27:03.073663 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.073611 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-console-config" (OuterVolumeSpecName: "console-config") pod "da90aea4-d79b-44f5-852c-cace56d90bac" (UID: "da90aea4-d79b-44f5-852c-cace56d90bac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:27:03.073776 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.073747 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da90aea4-d79b-44f5-852c-cace56d90bac" (UID: "da90aea4-d79b-44f5-852c-cace56d90bac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:27:03.073842 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.073795 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-console-config\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:03.073967 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.073938 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "da90aea4-d79b-44f5-852c-cace56d90bac" (UID: "da90aea4-d79b-44f5-852c-cace56d90bac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:27:03.074069 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.074042 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-service-ca" (OuterVolumeSpecName: "service-ca") pod "da90aea4-d79b-44f5-852c-cace56d90bac" (UID: "da90aea4-d79b-44f5-852c-cace56d90bac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:27:03.075546 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.075523 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da90aea4-d79b-44f5-852c-cace56d90bac" (UID: "da90aea4-d79b-44f5-852c-cace56d90bac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:27:03.075644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.075614 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da90aea4-d79b-44f5-852c-cace56d90bac-kube-api-access-stp4c" (OuterVolumeSpecName: "kube-api-access-stp4c") pod "da90aea4-d79b-44f5-852c-cace56d90bac" (UID: "da90aea4-d79b-44f5-852c-cace56d90bac"). InnerVolumeSpecName "kube-api-access-stp4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:27:03.075707 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.075689 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da90aea4-d79b-44f5-852c-cace56d90bac" (UID: "da90aea4-d79b-44f5-852c-cace56d90bac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:27:03.175111 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.175010 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-serving-cert\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:03.175111 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.175043 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da90aea4-d79b-44f5-852c-cace56d90bac-console-oauth-config\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:03.175111 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.175053 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-oauth-serving-cert\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:03.175111 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.175062 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-service-ca\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:03.175111 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.175071 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da90aea4-d79b-44f5-852c-cace56d90bac-trusted-ca-bundle\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:03.175111 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.175107 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stp4c\" (UniqueName: \"kubernetes.io/projected/da90aea4-d79b-44f5-852c-cace56d90bac-kube-api-access-stp4c\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:03.638498 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.638458 2577 generic.go:356] "Generic (PLEG): container finished" podID="da90aea4-d79b-44f5-852c-cace56d90bac" containerID="e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b" exitCode=0 Jul 09 13:27:03.638992 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.638515 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7558f4ff9f-jd2ql" Jul 09 13:27:03.638992 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.638515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7558f4ff9f-jd2ql" event={"ID":"da90aea4-d79b-44f5-852c-cace56d90bac","Type":"ContainerDied","Data":"e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b"} Jul 09 13:27:03.638992 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.638578 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7558f4ff9f-jd2ql" event={"ID":"da90aea4-d79b-44f5-852c-cace56d90bac","Type":"ContainerDied","Data":"4e35bc725dac7473bb83ba59b1d801266653dddbb815ce9c3f7c2d0ab3cab7e2"} Jul 09 13:27:03.638992 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.638607 2577 scope.go:117] "RemoveContainer" containerID="e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b" Jul 09 13:27:03.640513 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.640493 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4bvpw" event={"ID":"88eee4cb-a0b5-48b0-8df3-9e3bd0877983","Type":"ContainerStarted","Data":"bcfd13f404dc92b7cefc40bd1cd55d4bfcf70e86e6616a7ead47c763dab3eed0"} Jul 09 13:27:03.647574 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.647559 2577 scope.go:117] "RemoveContainer" containerID="e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b" Jul 09 13:27:03.647854 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:27:03.647836 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b\": container with ID starting with e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b not found: ID does not exist" containerID="e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b" Jul 09 13:27:03.647912 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.647862 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b"} err="failed to get container status \"e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b\": rpc error: code = NotFound desc = could not find container \"e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b\": container with ID starting with e6ee2d59677a88d8392f436d2abeb65910fc768d9cbb893db1fb58bc658d410b not found: ID does not exist" Jul 09 13:27:03.674121 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.674097 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7558f4ff9f-jd2ql"] Jul 09 13:27:03.680091 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.680053 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7558f4ff9f-jd2ql"] Jul 09 13:27:03.902367 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:03.902289 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da90aea4-d79b-44f5-852c-cace56d90bac" path="/var/lib/kubelet/pods/da90aea4-d79b-44f5-852c-cace56d90bac/volumes" Jul 09 13:27:13.677896 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:13.677833 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9dd46b564-rdd2d" podUID="89ce0212-81b5-434e-a25b-a2cc280bff8f" containerName="console" containerID="cri-o://787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be" gracePeriod=15 Jul 09 13:27:13.952787 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:13.952763 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:27:14.079901 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.079871 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-trusted-ca-bundle\") pod \"89ce0212-81b5-434e-a25b-a2cc280bff8f\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " Jul 09 13:27:14.080107 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.079914 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-service-ca\") pod \"89ce0212-81b5-434e-a25b-a2cc280bff8f\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " Jul 09 13:27:14.080107 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.079940 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-oauth-config\") pod \"89ce0212-81b5-434e-a25b-a2cc280bff8f\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " Jul 09 13:27:14.080107 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.079977 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-serving-cert\") pod \"89ce0212-81b5-434e-a25b-a2cc280bff8f\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " Jul 09 13:27:14.080107 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.080004 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-config\") pod \"89ce0212-81b5-434e-a25b-a2cc280bff8f\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " Jul 09 13:27:14.080107 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.080023 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dk9hg\" (UniqueName: \"kubernetes.io/projected/89ce0212-81b5-434e-a25b-a2cc280bff8f-kube-api-access-dk9hg\") pod \"89ce0212-81b5-434e-a25b-a2cc280bff8f\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " Jul 09 13:27:14.080107 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.080050 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-oauth-serving-cert\") pod \"89ce0212-81b5-434e-a25b-a2cc280bff8f\" (UID: \"89ce0212-81b5-434e-a25b-a2cc280bff8f\") " Jul 09 13:27:14.080521 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.080384 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "89ce0212-81b5-434e-a25b-a2cc280bff8f" (UID: "89ce0212-81b5-434e-a25b-a2cc280bff8f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:27:14.080618 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.080557 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-config" (OuterVolumeSpecName: "console-config") pod "89ce0212-81b5-434e-a25b-a2cc280bff8f" (UID: "89ce0212-81b5-434e-a25b-a2cc280bff8f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:27:14.080664 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.080640 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "89ce0212-81b5-434e-a25b-a2cc280bff8f" (UID: "89ce0212-81b5-434e-a25b-a2cc280bff8f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:27:14.080713 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.080675 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-service-ca" (OuterVolumeSpecName: "service-ca") pod "89ce0212-81b5-434e-a25b-a2cc280bff8f" (UID: "89ce0212-81b5-434e-a25b-a2cc280bff8f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:27:14.082250 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.082226 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "89ce0212-81b5-434e-a25b-a2cc280bff8f" (UID: "89ce0212-81b5-434e-a25b-a2cc280bff8f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:27:14.082331 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.082290 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89ce0212-81b5-434e-a25b-a2cc280bff8f-kube-api-access-dk9hg" (OuterVolumeSpecName: "kube-api-access-dk9hg") pod "89ce0212-81b5-434e-a25b-a2cc280bff8f" (UID: "89ce0212-81b5-434e-a25b-a2cc280bff8f"). InnerVolumeSpecName "kube-api-access-dk9hg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:27:14.082331 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.082317 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "89ce0212-81b5-434e-a25b-a2cc280bff8f" (UID: "89ce0212-81b5-434e-a25b-a2cc280bff8f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:27:14.181122 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.181069 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-trusted-ca-bundle\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:14.181122 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.181115 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-service-ca\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:14.181122 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.181124 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-oauth-config\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:14.181122 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.181132 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-serving-cert\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:14.181361 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.181143 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-console-config\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:14.181361 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.181152 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dk9hg\" (UniqueName: \"kubernetes.io/projected/89ce0212-81b5-434e-a25b-a2cc280bff8f-kube-api-access-dk9hg\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:14.181361 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.181159 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89ce0212-81b5-434e-a25b-a2cc280bff8f-oauth-serving-cert\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:27:14.689993 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.689959 2577 generic.go:356] "Generic (PLEG): container finished" podID="89ce0212-81b5-434e-a25b-a2cc280bff8f" containerID="787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be" exitCode=0 Jul 09 13:27:14.690398 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.690003 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9dd46b564-rdd2d" Jul 09 13:27:14.690398 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.690048 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9dd46b564-rdd2d" event={"ID":"89ce0212-81b5-434e-a25b-a2cc280bff8f","Type":"ContainerDied","Data":"787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be"} Jul 09 13:27:14.690398 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.690128 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9dd46b564-rdd2d" event={"ID":"89ce0212-81b5-434e-a25b-a2cc280bff8f","Type":"ContainerDied","Data":"108d2a60983b5365a5f9d7adb27454a346743501765cf377091fede038e2873b"} Jul 09 13:27:14.690398 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.690154 2577 scope.go:117] "RemoveContainer" containerID="787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be" Jul 09 13:27:14.698513 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.698496 2577 scope.go:117] "RemoveContainer" containerID="787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be" Jul 09 13:27:14.698757 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:27:14.698740 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be\": container with ID starting with 787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be not found: ID does not exist" containerID="787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be" Jul 09 13:27:14.698807 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.698766 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be"} err="failed to get container status \"787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be\": rpc error: code = NotFound desc = could not find container \"787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be\": container with ID starting with 787fdfad200216d1914cf538efe2ba5cd33888d4cb28ba27cff35d92df4220be not found: ID does not exist" Jul 09 13:27:14.711763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.711741 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9dd46b564-rdd2d"] Jul 09 13:27:14.716688 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:14.716667 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9dd46b564-rdd2d"] Jul 09 13:27:15.901093 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:15.901053 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89ce0212-81b5-434e-a25b-a2cc280bff8f" path="/var/lib/kubelet/pods/89ce0212-81b5-434e-a25b-a2cc280bff8f/volumes" Jul 09 13:27:53.556125 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.556073 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86449859b5-nm7zv"] Jul 09 13:27:53.556533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.556389 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ce0212-81b5-434e-a25b-a2cc280bff8f" containerName="console" Jul 09 13:27:53.556533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.556401 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ce0212-81b5-434e-a25b-a2cc280bff8f" containerName="console" Jul 09 13:27:53.556533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.556414 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="590a0262-d491-435d-a8d5-d1eb3a12b614" containerName="console" Jul 09 13:27:53.556533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.556419 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="590a0262-d491-435d-a8d5-d1eb3a12b614" containerName="console" Jul 09 13:27:53.556533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.556429 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da90aea4-d79b-44f5-852c-cace56d90bac" containerName="console" Jul 09 13:27:53.556533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.556435 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="da90aea4-d79b-44f5-852c-cace56d90bac" containerName="console" Jul 09 13:27:53.556533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.556479 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="da90aea4-d79b-44f5-852c-cace56d90bac" containerName="console" Jul 09 13:27:53.556533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.556487 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="89ce0212-81b5-434e-a25b-a2cc280bff8f" containerName="console" Jul 09 13:27:53.556533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.556493 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="590a0262-d491-435d-a8d5-d1eb3a12b614" containerName="console" Jul 09 13:27:53.559161 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.559147 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.572956 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.572934 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86449859b5-nm7zv"] Jul 09 13:27:53.690517 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.690488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-trusted-ca-bundle\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.690517 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.690521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-service-ca\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.690720 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.690543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1baf7529-f570-46b3-bea5-f133b329a073-console-oauth-config\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.690720 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.690574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-oauth-serving-cert\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.690720 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.690630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-console-config\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.690720 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.690676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1baf7529-f570-46b3-bea5-f133b329a073-console-serving-cert\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.690720 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.690696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44xvj\" (UniqueName: \"kubernetes.io/projected/1baf7529-f570-46b3-bea5-f133b329a073-kube-api-access-44xvj\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.791812 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.791781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-service-ca\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.791812 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.791816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1baf7529-f570-46b3-bea5-f133b329a073-console-oauth-config\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.792032 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.791845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-oauth-serving-cert\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.792032 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.791861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-console-config\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.792032 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.791882 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1baf7529-f570-46b3-bea5-f133b329a073-console-serving-cert\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.792032 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.791905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44xvj\" (UniqueName: \"kubernetes.io/projected/1baf7529-f570-46b3-bea5-f133b329a073-kube-api-access-44xvj\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.792032 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.791970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-trusted-ca-bundle\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.792671 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.792640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-oauth-serving-cert\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.792789 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.792640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-service-ca\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.792789 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.792750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-console-config\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.792950 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.792933 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1baf7529-f570-46b3-bea5-f133b329a073-trusted-ca-bundle\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.794743 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.794717 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1baf7529-f570-46b3-bea5-f133b329a073-console-oauth-config\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.794824 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.794800 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1baf7529-f570-46b3-bea5-f133b329a073-console-serving-cert\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.801256 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.801234 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44xvj\" (UniqueName: \"kubernetes.io/projected/1baf7529-f570-46b3-bea5-f133b329a073-kube-api-access-44xvj\") pod \"console-86449859b5-nm7zv\" (UID: \"1baf7529-f570-46b3-bea5-f133b329a073\") " pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.868188 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.868122 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:27:53.998594 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:53.998571 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86449859b5-nm7zv"] Jul 09 13:27:54.000212 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:27:54.000187 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1baf7529_f570_46b3_bea5_f133b329a073.slice/crio-5240fee9d81b58c3462357f8be897e6f07056bc1e70ce72e19857c27b2c7eb2c WatchSource:0}: Error finding container 5240fee9d81b58c3462357f8be897e6f07056bc1e70ce72e19857c27b2c7eb2c: Status 404 returned error can't find the container with id 5240fee9d81b58c3462357f8be897e6f07056bc1e70ce72e19857c27b2c7eb2c Jul 09 13:27:54.848839 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:54.848805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86449859b5-nm7zv" event={"ID":"1baf7529-f570-46b3-bea5-f133b329a073","Type":"ContainerStarted","Data":"1dd3162855d83f773301fda0ddb7144ae16183cda7a85fea24b7c3772a683fd9"} Jul 09 13:27:54.849248 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:54.848851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86449859b5-nm7zv" event={"ID":"1baf7529-f570-46b3-bea5-f133b329a073","Type":"ContainerStarted","Data":"5240fee9d81b58c3462357f8be897e6f07056bc1e70ce72e19857c27b2c7eb2c"} Jul 09 13:27:54.876683 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:27:54.876642 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86449859b5-nm7zv" podStartSLOduration=1.8766275540000001 podStartE2EDuration="1.876627554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:27:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:27:54.874992312 +0000 UTC m=+187.545613474" watchObservedRunningTime="2026-07-09 13:27:54.876627554 +0000 UTC m=+187.547248716" Jul 09 13:28:03.869223 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:03.869170 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:28:03.869223 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:03.869241 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:28:03.873823 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:03.873803 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:28:03.884472 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:03.884453 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86449859b5-nm7zv" Jul 09 13:28:03.943685 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:03.943655 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb9d95f96-w5rlw"] Jul 09 13:28:28.965112 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:28.965039 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cb9d95f96-w5rlw" podUID="849355b4-6ba2-4393-a371-d8023782e421" containerName="console" containerID="cri-o://fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276" gracePeriod=15 Jul 09 13:28:29.202811 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.202788 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:28:29.287155 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.287032 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-service-ca\") pod \"849355b4-6ba2-4393-a371-d8023782e421\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " Jul 09 13:28:29.287155 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.287072 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-trusted-ca-bundle\") pod \"849355b4-6ba2-4393-a371-d8023782e421\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " Jul 09 13:28:29.287155 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.287139 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8ctq\" (UniqueName: \"kubernetes.io/projected/849355b4-6ba2-4393-a371-d8023782e421-kube-api-access-l8ctq\") pod \"849355b4-6ba2-4393-a371-d8023782e421\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " Jul 09 13:28:29.287425 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.287189 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-oauth-config\") pod \"849355b4-6ba2-4393-a371-d8023782e421\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " Jul 09 13:28:29.287425 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.287232 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-serving-cert\") pod \"849355b4-6ba2-4393-a371-d8023782e421\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " Jul 09 13:28:29.287425 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.287265 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-console-config\") pod \"849355b4-6ba2-4393-a371-d8023782e421\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " Jul 09 13:28:29.287425 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.287288 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-oauth-serving-cert\") pod \"849355b4-6ba2-4393-a371-d8023782e421\" (UID: \"849355b4-6ba2-4393-a371-d8023782e421\") " Jul 09 13:28:29.287602 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.287464 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-service-ca" (OuterVolumeSpecName: "service-ca") pod "849355b4-6ba2-4393-a371-d8023782e421" (UID: "849355b4-6ba2-4393-a371-d8023782e421"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:28:29.287602 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.287572 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "849355b4-6ba2-4393-a371-d8023782e421" (UID: "849355b4-6ba2-4393-a371-d8023782e421"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:28:29.287721 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.287696 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-console-config" (OuterVolumeSpecName: "console-config") pod "849355b4-6ba2-4393-a371-d8023782e421" (UID: "849355b4-6ba2-4393-a371-d8023782e421"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:28:29.287825 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.287798 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "849355b4-6ba2-4393-a371-d8023782e421" (UID: "849355b4-6ba2-4393-a371-d8023782e421"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:28:29.289396 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.289369 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/849355b4-6ba2-4393-a371-d8023782e421-kube-api-access-l8ctq" (OuterVolumeSpecName: "kube-api-access-l8ctq") pod "849355b4-6ba2-4393-a371-d8023782e421" (UID: "849355b4-6ba2-4393-a371-d8023782e421"). InnerVolumeSpecName "kube-api-access-l8ctq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:28:29.289857 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.289833 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "849355b4-6ba2-4393-a371-d8023782e421" (UID: "849355b4-6ba2-4393-a371-d8023782e421"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:28:29.289919 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.289852 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "849355b4-6ba2-4393-a371-d8023782e421" (UID: "849355b4-6ba2-4393-a371-d8023782e421"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:28:29.388515 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.388464 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-oauth-config\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:28:29.388515 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.388508 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/849355b4-6ba2-4393-a371-d8023782e421-console-serving-cert\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:28:29.388515 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.388520 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-console-config\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:28:29.388515 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.388532 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-oauth-serving-cert\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:28:29.388786 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.388543 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-service-ca\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:28:29.388786 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.388551 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/849355b4-6ba2-4393-a371-d8023782e421-trusted-ca-bundle\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:28:29.388786 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.388561 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8ctq\" (UniqueName: \"kubernetes.io/projected/849355b4-6ba2-4393-a371-d8023782e421-kube-api-access-l8ctq\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:28:29.974494 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.974455 2577 generic.go:356] "Generic (PLEG): container finished" podID="849355b4-6ba2-4393-a371-d8023782e421" containerID="fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276" exitCode=0 Jul 09 13:28:29.974985 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.974507 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb9d95f96-w5rlw" Jul 09 13:28:29.974985 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.974547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb9d95f96-w5rlw" event={"ID":"849355b4-6ba2-4393-a371-d8023782e421","Type":"ContainerDied","Data":"fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276"} Jul 09 13:28:29.974985 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.974616 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb9d95f96-w5rlw" event={"ID":"849355b4-6ba2-4393-a371-d8023782e421","Type":"ContainerDied","Data":"6ea1486138ec32de9d5345007cd3831a8de84ce9a3bd2fcda347e4701e3eb9c4"} Jul 09 13:28:29.974985 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.974651 2577 scope.go:117] "RemoveContainer" containerID="fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276" Jul 09 13:28:29.982711 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.982693 2577 scope.go:117] "RemoveContainer" containerID="fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276" Jul 09 13:28:29.982998 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:28:29.982974 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276\": container with ID starting with fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276 not found: ID does not exist" containerID="fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276" Jul 09 13:28:29.983063 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.983014 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276"} err="failed to get container status \"fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276\": rpc error: code = NotFound desc = could not find container \"fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276\": container with ID starting with fc37585ed54a709c8907e995d9f7f3597ebfceb328cb6629e6a4cb615eb00276 not found: ID does not exist" Jul 09 13:28:29.992342 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.992316 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb9d95f96-w5rlw"] Jul 09 13:28:29.999438 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:29.999414 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb9d95f96-w5rlw"] Jul 09 13:28:31.903202 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:28:31.903152 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="849355b4-6ba2-4393-a371-d8023782e421" path="/var/lib/kubelet/pods/849355b4-6ba2-4393-a371-d8023782e421/volumes" Jul 09 13:29:01.271422 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.271392 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc"] Jul 09 13:29:01.271799 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.271675 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="849355b4-6ba2-4393-a371-d8023782e421" containerName="console" Jul 09 13:29:01.271799 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.271686 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="849355b4-6ba2-4393-a371-d8023782e421" containerName="console" Jul 09 13:29:01.271799 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.271750 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="849355b4-6ba2-4393-a371-d8023782e421" containerName="console" Jul 09 13:29:01.274384 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.274364 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:01.276992 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.276972 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 13:29:01.278031 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.278017 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lb655\"" Jul 09 13:29:01.278130 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.278101 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 13:29:01.283700 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.283682 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc"] Jul 09 13:29:01.343714 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.343695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8nnn\" (UniqueName: \"kubernetes.io/projected/51c71145-6667-4c20-af99-c6944143b23e-kube-api-access-q8nnn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:01.343813 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.343730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:01.343813 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.343751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:01.444633 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.444603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:01.444717 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.444642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:01.444717 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.444698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nnn\" (UniqueName: \"kubernetes.io/projected/51c71145-6667-4c20-af99-c6944143b23e-kube-api-access-q8nnn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:01.444928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.444911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:01.445032 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.445016 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:01.453540 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.453524 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8nnn\" (UniqueName: \"kubernetes.io/projected/51c71145-6667-4c20-af99-c6944143b23e-kube-api-access-q8nnn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:01.583440 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.583422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:01.706010 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:01.705985 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc"] Jul 09 13:29:01.707923 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:29:01.707894 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c71145_6667_4c20_af99_c6944143b23e.slice/crio-c744bd16b80916fd9a1fae72b12228b87d645ea31fe9e45e5fb2a9b2c4464c49 WatchSource:0}: Error finding container c744bd16b80916fd9a1fae72b12228b87d645ea31fe9e45e5fb2a9b2c4464c49: Status 404 returned error can't find the container with id c744bd16b80916fd9a1fae72b12228b87d645ea31fe9e45e5fb2a9b2c4464c49 Jul 09 13:29:02.098253 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:02.098221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" event={"ID":"51c71145-6667-4c20-af99-c6944143b23e","Type":"ContainerStarted","Data":"c744bd16b80916fd9a1fae72b12228b87d645ea31fe9e45e5fb2a9b2c4464c49"} Jul 09 13:29:12.141090 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:12.141027 2577 generic.go:356] "Generic (PLEG): container finished" podID="51c71145-6667-4c20-af99-c6944143b23e" containerID="9420dbdd46263cbb25b363dfd974de5c040bd34dd0d156d1c5a0852737c94b94" exitCode=0 Jul 09 13:29:12.141549 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:12.141113 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" event={"ID":"51c71145-6667-4c20-af99-c6944143b23e","Type":"ContainerDied","Data":"9420dbdd46263cbb25b363dfd974de5c040bd34dd0d156d1c5a0852737c94b94"} Jul 09 13:29:15.155487 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:15.155451 2577 generic.go:356] "Generic (PLEG): container finished" podID="51c71145-6667-4c20-af99-c6944143b23e" containerID="c5924919768688cd701e916b689987e9c31349955976a7a2ee72bbf64229ae06" exitCode=0 Jul 09 13:29:15.155888 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:15.155496 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" event={"ID":"51c71145-6667-4c20-af99-c6944143b23e","Type":"ContainerDied","Data":"c5924919768688cd701e916b689987e9c31349955976a7a2ee72bbf64229ae06"} Jul 09 13:29:23.192701 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:23.192666 2577 generic.go:356] "Generic (PLEG): container finished" podID="51c71145-6667-4c20-af99-c6944143b23e" containerID="1a5276cc16498af73da84eac65045db36b605bbaef0aa30290ee6f74deffd960" exitCode=0 Jul 09 13:29:23.193195 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:23.192767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" event={"ID":"51c71145-6667-4c20-af99-c6944143b23e","Type":"ContainerDied","Data":"1a5276cc16498af73da84eac65045db36b605bbaef0aa30290ee6f74deffd960"} Jul 09 13:29:24.337922 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:24.337894 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:24.432371 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:24.432342 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-util\") pod \"51c71145-6667-4c20-af99-c6944143b23e\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " Jul 09 13:29:24.432545 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:24.432409 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-bundle\") pod \"51c71145-6667-4c20-af99-c6944143b23e\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " Jul 09 13:29:24.432545 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:24.432467 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8nnn\" (UniqueName: \"kubernetes.io/projected/51c71145-6667-4c20-af99-c6944143b23e-kube-api-access-q8nnn\") pod \"51c71145-6667-4c20-af99-c6944143b23e\" (UID: \"51c71145-6667-4c20-af99-c6944143b23e\") " Jul 09 13:29:24.433071 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:24.433034 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-bundle" (OuterVolumeSpecName: "bundle") pod "51c71145-6667-4c20-af99-c6944143b23e" (UID: "51c71145-6667-4c20-af99-c6944143b23e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:29:24.434591 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:24.434567 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c71145-6667-4c20-af99-c6944143b23e-kube-api-access-q8nnn" (OuterVolumeSpecName: "kube-api-access-q8nnn") pod "51c71145-6667-4c20-af99-c6944143b23e" (UID: "51c71145-6667-4c20-af99-c6944143b23e"). InnerVolumeSpecName "kube-api-access-q8nnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:29:24.436765 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:24.436743 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-util" (OuterVolumeSpecName: "util") pod "51c71145-6667-4c20-af99-c6944143b23e" (UID: "51c71145-6667-4c20-af99-c6944143b23e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:29:24.533985 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:24.533893 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8nnn\" (UniqueName: \"kubernetes.io/projected/51c71145-6667-4c20-af99-c6944143b23e-kube-api-access-q8nnn\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:29:24.533985 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:24.533923 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-util\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:29:24.533985 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:24.533933 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c71145-6667-4c20-af99-c6944143b23e-bundle\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:29:25.201652 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:25.201625 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" Jul 09 13:29:25.201814 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:25.201618 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqmkc" event={"ID":"51c71145-6667-4c20-af99-c6944143b23e","Type":"ContainerDied","Data":"c744bd16b80916fd9a1fae72b12228b87d645ea31fe9e45e5fb2a9b2c4464c49"} Jul 09 13:29:25.201814 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:25.201745 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c744bd16b80916fd9a1fae72b12228b87d645ea31fe9e45e5fb2a9b2c4464c49" Jul 09 13:29:29.544048 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.544010 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2"] Jul 09 13:29:29.544540 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.544458 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c71145-6667-4c20-af99-c6944143b23e" containerName="util" Jul 09 13:29:29.544540 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.544476 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c71145-6667-4c20-af99-c6944143b23e" containerName="util" Jul 09 13:29:29.544540 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.544495 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c71145-6667-4c20-af99-c6944143b23e" containerName="pull" Jul 09 13:29:29.544540 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.544502 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c71145-6667-4c20-af99-c6944143b23e" containerName="pull" Jul 09 13:29:29.544540 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.544512 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c71145-6667-4c20-af99-c6944143b23e" containerName="extract" Jul 09 13:29:29.544540 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.544520 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c71145-6667-4c20-af99-c6944143b23e" containerName="extract" Jul 09 13:29:29.544820 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.544606 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="51c71145-6667-4c20-af99-c6944143b23e" containerName="extract" Jul 09 13:29:29.546817 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.546796 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2" Jul 09 13:29:29.549586 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.549570 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 13:29:29.549881 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.549864 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-x5czd\"" Jul 09 13:29:29.549973 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.549957 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:29:29.568754 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.568724 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2"] Jul 09 13:29:29.673223 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.673193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/017d684c-e2fa-4c74-acd7-243959aa7ae5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wgws2\" (UID: \"017d684c-e2fa-4c74-acd7-243959aa7ae5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2" Jul 09 13:29:29.673390 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.673232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6glpz\" (UniqueName: \"kubernetes.io/projected/017d684c-e2fa-4c74-acd7-243959aa7ae5-kube-api-access-6glpz\") pod \"cert-manager-operator-controller-manager-55c444bf86-wgws2\" (UID: \"017d684c-e2fa-4c74-acd7-243959aa7ae5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2" Jul 09 13:29:29.774476 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.774435 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/017d684c-e2fa-4c74-acd7-243959aa7ae5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wgws2\" (UID: \"017d684c-e2fa-4c74-acd7-243959aa7ae5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2" Jul 09 13:29:29.774668 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.774487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6glpz\" (UniqueName: \"kubernetes.io/projected/017d684c-e2fa-4c74-acd7-243959aa7ae5-kube-api-access-6glpz\") pod \"cert-manager-operator-controller-manager-55c444bf86-wgws2\" (UID: \"017d684c-e2fa-4c74-acd7-243959aa7ae5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2" Jul 09 13:29:29.774856 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.774833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/017d684c-e2fa-4c74-acd7-243959aa7ae5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wgws2\" (UID: \"017d684c-e2fa-4c74-acd7-243959aa7ae5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2" Jul 09 13:29:29.782581 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.782556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6glpz\" (UniqueName: \"kubernetes.io/projected/017d684c-e2fa-4c74-acd7-243959aa7ae5-kube-api-access-6glpz\") pod \"cert-manager-operator-controller-manager-55c444bf86-wgws2\" (UID: \"017d684c-e2fa-4c74-acd7-243959aa7ae5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2" Jul 09 13:29:29.855999 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.855965 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2" Jul 09 13:29:29.986962 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:29.986941 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2"] Jul 09 13:29:29.989767 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:29:29.989744 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017d684c_e2fa_4c74_acd7_243959aa7ae5.slice/crio-5ac4210f009948c2ce2f0d3766ff760e0e82fbda39170feb2d0865031c9cabdf WatchSource:0}: Error finding container 5ac4210f009948c2ce2f0d3766ff760e0e82fbda39170feb2d0865031c9cabdf: Status 404 returned error can't find the container with id 5ac4210f009948c2ce2f0d3766ff760e0e82fbda39170feb2d0865031c9cabdf Jul 09 13:29:30.223414 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:30.223330 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2" event={"ID":"017d684c-e2fa-4c74-acd7-243959aa7ae5","Type":"ContainerStarted","Data":"5ac4210f009948c2ce2f0d3766ff760e0e82fbda39170feb2d0865031c9cabdf"} Jul 09 13:29:32.235543 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:32.235508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2" event={"ID":"017d684c-e2fa-4c74-acd7-243959aa7ae5","Type":"ContainerStarted","Data":"2067d784c11d52d77268f87cc027015024f4a919a17d0b296284a6baccb201de"} Jul 09 13:29:32.266171 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:32.266120 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wgws2" podStartSLOduration=1.749070226 podStartE2EDuration="3.266104662s" totalImagesPullingTime="1.517034436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:32.264576297 +0000 UTC m=+284.935197459" watchObservedRunningTime="2026-07-09 13:29:32.266104662 +0000 UTC m=+284.936725820" Jul 09 13:29:33.752297 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:33.752266 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw"] Jul 09 13:29:33.754715 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:33.754698 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:33.757776 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:33.757751 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 13:29:33.757776 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:33.757752 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 13:29:33.758646 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:33.758626 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lb655\"" Jul 09 13:29:33.774534 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:33.774512 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw"] Jul 09 13:29:33.914437 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:33.914404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:33.914611 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:33.914472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:33.914611 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:33.914524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtqkw\" (UniqueName: \"kubernetes.io/projected/6a79beb8-a481-4bbe-839e-65590619bd49-kube-api-access-gtqkw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:34.015436 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.015353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:34.015436 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.015397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtqkw\" (UniqueName: \"kubernetes.io/projected/6a79beb8-a481-4bbe-839e-65590619bd49-kube-api-access-gtqkw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:34.015629 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.015520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:34.015733 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.015714 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:34.015793 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.015776 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:34.028788 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.028755 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtqkw\" (UniqueName: \"kubernetes.io/projected/6a79beb8-a481-4bbe-839e-65590619bd49-kube-api-access-gtqkw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:34.063745 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.063721 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:34.193767 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.193743 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw"] Jul 09 13:29:34.195885 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:29:34.195835 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a79beb8_a481_4bbe_839e_65590619bd49.slice/crio-cf6f7843235e2854d5084292ce7c56891b40c516e277ed3c6b827d785065c56e WatchSource:0}: Error finding container cf6f7843235e2854d5084292ce7c56891b40c516e277ed3c6b827d785065c56e: Status 404 returned error can't find the container with id cf6f7843235e2854d5084292ce7c56891b40c516e277ed3c6b827d785065c56e Jul 09 13:29:34.244494 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.244468 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" event={"ID":"6a79beb8-a481-4bbe-839e-65590619bd49","Type":"ContainerStarted","Data":"cf6f7843235e2854d5084292ce7c56891b40c516e277ed3c6b827d785065c56e"} Jul 09 13:29:34.583949 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.583920 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zzv7j"] Jul 09 13:29:34.586153 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.586138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" Jul 09 13:29:34.588709 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.588679 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-n6zpf\"" Jul 09 13:29:34.588709 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.588699 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 13:29:34.588885 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.588774 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 13:29:34.598940 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.598918 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zzv7j"] Jul 09 13:29:34.620994 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.620973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39286e45-bc69-4c22-926b-351096a08853-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zzv7j\" (UID: \"39286e45-bc69-4c22-926b-351096a08853\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" Jul 09 13:29:34.621131 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.621006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z8vf\" (UniqueName: \"kubernetes.io/projected/39286e45-bc69-4c22-926b-351096a08853-kube-api-access-8z8vf\") pod \"cert-manager-webhook-6486ffd997-zzv7j\" (UID: \"39286e45-bc69-4c22-926b-351096a08853\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" Jul 09 13:29:34.721938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.721917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39286e45-bc69-4c22-926b-351096a08853-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zzv7j\" (UID: \"39286e45-bc69-4c22-926b-351096a08853\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" Jul 09 13:29:34.722052 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.721954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z8vf\" (UniqueName: \"kubernetes.io/projected/39286e45-bc69-4c22-926b-351096a08853-kube-api-access-8z8vf\") pod \"cert-manager-webhook-6486ffd997-zzv7j\" (UID: \"39286e45-bc69-4c22-926b-351096a08853\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" Jul 09 13:29:34.730908 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.730883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z8vf\" (UniqueName: \"kubernetes.io/projected/39286e45-bc69-4c22-926b-351096a08853-kube-api-access-8z8vf\") pod \"cert-manager-webhook-6486ffd997-zzv7j\" (UID: \"39286e45-bc69-4c22-926b-351096a08853\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" Jul 09 13:29:34.731039 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.730958 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39286e45-bc69-4c22-926b-351096a08853-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zzv7j\" (UID: \"39286e45-bc69-4c22-926b-351096a08853\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" Jul 09 13:29:34.895694 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:34.895626 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" Jul 09 13:29:35.016727 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:35.016674 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zzv7j"] Jul 09 13:29:35.019190 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:29:35.019167 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39286e45_bc69_4c22_926b_351096a08853.slice/crio-a9c40dfa5b187e556b054ce26de8354cc319400218783708f29589e1813742e2 WatchSource:0}: Error finding container a9c40dfa5b187e556b054ce26de8354cc319400218783708f29589e1813742e2: Status 404 returned error can't find the container with id a9c40dfa5b187e556b054ce26de8354cc319400218783708f29589e1813742e2 Jul 09 13:29:35.249893 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:35.249822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" event={"ID":"39286e45-bc69-4c22-926b-351096a08853","Type":"ContainerStarted","Data":"a9c40dfa5b187e556b054ce26de8354cc319400218783708f29589e1813742e2"} Jul 09 13:29:35.251369 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:35.251344 2577 generic.go:356] "Generic (PLEG): container finished" podID="6a79beb8-a481-4bbe-839e-65590619bd49" containerID="2fbd5cf109025b43e90ba225f31383a8c8e5b4052c4c880934a5ee05219c1376" exitCode=0 Jul 09 13:29:35.251444 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:35.251413 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" event={"ID":"6a79beb8-a481-4bbe-839e-65590619bd49","Type":"ContainerDied","Data":"2fbd5cf109025b43e90ba225f31383a8c8e5b4052c4c880934a5ee05219c1376"} Jul 09 13:29:39.272045 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:39.272009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" event={"ID":"39286e45-bc69-4c22-926b-351096a08853","Type":"ContainerStarted","Data":"8ab563df9e33b4e72bc14519b12c8b8fb2008ba0861b7736b2e5ccc361dd5217"} Jul 09 13:29:39.272490 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:39.272100 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" Jul 09 13:29:39.273877 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:39.273855 2577 generic.go:356] "Generic (PLEG): container finished" podID="6a79beb8-a481-4bbe-839e-65590619bd49" containerID="c0e48d9ddd65dbc2f20f3c6e54245a99a34aec2cfe73441fbeec4490e7ba5d34" exitCode=0 Jul 09 13:29:39.273972 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:39.273889 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" event={"ID":"6a79beb8-a481-4bbe-839e-65590619bd49","Type":"ContainerDied","Data":"c0e48d9ddd65dbc2f20f3c6e54245a99a34aec2cfe73441fbeec4490e7ba5d34"} Jul 09 13:29:39.290906 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:39.290866 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" podStartSLOduration=1.92179213 podStartE2EDuration="5.290852732s" totalImagesPullingTime="3.369060602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:39.290100797 +0000 UTC m=+291.960721952" watchObservedRunningTime="2026-07-09 13:29:39.290852732 +0000 UTC m=+291.961473892" Jul 09 13:29:40.280285 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:40.280253 2577 generic.go:356] "Generic (PLEG): container finished" podID="6a79beb8-a481-4bbe-839e-65590619bd49" containerID="24d5903a5fa8ab62cf49ffcd6c6836feeea43c16ce5f7b725ffb9a02e4626663" exitCode=0 Jul 09 13:29:40.280648 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:40.280311 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" event={"ID":"6a79beb8-a481-4bbe-839e-65590619bd49","Type":"ContainerDied","Data":"24d5903a5fa8ab62cf49ffcd6c6836feeea43c16ce5f7b725ffb9a02e4626663"} Jul 09 13:29:41.404829 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:41.404807 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:41.477831 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:41.477803 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-util\") pod \"6a79beb8-a481-4bbe-839e-65590619bd49\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " Jul 09 13:29:41.477973 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:41.477843 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-bundle\") pod \"6a79beb8-a481-4bbe-839e-65590619bd49\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " Jul 09 13:29:41.477973 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:41.477887 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtqkw\" (UniqueName: \"kubernetes.io/projected/6a79beb8-a481-4bbe-839e-65590619bd49-kube-api-access-gtqkw\") pod \"6a79beb8-a481-4bbe-839e-65590619bd49\" (UID: \"6a79beb8-a481-4bbe-839e-65590619bd49\") " Jul 09 13:29:41.478277 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:41.478244 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-bundle" (OuterVolumeSpecName: "bundle") pod "6a79beb8-a481-4bbe-839e-65590619bd49" (UID: "6a79beb8-a481-4bbe-839e-65590619bd49"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:29:41.479856 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:41.479816 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a79beb8-a481-4bbe-839e-65590619bd49-kube-api-access-gtqkw" (OuterVolumeSpecName: "kube-api-access-gtqkw") pod "6a79beb8-a481-4bbe-839e-65590619bd49" (UID: "6a79beb8-a481-4bbe-839e-65590619bd49"). InnerVolumeSpecName "kube-api-access-gtqkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:29:41.482518 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:41.482497 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-util" (OuterVolumeSpecName: "util") pod "6a79beb8-a481-4bbe-839e-65590619bd49" (UID: "6a79beb8-a481-4bbe-839e-65590619bd49"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:29:41.579305 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:41.579280 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-util\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:29:41.579305 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:41.579303 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a79beb8-a481-4bbe-839e-65590619bd49-bundle\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:29:41.579496 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:41.579313 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtqkw\" (UniqueName: \"kubernetes.io/projected/6a79beb8-a481-4bbe-839e-65590619bd49-kube-api-access-gtqkw\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:29:42.294991 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:42.294922 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" Jul 09 13:29:42.295149 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:42.294914 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frw9hw" event={"ID":"6a79beb8-a481-4bbe-839e-65590619bd49","Type":"ContainerDied","Data":"cf6f7843235e2854d5084292ce7c56891b40c516e277ed3c6b827d785065c56e"} Jul 09 13:29:42.295149 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:42.295095 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf6f7843235e2854d5084292ce7c56891b40c516e277ed3c6b827d785065c56e" Jul 09 13:29:45.282201 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:45.282176 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zzv7j" Jul 09 13:29:46.163912 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.163880 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw"] Jul 09 13:29:46.164199 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.164187 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a79beb8-a481-4bbe-839e-65590619bd49" containerName="util" Jul 09 13:29:46.164254 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.164201 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a79beb8-a481-4bbe-839e-65590619bd49" containerName="util" Jul 09 13:29:46.164254 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.164220 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a79beb8-a481-4bbe-839e-65590619bd49" containerName="extract" Jul 09 13:29:46.164254 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.164226 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a79beb8-a481-4bbe-839e-65590619bd49" containerName="extract" Jul 09 13:29:46.164254 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.164238 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a79beb8-a481-4bbe-839e-65590619bd49" containerName="pull" Jul 09 13:29:46.164254 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.164243 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a79beb8-a481-4bbe-839e-65590619bd49" containerName="pull" Jul 09 13:29:46.164403 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.164286 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a79beb8-a481-4bbe-839e-65590619bd49" containerName="extract" Jul 09 13:29:46.167996 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.167975 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw" Jul 09 13:29:46.171041 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.171017 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bv6cr\"" Jul 09 13:29:46.171145 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.171026 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:29:46.172119 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.172104 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 13:29:46.181686 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.181666 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw"] Jul 09 13:29:46.213665 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.213640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba33b7bd-99d3-4872-81b7-c4874d48d8e2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-td2zw\" (UID: \"ba33b7bd-99d3-4872-81b7-c4874d48d8e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw" Jul 09 13:29:46.213813 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.213699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8swq7\" (UniqueName: \"kubernetes.io/projected/ba33b7bd-99d3-4872-81b7-c4874d48d8e2-kube-api-access-8swq7\") pod \"openshift-lws-operator-fd8ccff4c-td2zw\" (UID: \"ba33b7bd-99d3-4872-81b7-c4874d48d8e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw" Jul 09 13:29:46.314420 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.314388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8swq7\" (UniqueName: \"kubernetes.io/projected/ba33b7bd-99d3-4872-81b7-c4874d48d8e2-kube-api-access-8swq7\") pod \"openshift-lws-operator-fd8ccff4c-td2zw\" (UID: \"ba33b7bd-99d3-4872-81b7-c4874d48d8e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw" Jul 09 13:29:46.314804 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.314467 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba33b7bd-99d3-4872-81b7-c4874d48d8e2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-td2zw\" (UID: \"ba33b7bd-99d3-4872-81b7-c4874d48d8e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw" Jul 09 13:29:46.314848 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.314814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba33b7bd-99d3-4872-81b7-c4874d48d8e2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-td2zw\" (UID: \"ba33b7bd-99d3-4872-81b7-c4874d48d8e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw" Jul 09 13:29:46.323506 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.323483 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8swq7\" (UniqueName: \"kubernetes.io/projected/ba33b7bd-99d3-4872-81b7-c4874d48d8e2-kube-api-access-8swq7\") pod \"openshift-lws-operator-fd8ccff4c-td2zw\" (UID: \"ba33b7bd-99d3-4872-81b7-c4874d48d8e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw" Jul 09 13:29:46.445823 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.445746 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8rs6p"] Jul 09 13:29:46.449564 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.449548 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8rs6p" Jul 09 13:29:46.452463 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.452443 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hwwb9\"" Jul 09 13:29:46.459252 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.459234 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8rs6p"] Jul 09 13:29:46.478041 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.477817 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw" Jul 09 13:29:46.516359 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.516319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbh8r\" (UniqueName: \"kubernetes.io/projected/a6713f26-a263-4e69-b532-5f9031b64b03-kube-api-access-lbh8r\") pod \"cert-manager-55b4d954d5-8rs6p\" (UID: \"a6713f26-a263-4e69-b532-5f9031b64b03\") " pod="cert-manager/cert-manager-55b4d954d5-8rs6p" Jul 09 13:29:46.516512 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.516365 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6713f26-a263-4e69-b532-5f9031b64b03-bound-sa-token\") pod \"cert-manager-55b4d954d5-8rs6p\" (UID: \"a6713f26-a263-4e69-b532-5f9031b64b03\") " pod="cert-manager/cert-manager-55b4d954d5-8rs6p" Jul 09 13:29:46.608616 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.608591 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw"] Jul 09 13:29:46.610605 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:29:46.610576 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba33b7bd_99d3_4872_81b7_c4874d48d8e2.slice/crio-ae4170573201fa1c9d6ae70405d4dbcec5bdabbf750d4b1774805dae09a0f2ca WatchSource:0}: Error finding container ae4170573201fa1c9d6ae70405d4dbcec5bdabbf750d4b1774805dae09a0f2ca: Status 404 returned error can't find the container with id ae4170573201fa1c9d6ae70405d4dbcec5bdabbf750d4b1774805dae09a0f2ca Jul 09 13:29:46.617340 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.617312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbh8r\" (UniqueName: \"kubernetes.io/projected/a6713f26-a263-4e69-b532-5f9031b64b03-kube-api-access-lbh8r\") pod \"cert-manager-55b4d954d5-8rs6p\" (UID: \"a6713f26-a263-4e69-b532-5f9031b64b03\") " pod="cert-manager/cert-manager-55b4d954d5-8rs6p" Jul 09 13:29:46.617452 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.617368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6713f26-a263-4e69-b532-5f9031b64b03-bound-sa-token\") pod \"cert-manager-55b4d954d5-8rs6p\" (UID: \"a6713f26-a263-4e69-b532-5f9031b64b03\") " pod="cert-manager/cert-manager-55b4d954d5-8rs6p" Jul 09 13:29:46.625534 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.625513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6713f26-a263-4e69-b532-5f9031b64b03-bound-sa-token\") pod \"cert-manager-55b4d954d5-8rs6p\" (UID: \"a6713f26-a263-4e69-b532-5f9031b64b03\") " pod="cert-manager/cert-manager-55b4d954d5-8rs6p" Jul 09 13:29:46.625859 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.625841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbh8r\" (UniqueName: \"kubernetes.io/projected/a6713f26-a263-4e69-b532-5f9031b64b03-kube-api-access-lbh8r\") pod \"cert-manager-55b4d954d5-8rs6p\" (UID: \"a6713f26-a263-4e69-b532-5f9031b64b03\") " pod="cert-manager/cert-manager-55b4d954d5-8rs6p" Jul 09 13:29:46.758379 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.758286 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8rs6p" Jul 09 13:29:46.906203 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:46.906113 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8rs6p"] Jul 09 13:29:46.908608 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:29:46.908579 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6713f26_a263_4e69_b532_5f9031b64b03.slice/crio-fdc77d492444e6bebe692ec109435f08e2afb0ba6200ab01a1769f87c3b5d5cb WatchSource:0}: Error finding container fdc77d492444e6bebe692ec109435f08e2afb0ba6200ab01a1769f87c3b5d5cb: Status 404 returned error can't find the container with id fdc77d492444e6bebe692ec109435f08e2afb0ba6200ab01a1769f87c3b5d5cb Jul 09 13:29:47.318222 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:47.318183 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8rs6p" event={"ID":"a6713f26-a263-4e69-b532-5f9031b64b03","Type":"ContainerStarted","Data":"6321f8898b801933a0a8b774d98b6dd3591b7ae89b9a96e2ff1d5d5ba177177f"} Jul 09 13:29:47.318222 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:47.318231 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8rs6p" event={"ID":"a6713f26-a263-4e69-b532-5f9031b64b03","Type":"ContainerStarted","Data":"fdc77d492444e6bebe692ec109435f08e2afb0ba6200ab01a1769f87c3b5d5cb"} Jul 09 13:29:47.319480 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:47.319444 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw" event={"ID":"ba33b7bd-99d3-4872-81b7-c4874d48d8e2","Type":"ContainerStarted","Data":"ae4170573201fa1c9d6ae70405d4dbcec5bdabbf750d4b1774805dae09a0f2ca"} Jul 09 13:29:47.338417 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:47.338370 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-8rs6p" podStartSLOduration=1.338357491 podStartE2EDuration="1.338357491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:47.337593701 +0000 UTC m=+300.008214860" watchObservedRunningTime="2026-07-09 13:29:47.338357491 +0000 UTC m=+300.008978653" Jul 09 13:29:47.768953 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:47.768881 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 13:29:49.332164 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:49.332130 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw" event={"ID":"ba33b7bd-99d3-4872-81b7-c4874d48d8e2","Type":"ContainerStarted","Data":"b85e0630406511a93be15ec45de6501e1bc87d19397239f863f57509d396d6f2"} Jul 09 13:29:49.350737 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:49.350682 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-td2zw" podStartSLOduration=1.003903591 podStartE2EDuration="3.350667417s" totalImagesPullingTime="2.346763826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:49.350389153 +0000 UTC m=+302.021010315" watchObservedRunningTime="2026-07-09 13:29:49.350667417 +0000 UTC m=+302.021288589" Jul 09 13:29:51.905753 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:51.905725 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72"] Jul 09 13:29:51.925164 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:51.925072 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72"] Jul 09 13:29:51.925337 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:51.925192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:51.927877 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:51.927854 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lb655\"" Jul 09 13:29:51.928014 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:51.927989 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 13:29:51.928100 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:51.928060 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 13:29:51.960050 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:51.960022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:51.960190 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:51.960061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbk9w\" (UniqueName: \"kubernetes.io/projected/cdac4ec3-fb8e-457e-9def-3e8df964a98f-kube-api-access-vbk9w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:51.960190 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:51.960139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:52.061273 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:52.061238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:52.061434 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:52.061279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbk9w\" (UniqueName: \"kubernetes.io/projected/cdac4ec3-fb8e-457e-9def-3e8df964a98f-kube-api-access-vbk9w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:52.061434 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:52.061309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:52.061627 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:52.061611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:52.061693 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:52.061676 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:52.069530 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:52.069505 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbk9w\" (UniqueName: \"kubernetes.io/projected/cdac4ec3-fb8e-457e-9def-3e8df964a98f-kube-api-access-vbk9w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:52.236000 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:52.235921 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:52.388411 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:52.388380 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72"] Jul 09 13:29:52.391058 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:29:52.391032 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdac4ec3_fb8e_457e_9def_3e8df964a98f.slice/crio-813158411a7b548737514055b2d4a08c2b706b5dea105474c83dccf1a7fd6425 WatchSource:0}: Error finding container 813158411a7b548737514055b2d4a08c2b706b5dea105474c83dccf1a7fd6425: Status 404 returned error can't find the container with id 813158411a7b548737514055b2d4a08c2b706b5dea105474c83dccf1a7fd6425 Jul 09 13:29:53.352436 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:53.352352 2577 generic.go:356] "Generic (PLEG): container finished" podID="cdac4ec3-fb8e-457e-9def-3e8df964a98f" containerID="9c5eec48593d4e8374e2232dcbacf4c5adfaf4894bb547239f1e56884508ae7b" exitCode=0 Jul 09 13:29:53.352436 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:53.352402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" event={"ID":"cdac4ec3-fb8e-457e-9def-3e8df964a98f","Type":"ContainerDied","Data":"9c5eec48593d4e8374e2232dcbacf4c5adfaf4894bb547239f1e56884508ae7b"} Jul 09 13:29:53.352835 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:53.352438 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" event={"ID":"cdac4ec3-fb8e-457e-9def-3e8df964a98f","Type":"ContainerStarted","Data":"813158411a7b548737514055b2d4a08c2b706b5dea105474c83dccf1a7fd6425"} Jul 09 13:29:53.353044 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:53.353028 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 13:29:54.359662 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:54.359627 2577 generic.go:356] "Generic (PLEG): container finished" podID="cdac4ec3-fb8e-457e-9def-3e8df964a98f" containerID="aaf53470cec44df58fd92d7e96d84d135c283b7b75a2aac4c82a851694aa0048" exitCode=0 Jul 09 13:29:54.360123 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:54.359696 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" event={"ID":"cdac4ec3-fb8e-457e-9def-3e8df964a98f","Type":"ContainerDied","Data":"aaf53470cec44df58fd92d7e96d84d135c283b7b75a2aac4c82a851694aa0048"} Jul 09 13:29:55.366400 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:55.366368 2577 generic.go:356] "Generic (PLEG): container finished" podID="cdac4ec3-fb8e-457e-9def-3e8df964a98f" containerID="df2ccd858ba84891bc482a16f30cae4dd0386c542e83ad95fea9ee7e33f40f3a" exitCode=0 Jul 09 13:29:55.366789 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:55.366417 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" event={"ID":"cdac4ec3-fb8e-457e-9def-3e8df964a98f","Type":"ContainerDied","Data":"df2ccd858ba84891bc482a16f30cae4dd0386c542e83ad95fea9ee7e33f40f3a"} Jul 09 13:29:56.497841 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:56.497792 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:56.599976 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:56.599946 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-util\") pod \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " Jul 09 13:29:56.600165 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:56.600009 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbk9w\" (UniqueName: \"kubernetes.io/projected/cdac4ec3-fb8e-457e-9def-3e8df964a98f-kube-api-access-vbk9w\") pod \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " Jul 09 13:29:56.600165 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:56.600109 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-bundle\") pod \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\" (UID: \"cdac4ec3-fb8e-457e-9def-3e8df964a98f\") " Jul 09 13:29:56.600746 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:56.600717 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-bundle" (OuterVolumeSpecName: "bundle") pod "cdac4ec3-fb8e-457e-9def-3e8df964a98f" (UID: "cdac4ec3-fb8e-457e-9def-3e8df964a98f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:29:56.602034 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:56.602005 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdac4ec3-fb8e-457e-9def-3e8df964a98f-kube-api-access-vbk9w" (OuterVolumeSpecName: "kube-api-access-vbk9w") pod "cdac4ec3-fb8e-457e-9def-3e8df964a98f" (UID: "cdac4ec3-fb8e-457e-9def-3e8df964a98f"). InnerVolumeSpecName "kube-api-access-vbk9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:29:56.605644 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:56.605622 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-util" (OuterVolumeSpecName: "util") pod "cdac4ec3-fb8e-457e-9def-3e8df964a98f" (UID: "cdac4ec3-fb8e-457e-9def-3e8df964a98f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:29:56.700769 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:56.700677 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-util\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:29:56.700769 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:56.700711 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbk9w\" (UniqueName: \"kubernetes.io/projected/cdac4ec3-fb8e-457e-9def-3e8df964a98f-kube-api-access-vbk9w\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:29:56.700769 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:56.700735 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdac4ec3-fb8e-457e-9def-3e8df964a98f-bundle\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:29:57.378662 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:57.378638 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" Jul 09 13:29:57.378859 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:57.378671 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afx4v72" event={"ID":"cdac4ec3-fb8e-457e-9def-3e8df964a98f","Type":"ContainerDied","Data":"813158411a7b548737514055b2d4a08c2b706b5dea105474c83dccf1a7fd6425"} Jul 09 13:29:57.378859 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:29:57.378718 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="813158411a7b548737514055b2d4a08c2b706b5dea105474c83dccf1a7fd6425" Jul 09 13:30:08.192692 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.192658 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l"] Jul 09 13:30:08.193200 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.193161 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdac4ec3-fb8e-457e-9def-3e8df964a98f" containerName="pull" Jul 09 13:30:08.193200 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.193179 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdac4ec3-fb8e-457e-9def-3e8df964a98f" containerName="pull" Jul 09 13:30:08.193325 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.193206 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdac4ec3-fb8e-457e-9def-3e8df964a98f" containerName="util" Jul 09 13:30:08.193325 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.193215 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdac4ec3-fb8e-457e-9def-3e8df964a98f" containerName="util" Jul 09 13:30:08.193325 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.193234 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdac4ec3-fb8e-457e-9def-3e8df964a98f" containerName="extract" Jul 09 13:30:08.193325 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.193244 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdac4ec3-fb8e-457e-9def-3e8df964a98f" containerName="extract" Jul 09 13:30:08.193522 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.193334 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdac4ec3-fb8e-457e-9def-3e8df964a98f" containerName="extract" Jul 09 13:30:08.196429 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.196410 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.201897 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.201876 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 13:30:08.202074 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.201962 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 13:30:08.202195 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.202099 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 13:30:08.202195 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.202120 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 13:30:08.202195 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.202130 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kp2fp\"" Jul 09 13:30:08.224207 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.224174 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l"] Jul 09 13:30:08.293118 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.293063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ce97c625-8840-42a1-884a-d15b56493a88-manifests\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.293287 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.293177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce97c625-8840-42a1-884a-d15b56493a88-tmp\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.293287 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.293243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce97c625-8840-42a1-884a-d15b56493a88-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.293287 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.293270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9htst\" (UniqueName: \"kubernetes.io/projected/ce97c625-8840-42a1-884a-d15b56493a88-kube-api-access-9htst\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.293409 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.293370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ce97c625-8840-42a1-884a-d15b56493a88-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.394264 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.394223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ce97c625-8840-42a1-884a-d15b56493a88-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.394438 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.394268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ce97c625-8840-42a1-884a-d15b56493a88-manifests\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.394438 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.394322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce97c625-8840-42a1-884a-d15b56493a88-tmp\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.394438 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.394371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce97c625-8840-42a1-884a-d15b56493a88-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.394438 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.394395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9htst\" (UniqueName: \"kubernetes.io/projected/ce97c625-8840-42a1-884a-d15b56493a88-kube-api-access-9htst\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.394783 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.394759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ce97c625-8840-42a1-884a-d15b56493a88-manifests\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.396802 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.396778 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce97c625-8840-42a1-884a-d15b56493a88-tmp\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.396936 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.396870 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ce97c625-8840-42a1-884a-d15b56493a88-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.396936 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.396916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce97c625-8840-42a1-884a-d15b56493a88-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.409010 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.408984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9htst\" (UniqueName: \"kubernetes.io/projected/ce97c625-8840-42a1-884a-d15b56493a88-kube-api-access-9htst\") pod \"opendatahub-operator-controller-manager-78c95977c-rgz4l\" (UID: \"ce97c625-8840-42a1-884a-d15b56493a88\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.507368 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.507268 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:08.649262 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:08.649233 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l"] Jul 09 13:30:08.651010 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:30:08.650966 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce97c625_8840_42a1_884a_d15b56493a88.slice/crio-9a714cc6190a6c687b18a3cb92c6ceca92b5d9391ee22e965f4caad5dd8ae09a WatchSource:0}: Error finding container 9a714cc6190a6c687b18a3cb92c6ceca92b5d9391ee22e965f4caad5dd8ae09a: Status 404 returned error can't find the container with id 9a714cc6190a6c687b18a3cb92c6ceca92b5d9391ee22e965f4caad5dd8ae09a Jul 09 13:30:09.437763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:09.437726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" event={"ID":"ce97c625-8840-42a1-884a-d15b56493a88","Type":"ContainerStarted","Data":"9a714cc6190a6c687b18a3cb92c6ceca92b5d9391ee22e965f4caad5dd8ae09a"} Jul 09 13:30:12.454172 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:12.454137 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" event={"ID":"ce97c625-8840-42a1-884a-d15b56493a88","Type":"ContainerStarted","Data":"cbc32e88e1c10cf1a19b9f7cb77ea4df87c18cccf60fe98f9bb1a35acbf942bd"} Jul 09 13:30:13.468834 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:13.468795 2577 generic.go:356] "Generic (PLEG): container finished" podID="ce97c625-8840-42a1-884a-d15b56493a88" containerID="cbc32e88e1c10cf1a19b9f7cb77ea4df87c18cccf60fe98f9bb1a35acbf942bd" exitCode=0 Jul 09 13:30:13.469328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:13.468881 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" event={"ID":"ce97c625-8840-42a1-884a-d15b56493a88","Type":"ContainerDied","Data":"cbc32e88e1c10cf1a19b9f7cb77ea4df87c18cccf60fe98f9bb1a35acbf942bd"} Jul 09 13:30:14.475205 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:14.475172 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" event={"ID":"ce97c625-8840-42a1-884a-d15b56493a88","Type":"ContainerStarted","Data":"8654c675c29cd7e2799fa21919661a8f8dcf62ccd7eb8f37b08368ef943abdb3"} Jul 09 13:30:14.475656 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:14.475305 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:14.507536 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:14.507479 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" podStartSLOduration=2.26811589 podStartE2EDuration="6.507462596s" totalImagesPullingTime="3.165220642s" totalInitContainerRuntime="1.074126064s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:14.505849841 +0000 UTC m=+327.176471003" watchObservedRunningTime="2026-07-09 13:30:14.507462596 +0000 UTC m=+327.178083758" Jul 09 13:30:25.482510 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:25.482479 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-rgz4l" Jul 09 13:30:28.036294 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.036206 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2gvlq"] Jul 09 13:30:28.044298 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.044275 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" Jul 09 13:30:28.047449 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.047425 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 09 13:30:28.047568 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.047499 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-99jdx\"" Jul 09 13:30:28.052486 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.052466 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2gvlq"] Jul 09 13:30:28.056718 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.056691 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm"] Jul 09 13:30:28.060126 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.060103 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:28.062562 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.062541 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 13:30:28.062665 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.062647 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hkpg9\"" Jul 09 13:30:28.062885 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.062868 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 13:30:28.063056 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.063040 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 13:30:28.063273 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.063257 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 13:30:28.076545 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.076514 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm"] Jul 09 13:30:28.150722 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.150691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-tmp\") pod \"kube-auth-proxy-65b545db8f-2nkjm\" (UID: \"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2\") " pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:28.150900 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.150732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f218686-1a13-4ec5-bc8c-a92c17dcf183-cert\") pod \"odh-model-controller-7998c67dc4-2gvlq\" (UID: \"1f218686-1a13-4ec5-bc8c-a92c17dcf183\") " pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" Jul 09 13:30:28.150900 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.150756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpkx6\" (UniqueName: \"kubernetes.io/projected/1f218686-1a13-4ec5-bc8c-a92c17dcf183-kube-api-access-fpkx6\") pod \"odh-model-controller-7998c67dc4-2gvlq\" (UID: \"1f218686-1a13-4ec5-bc8c-a92c17dcf183\") " pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" Jul 09 13:30:28.150900 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.150860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw678\" (UniqueName: \"kubernetes.io/projected/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-kube-api-access-sw678\") pod \"kube-auth-proxy-65b545db8f-2nkjm\" (UID: \"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2\") " pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:28.150900 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.150895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-tls-certs\") pod \"kube-auth-proxy-65b545db8f-2nkjm\" (UID: \"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2\") " pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:28.251785 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.251752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw678\" (UniqueName: \"kubernetes.io/projected/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-kube-api-access-sw678\") pod \"kube-auth-proxy-65b545db8f-2nkjm\" (UID: \"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2\") " pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:28.251785 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.251788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-tls-certs\") pod \"kube-auth-proxy-65b545db8f-2nkjm\" (UID: \"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2\") " pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:28.252066 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.251807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-tmp\") pod \"kube-auth-proxy-65b545db8f-2nkjm\" (UID: \"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2\") " pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:28.252066 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.251832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f218686-1a13-4ec5-bc8c-a92c17dcf183-cert\") pod \"odh-model-controller-7998c67dc4-2gvlq\" (UID: \"1f218686-1a13-4ec5-bc8c-a92c17dcf183\") " pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" Jul 09 13:30:28.252066 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.251853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpkx6\" (UniqueName: \"kubernetes.io/projected/1f218686-1a13-4ec5-bc8c-a92c17dcf183-kube-api-access-fpkx6\") pod \"odh-model-controller-7998c67dc4-2gvlq\" (UID: \"1f218686-1a13-4ec5-bc8c-a92c17dcf183\") " pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" Jul 09 13:30:28.252066 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:30:28.251938 2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 09 13:30:28.252066 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:30:28.251969 2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 09 13:30:28.252066 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:30:28.252026 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-tls-certs podName:6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:28.752002877 +0000 UTC m=+341.422624017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-tls-certs") pod "kube-auth-proxy-65b545db8f-2nkjm" (UID: "6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2") : secret "kube-auth-proxy-tls" not found Jul 09 13:30:28.252066 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:30:28.252050 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f218686-1a13-4ec5-bc8c-a92c17dcf183-cert podName:1f218686-1a13-4ec5-bc8c-a92c17dcf183 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:28.752037753 +0000 UTC m=+341.422658899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1f218686-1a13-4ec5-bc8c-a92c17dcf183-cert") pod "odh-model-controller-7998c67dc4-2gvlq" (UID: "1f218686-1a13-4ec5-bc8c-a92c17dcf183") : secret "odh-model-controller-webhook-cert" not found Jul 09 13:30:28.254003 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.253987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-tmp\") pod \"kube-auth-proxy-65b545db8f-2nkjm\" (UID: \"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2\") " pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:28.268703 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.268675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpkx6\" (UniqueName: \"kubernetes.io/projected/1f218686-1a13-4ec5-bc8c-a92c17dcf183-kube-api-access-fpkx6\") pod \"odh-model-controller-7998c67dc4-2gvlq\" (UID: \"1f218686-1a13-4ec5-bc8c-a92c17dcf183\") " pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" Jul 09 13:30:28.271575 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.271552 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw678\" (UniqueName: \"kubernetes.io/projected/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-kube-api-access-sw678\") pod \"kube-auth-proxy-65b545db8f-2nkjm\" (UID: \"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2\") " pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:28.755847 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.755813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-tls-certs\") pod \"kube-auth-proxy-65b545db8f-2nkjm\" (UID: \"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2\") " pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:28.756063 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.755858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f218686-1a13-4ec5-bc8c-a92c17dcf183-cert\") pod \"odh-model-controller-7998c67dc4-2gvlq\" (UID: \"1f218686-1a13-4ec5-bc8c-a92c17dcf183\") " pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" Jul 09 13:30:28.758219 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.758196 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2-tls-certs\") pod \"kube-auth-proxy-65b545db8f-2nkjm\" (UID: \"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2\") " pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:28.758316 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.758277 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f218686-1a13-4ec5-bc8c-a92c17dcf183-cert\") pod \"odh-model-controller-7998c67dc4-2gvlq\" (UID: \"1f218686-1a13-4ec5-bc8c-a92c17dcf183\") " pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" Jul 09 13:30:28.954956 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.954914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" Jul 09 13:30:28.969787 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:28.969754 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" Jul 09 13:30:29.022420 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.021858 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl"] Jul 09 13:30:29.030278 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.027466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.033980 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.033622 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 13:30:29.033980 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.033852 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 13:30:29.034855 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.034359 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bzr8b\"" Jul 09 13:30:29.034855 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.034560 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 13:30:29.034855 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.034733 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 13:30:29.039364 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.039306 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl"] Jul 09 13:30:29.109093 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.109033 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2gvlq"] Jul 09 13:30:29.112777 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:30:29.112751 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f218686_1a13_4ec5_bc8c_a92c17dcf183.slice/crio-a358abae214b1d9f61735eabbea579623252adbbf114416fccb81800effca30a WatchSource:0}: Error finding container a358abae214b1d9f61735eabbea579623252adbbf114416fccb81800effca30a: Status 404 returned error can't find the container with id a358abae214b1d9f61735eabbea579623252adbbf114416fccb81800effca30a Jul 09 13:30:29.129663 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.129642 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm"] Jul 09 13:30:29.131237 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:30:29.131217 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cafd6ab_4f7e_4089_949b_9a50dd7ce9d2.slice/crio-8fee02748ecc195d7f38eeb7752b71c47345e47f89063c466a8e98394dc976ad WatchSource:0}: Error finding container 8fee02748ecc195d7f38eeb7752b71c47345e47f89063c466a8e98394dc976ad: Status 404 returned error can't find the container with id 8fee02748ecc195d7f38eeb7752b71c47345e47f89063c466a8e98394dc976ad Jul 09 13:30:29.160557 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.160529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-local-certs\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.160678 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.160565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.160678 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.160586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.160749 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.160686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-cacerts\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.160749 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.160718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpzwf\" (UniqueName: \"kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-kube-api-access-hpzwf\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.160815 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.160783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-token\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.160852 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.160823 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.262069 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.261971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-token\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.262069 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.262020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.262305 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.262102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-local-certs\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.262305 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.262223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.262305 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.262263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.262576 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.262324 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-cacerts\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.262576 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.262347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpzwf\" (UniqueName: \"kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-kube-api-access-hpzwf\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.263000 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.262918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.264846 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.264806 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-local-certs\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.264991 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.264973 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.265187 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.265164 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.265261 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.265164 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-cacerts\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.282979 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.282953 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-token\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.289141 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.289118 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpzwf\" (UniqueName: \"kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-kube-api-access-hpzwf\") pod \"istiod-openshift-gateway-7574459656-lfjnl\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.344583 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.344555 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:29.484703 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.484678 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl"] Jul 09 13:30:29.486907 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:30:29.486882 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f0136a_f544_4fbc_9b0a_aa9ca31a1bab.slice/crio-4d0139834bd2e213c6e60bd0a9ef24dfaf1d1153d28785aa1b2ead4a7915cadc WatchSource:0}: Error finding container 4d0139834bd2e213c6e60bd0a9ef24dfaf1d1153d28785aa1b2ead4a7915cadc: Status 404 returned error can't find the container with id 4d0139834bd2e213c6e60bd0a9ef24dfaf1d1153d28785aa1b2ead4a7915cadc Jul 09 13:30:29.546641 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.546547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" event={"ID":"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab","Type":"ContainerStarted","Data":"4d0139834bd2e213c6e60bd0a9ef24dfaf1d1153d28785aa1b2ead4a7915cadc"} Jul 09 13:30:29.547686 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.547656 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" event={"ID":"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2","Type":"ContainerStarted","Data":"8fee02748ecc195d7f38eeb7752b71c47345e47f89063c466a8e98394dc976ad"} Jul 09 13:30:29.548689 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:29.548665 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" event={"ID":"1f218686-1a13-4ec5-bc8c-a92c17dcf183","Type":"ContainerStarted","Data":"a358abae214b1d9f61735eabbea579623252adbbf114416fccb81800effca30a"} Jul 09 13:30:34.048619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:34.048583 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 13:30:34.048912 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:34.048665 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 13:30:34.580975 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:34.580932 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" event={"ID":"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab","Type":"ContainerStarted","Data":"8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57"} Jul 09 13:30:34.581213 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:34.581066 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:34.582524 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:34.582496 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" event={"ID":"6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2","Type":"ContainerStarted","Data":"2908fa2dc2578db8f75b4a8a5cbfb1ba08ddbb63bd5cb73503e74834cd45e65a"} Jul 09 13:30:34.583968 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:34.583948 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" event={"ID":"1f218686-1a13-4ec5-bc8c-a92c17dcf183","Type":"ContainerStarted","Data":"9dd11a41c6352b9d8b8095e803117f65f02720c81fa1c4a902b2647fe06199ef"} Jul 09 13:30:34.584060 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:34.584033 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" Jul 09 13:30:34.604008 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:34.603951 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" podStartSLOduration=1.044576782 podStartE2EDuration="5.603935352s" totalImagesPullingTime="4.55935857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:34.601569201 +0000 UTC m=+347.272190363" watchObservedRunningTime="2026-07-09 13:30:34.603935352 +0000 UTC m=+347.274556514" Jul 09 13:30:34.620448 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:34.620397 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" podStartSLOduration=1.676582196 podStartE2EDuration="6.620380099s" totalImagesPullingTime="4.943797903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:34.618235899 +0000 UTC m=+347.288857062" watchObservedRunningTime="2026-07-09 13:30:34.620380099 +0000 UTC m=+347.291001260" Jul 09 13:30:34.640188 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:34.640133 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65b545db8f-2nkjm" podStartSLOduration=1.726946843 podStartE2EDuration="6.640116188s" totalImagesPullingTime="4.913169345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:34.6378009 +0000 UTC m=+347.308422074" watchObservedRunningTime="2026-07-09 13:30:34.640116188 +0000 UTC m=+347.310737349" Jul 09 13:30:35.591821 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:35.591781 2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-lfjnl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 13:30:35.592328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:35.591840 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" podUID="30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 13:30:38.590883 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:38.590854 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:39.573966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.573932 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8"] Jul 09 13:30:39.576873 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.576857 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" Jul 09 13:30:39.589207 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.589178 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 13:30:39.589353 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.589328 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9d594\"" Jul 09 13:30:39.592247 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.592224 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq"] Jul 09 13:30:39.595444 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.595428 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" Jul 09 13:30:39.598051 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.598028 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 09 13:30:39.598204 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.598150 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zwjh2\"" Jul 09 13:30:39.600430 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.600407 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8"] Jul 09 13:30:39.613595 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.613560 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq"] Jul 09 13:30:39.659552 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.659516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4c9c45d-617b-427b-bdf9-04ae8c8d6c33-cert\") pod \"kserve-controller-manager-d6f4b65b8-rcnh8\" (UID: \"b4c9c45d-617b-427b-bdf9-04ae8c8d6c33\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" Jul 09 13:30:39.659717 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.659577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6b5a664-fb48-48af-a48b-4be3ced29aaa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x8ctq\" (UID: \"a6b5a664-fb48-48af-a48b-4be3ced29aaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" Jul 09 13:30:39.659717 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.659620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d926m\" (UniqueName: \"kubernetes.io/projected/b4c9c45d-617b-427b-bdf9-04ae8c8d6c33-kube-api-access-d926m\") pod \"kserve-controller-manager-d6f4b65b8-rcnh8\" (UID: \"b4c9c45d-617b-427b-bdf9-04ae8c8d6c33\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" Jul 09 13:30:39.659717 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.659643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh9zs\" (UniqueName: \"kubernetes.io/projected/a6b5a664-fb48-48af-a48b-4be3ced29aaa-kube-api-access-jh9zs\") pod \"llmisvc-controller-manager-777c6bd7d5-x8ctq\" (UID: \"a6b5a664-fb48-48af-a48b-4be3ced29aaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" Jul 09 13:30:39.760832 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.760797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4c9c45d-617b-427b-bdf9-04ae8c8d6c33-cert\") pod \"kserve-controller-manager-d6f4b65b8-rcnh8\" (UID: \"b4c9c45d-617b-427b-bdf9-04ae8c8d6c33\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" Jul 09 13:30:39.760996 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.760855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6b5a664-fb48-48af-a48b-4be3ced29aaa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x8ctq\" (UID: \"a6b5a664-fb48-48af-a48b-4be3ced29aaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" Jul 09 13:30:39.760996 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.760880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d926m\" (UniqueName: \"kubernetes.io/projected/b4c9c45d-617b-427b-bdf9-04ae8c8d6c33-kube-api-access-d926m\") pod \"kserve-controller-manager-d6f4b65b8-rcnh8\" (UID: \"b4c9c45d-617b-427b-bdf9-04ae8c8d6c33\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" Jul 09 13:30:39.760996 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.760900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh9zs\" (UniqueName: \"kubernetes.io/projected/a6b5a664-fb48-48af-a48b-4be3ced29aaa-kube-api-access-jh9zs\") pod \"llmisvc-controller-manager-777c6bd7d5-x8ctq\" (UID: \"a6b5a664-fb48-48af-a48b-4be3ced29aaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" Jul 09 13:30:39.760996 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:30:39.760958 2577 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 09 13:30:39.760996 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:30:39.760983 2577 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 09 13:30:39.761234 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:30:39.761045 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c9c45d-617b-427b-bdf9-04ae8c8d6c33-cert podName:b4c9c45d-617b-427b-bdf9-04ae8c8d6c33 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:40.261024598 +0000 UTC m=+352.931645746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b4c9c45d-617b-427b-bdf9-04ae8c8d6c33-cert") pod "kserve-controller-manager-d6f4b65b8-rcnh8" (UID: "b4c9c45d-617b-427b-bdf9-04ae8c8d6c33") : secret "kserve-webhook-server-cert" not found Jul 09 13:30:39.761234 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:30:39.761059 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b5a664-fb48-48af-a48b-4be3ced29aaa-cert podName:a6b5a664-fb48-48af-a48b-4be3ced29aaa nodeName:}" failed. No retries permitted until 2026-07-09 13:30:40.261053093 +0000 UTC m=+352.931674233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a6b5a664-fb48-48af-a48b-4be3ced29aaa-cert") pod "llmisvc-controller-manager-777c6bd7d5-x8ctq" (UID: "a6b5a664-fb48-48af-a48b-4be3ced29aaa") : secret "llmisvc-webhook-server-cert" not found Jul 09 13:30:39.772639 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.772603 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d926m\" (UniqueName: \"kubernetes.io/projected/b4c9c45d-617b-427b-bdf9-04ae8c8d6c33-kube-api-access-d926m\") pod \"kserve-controller-manager-d6f4b65b8-rcnh8\" (UID: \"b4c9c45d-617b-427b-bdf9-04ae8c8d6c33\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" Jul 09 13:30:39.773053 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:39.773028 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh9zs\" (UniqueName: \"kubernetes.io/projected/a6b5a664-fb48-48af-a48b-4be3ced29aaa-kube-api-access-jh9zs\") pod \"llmisvc-controller-manager-777c6bd7d5-x8ctq\" (UID: \"a6b5a664-fb48-48af-a48b-4be3ced29aaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" Jul 09 13:30:40.265136 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:40.265098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4c9c45d-617b-427b-bdf9-04ae8c8d6c33-cert\") pod \"kserve-controller-manager-d6f4b65b8-rcnh8\" (UID: \"b4c9c45d-617b-427b-bdf9-04ae8c8d6c33\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" Jul 09 13:30:40.265315 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:40.265158 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6b5a664-fb48-48af-a48b-4be3ced29aaa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x8ctq\" (UID: \"a6b5a664-fb48-48af-a48b-4be3ced29aaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" Jul 09 13:30:40.267609 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:40.267585 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4c9c45d-617b-427b-bdf9-04ae8c8d6c33-cert\") pod \"kserve-controller-manager-d6f4b65b8-rcnh8\" (UID: \"b4c9c45d-617b-427b-bdf9-04ae8c8d6c33\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" Jul 09 13:30:40.267698 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:40.267677 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6b5a664-fb48-48af-a48b-4be3ced29aaa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x8ctq\" (UID: \"a6b5a664-fb48-48af-a48b-4be3ced29aaa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" Jul 09 13:30:40.487298 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:40.487258 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" Jul 09 13:30:40.507607 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:40.507577 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" Jul 09 13:30:40.663268 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:40.663233 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8"] Jul 09 13:30:40.664440 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:30:40.664414 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c9c45d_617b_427b_bdf9_04ae8c8d6c33.slice/crio-d490f4a02b7ba8a83b5a1b895f4d226392867935ceda62eaae4401ddaaed5c55 WatchSource:0}: Error finding container d490f4a02b7ba8a83b5a1b895f4d226392867935ceda62eaae4401ddaaed5c55: Status 404 returned error can't find the container with id d490f4a02b7ba8a83b5a1b895f4d226392867935ceda62eaae4401ddaaed5c55 Jul 09 13:30:40.718432 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:40.718407 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq"] Jul 09 13:30:40.719641 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:30:40.719615 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda6b5a664_fb48_48af_a48b_4be3ced29aaa.slice/crio-2f08fa9a072a0a76a13306e5deb2b7b67ce084e311b32223ba95f3e0fa8196f2 WatchSource:0}: Error finding container 2f08fa9a072a0a76a13306e5deb2b7b67ce084e311b32223ba95f3e0fa8196f2: Status 404 returned error can't find the container with id 2f08fa9a072a0a76a13306e5deb2b7b67ce084e311b32223ba95f3e0fa8196f2 Jul 09 13:30:41.627405 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:41.627367 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" event={"ID":"b4c9c45d-617b-427b-bdf9-04ae8c8d6c33","Type":"ContainerStarted","Data":"d490f4a02b7ba8a83b5a1b895f4d226392867935ceda62eaae4401ddaaed5c55"} Jul 09 13:30:41.628557 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:41.628527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" event={"ID":"a6b5a664-fb48-48af-a48b-4be3ced29aaa","Type":"ContainerStarted","Data":"2f08fa9a072a0a76a13306e5deb2b7b67ce084e311b32223ba95f3e0fa8196f2"} Jul 09 13:30:41.684209 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:41.684179 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl"] Jul 09 13:30:41.684631 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:41.684411 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" podUID="30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" containerName="discovery" containerID="cri-o://8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57" gracePeriod=30 Jul 09 13:30:42.024853 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.024585 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:42.083557 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.083534 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-local-certs\") pod \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " Jul 09 13:30:42.083712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.083618 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpzwf\" (UniqueName: \"kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-kube-api-access-hpzwf\") pod \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " Jul 09 13:30:42.083712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.083652 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-dns-cert\") pod \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " Jul 09 13:30:42.083712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.083697 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-token\") pod \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " Jul 09 13:30:42.083881 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.083725 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-cacerts\") pod \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " Jul 09 13:30:42.083881 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.083780 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-ca-configmap\") pod \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " Jul 09 13:30:42.083881 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.083805 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-kubeconfig\") pod \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\" (UID: \"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab\") " Jul 09 13:30:42.084585 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.084552 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" (UID: "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:30:42.086333 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.086297 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" (UID: "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:30:42.086683 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.086592 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-local-certs" (OuterVolumeSpecName: "local-certs") pod "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" (UID: "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:30:42.086683 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.086625 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-token" (OuterVolumeSpecName: "istio-token") pod "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" (UID: "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:30:42.086683 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.086639 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" (UID: "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:30:42.086683 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.086662 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-kube-api-access-hpzwf" (OuterVolumeSpecName: "kube-api-access-hpzwf") pod "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" (UID: "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab"). InnerVolumeSpecName "kube-api-access-hpzwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:30:42.087217 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.087194 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-cacerts" (OuterVolumeSpecName: "cacerts") pod "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" (UID: "30f0136a-f544-4fbc-9b0a-aa9ca31a1bab"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:30:42.184960 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.184895 2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-dns-cert\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:30:42.184960 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.184927 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-token\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:30:42.184960 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.184938 2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-cacerts\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:30:42.184960 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.184946 2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-csr-ca-configmap\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:30:42.184960 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.184954 2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-istio-kubeconfig\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:30:42.184960 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.184963 2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-local-certs\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:30:42.185259 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.184971 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpzwf\" (UniqueName: \"kubernetes.io/projected/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab-kube-api-access-hpzwf\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:30:42.635107 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.635059 2577 generic.go:356] "Generic (PLEG): container finished" podID="30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" containerID="8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57" exitCode=0 Jul 09 13:30:42.635271 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.635115 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" Jul 09 13:30:42.635271 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.635142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" event={"ID":"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab","Type":"ContainerDied","Data":"8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57"} Jul 09 13:30:42.635271 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.635213 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl" event={"ID":"30f0136a-f544-4fbc-9b0a-aa9ca31a1bab","Type":"ContainerDied","Data":"4d0139834bd2e213c6e60bd0a9ef24dfaf1d1153d28785aa1b2ead4a7915cadc"} Jul 09 13:30:42.635271 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.635234 2577 scope.go:117] "RemoveContainer" containerID="8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57" Jul 09 13:30:42.646239 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.646214 2577 scope.go:117] "RemoveContainer" containerID="8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57" Jul 09 13:30:42.646535 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:30:42.646511 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57\": container with ID starting with 8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57 not found: ID does not exist" containerID="8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57" Jul 09 13:30:42.646607 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.646547 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57"} err="failed to get container status \"8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57\": rpc error: code = NotFound desc = could not find container \"8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57\": container with ID starting with 8dabec426702f862c3cf05ce6c3118599da292d9bce55d272de4b20852c07f57 not found: ID does not exist" Jul 09 13:30:42.665470 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.665445 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl"] Jul 09 13:30:42.667594 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:42.667572 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-lfjnl"] Jul 09 13:30:43.910346 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:43.910317 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" path="/var/lib/kubelet/pods/30f0136a-f544-4fbc-9b0a-aa9ca31a1bab/volumes" Jul 09 13:30:44.647009 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:44.646978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" event={"ID":"b4c9c45d-617b-427b-bdf9-04ae8c8d6c33","Type":"ContainerStarted","Data":"91084f6407cdb71cb8006ad9f40fea5b9cceaf04c44b6b7d9ed45f735ac5ef9c"} Jul 09 13:30:44.647149 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:44.647132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" Jul 09 13:30:44.648491 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:44.648470 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" event={"ID":"a6b5a664-fb48-48af-a48b-4be3ced29aaa","Type":"ContainerStarted","Data":"68d2f01c1ee7eb8b7dc384b9129ebe6d396eefd13a29704c6318b5fc67e70a97"} Jul 09 13:30:44.648581 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:44.648528 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" Jul 09 13:30:44.666533 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:44.666490 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" podStartSLOduration=2.639408688 podStartE2EDuration="5.666477713s" totalImagesPullingTime="3.027069025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:44.664622006 +0000 UTC m=+357.335243167" watchObservedRunningTime="2026-07-09 13:30:44.666477713 +0000 UTC m=+357.337098874" Jul 09 13:30:44.686642 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:44.686602 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" podStartSLOduration=1.879770108 podStartE2EDuration="5.686588738s" totalImagesPullingTime="3.80681863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:44.68542329 +0000 UTC m=+357.356044451" watchObservedRunningTime="2026-07-09 13:30:44.686588738 +0000 UTC m=+357.357209918" Jul 09 13:30:45.592040 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:30:45.592005 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2gvlq" Jul 09 13:31:15.655350 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:15.655314 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8ctq" Jul 09 13:31:15.658760 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:15.658739 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rcnh8" Jul 09 13:31:28.868487 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:28.868449 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kf76r"] Jul 09 13:31:28.869144 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:28.868853 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" containerName="discovery" Jul 09 13:31:28.869144 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:28.868871 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" containerName="discovery" Jul 09 13:31:28.869144 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:28.868977 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f0136a-f544-4fbc-9b0a-aa9ca31a1bab" containerName="discovery" Jul 09 13:31:28.874059 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:28.874036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kf76r" Jul 09 13:31:28.877053 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:28.877028 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 13:31:28.877957 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:28.877939 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 13:31:28.877957 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:28.877948 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-m6r2g\"" Jul 09 13:31:28.883804 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:28.883673 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kf76r"] Jul 09 13:31:28.958655 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:28.958621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49l7m\" (UniqueName: \"kubernetes.io/projected/c057951d-70e9-4530-be69-7df2fe6d1947-kube-api-access-49l7m\") pod \"kuadrant-operator-catalog-kf76r\" (UID: \"c057951d-70e9-4530-be69-7df2fe6d1947\") " pod="kuadrant-system/kuadrant-operator-catalog-kf76r" Jul 09 13:31:29.060176 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:29.060128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49l7m\" (UniqueName: \"kubernetes.io/projected/c057951d-70e9-4530-be69-7df2fe6d1947-kube-api-access-49l7m\") pod \"kuadrant-operator-catalog-kf76r\" (UID: \"c057951d-70e9-4530-be69-7df2fe6d1947\") " pod="kuadrant-system/kuadrant-operator-catalog-kf76r" Jul 09 13:31:29.068780 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:29.068756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49l7m\" (UniqueName: \"kubernetes.io/projected/c057951d-70e9-4530-be69-7df2fe6d1947-kube-api-access-49l7m\") pod \"kuadrant-operator-catalog-kf76r\" (UID: \"c057951d-70e9-4530-be69-7df2fe6d1947\") " pod="kuadrant-system/kuadrant-operator-catalog-kf76r" Jul 09 13:31:29.187824 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:29.187726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kf76r" Jul 09 13:31:29.328585 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:29.328559 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kf76r"] Jul 09 13:31:29.330342 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:31:29.330316 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc057951d_70e9_4530_be69_7df2fe6d1947.slice/crio-2d5a70ec0d12f7bc319da9c690df3a766e3096fa9c391cf96c87451dcf6c47d2 WatchSource:0}: Error finding container 2d5a70ec0d12f7bc319da9c690df3a766e3096fa9c391cf96c87451dcf6c47d2: Status 404 returned error can't find the container with id 2d5a70ec0d12f7bc319da9c690df3a766e3096fa9c391cf96c87451dcf6c47d2 Jul 09 13:31:29.864255 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:29.864219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kf76r" event={"ID":"c057951d-70e9-4530-be69-7df2fe6d1947","Type":"ContainerStarted","Data":"2d5a70ec0d12f7bc319da9c690df3a766e3096fa9c391cf96c87451dcf6c47d2"} Jul 09 13:31:31.877292 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:31.877261 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kf76r" event={"ID":"c057951d-70e9-4530-be69-7df2fe6d1947","Type":"ContainerStarted","Data":"e08b584bb574b65a1160be64840b4c5c5baaef257453308908535e960a49f6c8"} Jul 09 13:31:39.188845 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:39.188806 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kf76r" Jul 09 13:31:39.189343 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:39.188867 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kf76r" Jul 09 13:31:39.211673 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:39.211650 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kf76r" Jul 09 13:31:39.230218 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:39.230171 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kf76r" podStartSLOduration=8.892629332 podStartE2EDuration="11.230151826s" totalImagesPullingTime="2.337522494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:31:31.893669891 +0000 UTC m=+404.564291052" watchObservedRunningTime="2026-07-09 13:31:39.230151826 +0000 UTC m=+411.900772988" Jul 09 13:31:39.937197 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:39.937168 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kf76r" Jul 09 13:31:42.906130 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:42.906095 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z"] Jul 09 13:31:42.909756 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:42.909739 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:42.912518 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:42.912497 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lh4gm\"" Jul 09 13:31:42.919319 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:42.919300 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z"] Jul 09 13:31:42.984137 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:42.984095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ppbs\" (UniqueName: \"kubernetes.io/projected/12447412-03d7-40fc-ae52-ea853128719a-kube-api-access-4ppbs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:42.984332 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:42.984149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:42.984332 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:42.984195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:43.085507 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.085469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ppbs\" (UniqueName: \"kubernetes.io/projected/12447412-03d7-40fc-ae52-ea853128719a-kube-api-access-4ppbs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:43.085507 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.085510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:43.085722 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.085545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:43.085866 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.085851 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:43.085912 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.085888 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:43.095390 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.095361 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ppbs\" (UniqueName: \"kubernetes.io/projected/12447412-03d7-40fc-ae52-ea853128719a-kube-api-access-4ppbs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:43.219865 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.219777 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:43.353159 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.353131 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z"] Jul 09 13:31:43.355336 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:31:43.355306 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12447412_03d7_40fc_ae52_ea853128719a.slice/crio-e082d279b6a3bbea815b4d6d95858a0f7f942e1a07a5e14c0dd1457323b77d5d WatchSource:0}: Error finding container e082d279b6a3bbea815b4d6d95858a0f7f942e1a07a5e14c0dd1457323b77d5d: Status 404 returned error can't find the container with id e082d279b6a3bbea815b4d6d95858a0f7f942e1a07a5e14c0dd1457323b77d5d Jul 09 13:31:43.502013 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.501983 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5"] Jul 09 13:31:43.505479 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.505464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:43.515445 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.515421 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5"] Jul 09 13:31:43.590778 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.590738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:43.590964 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.590785 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:43.590964 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.590868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8bqd\" (UniqueName: \"kubernetes.io/projected/893f201e-fbf2-421c-87ef-2a503e211a79-kube-api-access-g8bqd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:43.692280 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.692243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:43.692453 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.692294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:43.692453 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.692328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8bqd\" (UniqueName: \"kubernetes.io/projected/893f201e-fbf2-421c-87ef-2a503e211a79-kube-api-access-g8bqd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:43.692735 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.692709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:43.692800 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.692734 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:43.701928 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.701908 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8bqd\" (UniqueName: \"kubernetes.io/projected/893f201e-fbf2-421c-87ef-2a503e211a79-kube-api-access-g8bqd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:43.844090 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.844047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:43.938183 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.938145 2577 generic.go:356] "Generic (PLEG): container finished" podID="12447412-03d7-40fc-ae52-ea853128719a" containerID="b6620f6f3fa6cf46042f744dcb6322b95e88bbf0fc3256d67e6b8d31b7dcb978" exitCode=0 Jul 09 13:31:43.938707 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.938205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" event={"ID":"12447412-03d7-40fc-ae52-ea853128719a","Type":"ContainerDied","Data":"b6620f6f3fa6cf46042f744dcb6322b95e88bbf0fc3256d67e6b8d31b7dcb978"} Jul 09 13:31:43.938841 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:43.938755 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" event={"ID":"12447412-03d7-40fc-ae52-ea853128719a","Type":"ContainerStarted","Data":"e082d279b6a3bbea815b4d6d95858a0f7f942e1a07a5e14c0dd1457323b77d5d"} Jul 09 13:31:44.010925 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.010901 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5"] Jul 09 13:31:44.012516 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:31:44.012486 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893f201e_fbf2_421c_87ef_2a503e211a79.slice/crio-145877c4d4721b55d243c80355ced0e3ee7fcc39328a1a5ddced4bfd10f87603 WatchSource:0}: Error finding container 145877c4d4721b55d243c80355ced0e3ee7fcc39328a1a5ddced4bfd10f87603: Status 404 returned error can't find the container with id 145877c4d4721b55d243c80355ced0e3ee7fcc39328a1a5ddced4bfd10f87603 Jul 09 13:31:44.105160 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.105126 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw"] Jul 09 13:31:44.109121 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.109071 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:44.119187 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.119161 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw"] Jul 09 13:31:44.196225 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.196199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr6vt\" (UniqueName: \"kubernetes.io/projected/78f98841-6d61-478a-a5e6-b82bf94b703f-kube-api-access-mr6vt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:44.196349 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.196246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:44.196349 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.196336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:44.297526 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.297493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:44.297667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.297549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:44.297667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.297601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr6vt\" (UniqueName: \"kubernetes.io/projected/78f98841-6d61-478a-a5e6-b82bf94b703f-kube-api-access-mr6vt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:44.297932 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.297914 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:44.298003 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.297987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:44.307487 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.307454 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr6vt\" (UniqueName: \"kubernetes.io/projected/78f98841-6d61-478a-a5e6-b82bf94b703f-kube-api-access-mr6vt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:44.476932 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.476840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:44.502507 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.502480 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6"] Jul 09 13:31:44.506446 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.506428 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:44.516650 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.516623 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6"] Jul 09 13:31:44.599949 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.599915 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:44.600182 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.600027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:44.600182 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.600121 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcfjl\" (UniqueName: \"kubernetes.io/projected/8de75634-822c-474f-9d3d-8a4a813a72df-kube-api-access-jcfjl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:44.613625 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.613601 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw"] Jul 09 13:31:44.615210 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:31:44.615184 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f98841_6d61_478a_a5e6_b82bf94b703f.slice/crio-86b00336eb512d91d08f62551dec18e837a633898ad499f09cf1b636668dcb86 WatchSource:0}: Error finding container 86b00336eb512d91d08f62551dec18e837a633898ad499f09cf1b636668dcb86: Status 404 returned error can't find the container with id 86b00336eb512d91d08f62551dec18e837a633898ad499f09cf1b636668dcb86 Jul 09 13:31:44.701025 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.700983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:44.701213 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.701039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfjl\" (UniqueName: \"kubernetes.io/projected/8de75634-822c-474f-9d3d-8a4a813a72df-kube-api-access-jcfjl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:44.701213 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.701121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:44.701542 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.701512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:44.701587 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.701520 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:44.710324 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.710300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcfjl\" (UniqueName: \"kubernetes.io/projected/8de75634-822c-474f-9d3d-8a4a813a72df-kube-api-access-jcfjl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:44.817636 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.817606 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:44.945038 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.944985 2577 generic.go:356] "Generic (PLEG): container finished" podID="893f201e-fbf2-421c-87ef-2a503e211a79" containerID="f2783d0acb58893bf60057afbf69df992ebf39e6b8517e01f928268688721351" exitCode=0 Jul 09 13:31:44.945391 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.945042 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" event={"ID":"893f201e-fbf2-421c-87ef-2a503e211a79","Type":"ContainerDied","Data":"f2783d0acb58893bf60057afbf69df992ebf39e6b8517e01f928268688721351"} Jul 09 13:31:44.945391 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.945120 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" event={"ID":"893f201e-fbf2-421c-87ef-2a503e211a79","Type":"ContainerStarted","Data":"145877c4d4721b55d243c80355ced0e3ee7fcc39328a1a5ddced4bfd10f87603"} Jul 09 13:31:44.946785 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.946764 2577 generic.go:356] "Generic (PLEG): container finished" podID="78f98841-6d61-478a-a5e6-b82bf94b703f" containerID="8197ea7a64d1ea2feddb2310fc4d3c6840f981241d73975908d4b99e1258b54a" exitCode=0 Jul 09 13:31:44.946891 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.946796 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" event={"ID":"78f98841-6d61-478a-a5e6-b82bf94b703f","Type":"ContainerDied","Data":"8197ea7a64d1ea2feddb2310fc4d3c6840f981241d73975908d4b99e1258b54a"} Jul 09 13:31:44.946891 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.946832 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" event={"ID":"78f98841-6d61-478a-a5e6-b82bf94b703f","Type":"ContainerStarted","Data":"86b00336eb512d91d08f62551dec18e837a633898ad499f09cf1b636668dcb86"} Jul 09 13:31:44.958528 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:44.958504 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6"] Jul 09 13:31:44.959936 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:31:44.959913 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de75634_822c_474f_9d3d_8a4a813a72df.slice/crio-59d6c4c5b2365efbd6c21a667bb0022d4bf71764849f03cbc507b815b27e5bae WatchSource:0}: Error finding container 59d6c4c5b2365efbd6c21a667bb0022d4bf71764849f03cbc507b815b27e5bae: Status 404 returned error can't find the container with id 59d6c4c5b2365efbd6c21a667bb0022d4bf71764849f03cbc507b815b27e5bae Jul 09 13:31:45.953726 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:45.953699 2577 generic.go:356] "Generic (PLEG): container finished" podID="12447412-03d7-40fc-ae52-ea853128719a" containerID="60b4fae62f5c56ee20062ce01e3f97f73ae0976d40f07d24f93787ae9498c1aa" exitCode=0 Jul 09 13:31:45.954130 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:45.953769 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" event={"ID":"12447412-03d7-40fc-ae52-ea853128719a","Type":"ContainerDied","Data":"60b4fae62f5c56ee20062ce01e3f97f73ae0976d40f07d24f93787ae9498c1aa"} Jul 09 13:31:45.955361 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:45.955336 2577 generic.go:356] "Generic (PLEG): container finished" podID="8de75634-822c-474f-9d3d-8a4a813a72df" containerID="1d18428700b8b4c6e8453987c31c0fa48ecdc3f25d883b2101be1c04c0bdbc6b" exitCode=0 Jul 09 13:31:45.955444 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:45.955419 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" event={"ID":"8de75634-822c-474f-9d3d-8a4a813a72df","Type":"ContainerDied","Data":"1d18428700b8b4c6e8453987c31c0fa48ecdc3f25d883b2101be1c04c0bdbc6b"} Jul 09 13:31:45.955487 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:45.955474 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" event={"ID":"8de75634-822c-474f-9d3d-8a4a813a72df","Type":"ContainerStarted","Data":"59d6c4c5b2365efbd6c21a667bb0022d4bf71764849f03cbc507b815b27e5bae"} Jul 09 13:31:45.957357 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:45.957338 2577 generic.go:356] "Generic (PLEG): container finished" podID="78f98841-6d61-478a-a5e6-b82bf94b703f" containerID="de5ac6678f3113eb8a38d9d5d78faec4bb6ce0397f13c74c1584d55d02a3e6e2" exitCode=0 Jul 09 13:31:45.957466 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:45.957446 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" event={"ID":"78f98841-6d61-478a-a5e6-b82bf94b703f","Type":"ContainerDied","Data":"de5ac6678f3113eb8a38d9d5d78faec4bb6ce0397f13c74c1584d55d02a3e6e2"} Jul 09 13:31:45.959487 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:45.959468 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" event={"ID":"893f201e-fbf2-421c-87ef-2a503e211a79","Type":"ContainerStarted","Data":"c3f99ddfd9c59da9ca08f7dc8901f11305d31539f442ce4aa0803b0526c46301"} Jul 09 13:31:46.966406 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:46.966368 2577 generic.go:356] "Generic (PLEG): container finished" podID="893f201e-fbf2-421c-87ef-2a503e211a79" containerID="c3f99ddfd9c59da9ca08f7dc8901f11305d31539f442ce4aa0803b0526c46301" exitCode=0 Jul 09 13:31:46.966868 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:46.966454 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" event={"ID":"893f201e-fbf2-421c-87ef-2a503e211a79","Type":"ContainerDied","Data":"c3f99ddfd9c59da9ca08f7dc8901f11305d31539f442ce4aa0803b0526c46301"} Jul 09 13:31:46.968794 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:46.968764 2577 generic.go:356] "Generic (PLEG): container finished" podID="12447412-03d7-40fc-ae52-ea853128719a" containerID="bd58345df8da6e9d4d5e25203d9dbd04c41e42522662b2475d94653f03e3497e" exitCode=0 Jul 09 13:31:46.968894 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:46.968838 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" event={"ID":"12447412-03d7-40fc-ae52-ea853128719a","Type":"ContainerDied","Data":"bd58345df8da6e9d4d5e25203d9dbd04c41e42522662b2475d94653f03e3497e"} Jul 09 13:31:46.970576 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:46.970556 2577 generic.go:356] "Generic (PLEG): container finished" podID="8de75634-822c-474f-9d3d-8a4a813a72df" containerID="14ac1831796866d9b0574f13cb9facb1f7b518564463a3409ed155264a3509c6" exitCode=0 Jul 09 13:31:46.970653 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:46.970635 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" event={"ID":"8de75634-822c-474f-9d3d-8a4a813a72df","Type":"ContainerDied","Data":"14ac1831796866d9b0574f13cb9facb1f7b518564463a3409ed155264a3509c6"} Jul 09 13:31:46.972806 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:46.972786 2577 generic.go:356] "Generic (PLEG): container finished" podID="78f98841-6d61-478a-a5e6-b82bf94b703f" containerID="91330d1a48b5f5b48b9d5320c31ccb9287a5744a57f8aac1d7286530d30c06ed" exitCode=0 Jul 09 13:31:46.972901 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:46.972873 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" event={"ID":"78f98841-6d61-478a-a5e6-b82bf94b703f","Type":"ContainerDied","Data":"91330d1a48b5f5b48b9d5320c31ccb9287a5744a57f8aac1d7286530d30c06ed"} Jul 09 13:31:47.980479 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:47.980441 2577 generic.go:356] "Generic (PLEG): container finished" podID="893f201e-fbf2-421c-87ef-2a503e211a79" containerID="e87dada0454cff246322d9547a4b6c09d39b5ea5605a0ed9f726cd71b91536a1" exitCode=0 Jul 09 13:31:47.980946 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:47.980515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" event={"ID":"893f201e-fbf2-421c-87ef-2a503e211a79","Type":"ContainerDied","Data":"e87dada0454cff246322d9547a4b6c09d39b5ea5605a0ed9f726cd71b91536a1"} Jul 09 13:31:47.982697 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:47.982670 2577 generic.go:356] "Generic (PLEG): container finished" podID="8de75634-822c-474f-9d3d-8a4a813a72df" containerID="1efec6d6d2329c85154ceebce4459f82f435de5901d3445bf5783b6318b29cde" exitCode=0 Jul 09 13:31:47.982818 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:47.982754 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" event={"ID":"8de75634-822c-474f-9d3d-8a4a813a72df","Type":"ContainerDied","Data":"1efec6d6d2329c85154ceebce4459f82f435de5901d3445bf5783b6318b29cde"} Jul 09 13:31:48.119781 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.119755 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:48.153835 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.153812 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:48.234172 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.233172 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr6vt\" (UniqueName: \"kubernetes.io/projected/78f98841-6d61-478a-a5e6-b82bf94b703f-kube-api-access-mr6vt\") pod \"78f98841-6d61-478a-a5e6-b82bf94b703f\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " Jul 09 13:31:48.234172 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.233230 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-util\") pod \"78f98841-6d61-478a-a5e6-b82bf94b703f\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " Jul 09 13:31:48.234172 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.233265 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-bundle\") pod \"12447412-03d7-40fc-ae52-ea853128719a\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " Jul 09 13:31:48.234172 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.233307 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-util\") pod \"12447412-03d7-40fc-ae52-ea853128719a\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " Jul 09 13:31:48.234172 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.233342 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-bundle\") pod \"78f98841-6d61-478a-a5e6-b82bf94b703f\" (UID: \"78f98841-6d61-478a-a5e6-b82bf94b703f\") " Jul 09 13:31:48.234172 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.233387 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ppbs\" (UniqueName: \"kubernetes.io/projected/12447412-03d7-40fc-ae52-ea853128719a-kube-api-access-4ppbs\") pod \"12447412-03d7-40fc-ae52-ea853128719a\" (UID: \"12447412-03d7-40fc-ae52-ea853128719a\") " Jul 09 13:31:48.240425 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.240380 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-bundle" (OuterVolumeSpecName: "bundle") pod "78f98841-6d61-478a-a5e6-b82bf94b703f" (UID: "78f98841-6d61-478a-a5e6-b82bf94b703f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:31:48.240570 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.240526 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-bundle" (OuterVolumeSpecName: "bundle") pod "12447412-03d7-40fc-ae52-ea853128719a" (UID: "12447412-03d7-40fc-ae52-ea853128719a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:31:48.241052 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.241027 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12447412-03d7-40fc-ae52-ea853128719a-kube-api-access-4ppbs" (OuterVolumeSpecName: "kube-api-access-4ppbs") pod "12447412-03d7-40fc-ae52-ea853128719a" (UID: "12447412-03d7-40fc-ae52-ea853128719a"). InnerVolumeSpecName "kube-api-access-4ppbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:31:48.242116 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.242063 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78f98841-6d61-478a-a5e6-b82bf94b703f-kube-api-access-mr6vt" (OuterVolumeSpecName: "kube-api-access-mr6vt") pod "78f98841-6d61-478a-a5e6-b82bf94b703f" (UID: "78f98841-6d61-478a-a5e6-b82bf94b703f"). InnerVolumeSpecName "kube-api-access-mr6vt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:31:48.242509 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.242475 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-util" (OuterVolumeSpecName: "util") pod "78f98841-6d61-478a-a5e6-b82bf94b703f" (UID: "78f98841-6d61-478a-a5e6-b82bf94b703f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:31:48.246281 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.246246 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-util" (OuterVolumeSpecName: "util") pod "12447412-03d7-40fc-ae52-ea853128719a" (UID: "12447412-03d7-40fc-ae52-ea853128719a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:31:48.334223 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.334183 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-bundle\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:48.334223 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.334217 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ppbs\" (UniqueName: \"kubernetes.io/projected/12447412-03d7-40fc-ae52-ea853128719a-kube-api-access-4ppbs\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:48.334223 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.334232 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr6vt\" (UniqueName: \"kubernetes.io/projected/78f98841-6d61-478a-a5e6-b82bf94b703f-kube-api-access-mr6vt\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:48.334467 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.334244 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78f98841-6d61-478a-a5e6-b82bf94b703f-util\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:48.334467 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.334255 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-bundle\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:48.334467 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.334265 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12447412-03d7-40fc-ae52-ea853128719a-util\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:48.990353 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.990322 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" Jul 09 13:31:48.990793 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.990322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z" event={"ID":"12447412-03d7-40fc-ae52-ea853128719a","Type":"ContainerDied","Data":"e082d279b6a3bbea815b4d6d95858a0f7f942e1a07a5e14c0dd1457323b77d5d"} Jul 09 13:31:48.990793 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.990441 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e082d279b6a3bbea815b4d6d95858a0f7f942e1a07a5e14c0dd1457323b77d5d" Jul 09 13:31:48.992318 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.992293 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" Jul 09 13:31:48.992426 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.992317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw" event={"ID":"78f98841-6d61-478a-a5e6-b82bf94b703f","Type":"ContainerDied","Data":"86b00336eb512d91d08f62551dec18e837a633898ad499f09cf1b636668dcb86"} Jul 09 13:31:48.992426 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:48.992363 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86b00336eb512d91d08f62551dec18e837a633898ad499f09cf1b636668dcb86" Jul 09 13:31:49.130625 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.130602 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:49.157248 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.157226 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:31:49.242611 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.242535 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-util\") pod \"893f201e-fbf2-421c-87ef-2a503e211a79\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " Jul 09 13:31:49.242611 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.242567 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-bundle\") pod \"8de75634-822c-474f-9d3d-8a4a813a72df\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " Jul 09 13:31:49.242611 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.242588 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-util\") pod \"8de75634-822c-474f-9d3d-8a4a813a72df\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " Jul 09 13:31:49.242890 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.242631 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8bqd\" (UniqueName: \"kubernetes.io/projected/893f201e-fbf2-421c-87ef-2a503e211a79-kube-api-access-g8bqd\") pod \"893f201e-fbf2-421c-87ef-2a503e211a79\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " Jul 09 13:31:49.242890 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.242722 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcfjl\" (UniqueName: \"kubernetes.io/projected/8de75634-822c-474f-9d3d-8a4a813a72df-kube-api-access-jcfjl\") pod \"8de75634-822c-474f-9d3d-8a4a813a72df\" (UID: \"8de75634-822c-474f-9d3d-8a4a813a72df\") " Jul 09 13:31:49.242890 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.242830 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-bundle\") pod \"893f201e-fbf2-421c-87ef-2a503e211a79\" (UID: \"893f201e-fbf2-421c-87ef-2a503e211a79\") " Jul 09 13:31:49.243163 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.243124 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-bundle" (OuterVolumeSpecName: "bundle") pod "8de75634-822c-474f-9d3d-8a4a813a72df" (UID: "8de75634-822c-474f-9d3d-8a4a813a72df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:31:49.243273 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.243242 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-bundle\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:49.243575 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.243529 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-bundle" (OuterVolumeSpecName: "bundle") pod "893f201e-fbf2-421c-87ef-2a503e211a79" (UID: "893f201e-fbf2-421c-87ef-2a503e211a79"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:31:49.244864 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.244844 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/893f201e-fbf2-421c-87ef-2a503e211a79-kube-api-access-g8bqd" (OuterVolumeSpecName: "kube-api-access-g8bqd") pod "893f201e-fbf2-421c-87ef-2a503e211a79" (UID: "893f201e-fbf2-421c-87ef-2a503e211a79"). InnerVolumeSpecName "kube-api-access-g8bqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:31:49.244951 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.244936 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8de75634-822c-474f-9d3d-8a4a813a72df-kube-api-access-jcfjl" (OuterVolumeSpecName: "kube-api-access-jcfjl") pod "8de75634-822c-474f-9d3d-8a4a813a72df" (UID: "8de75634-822c-474f-9d3d-8a4a813a72df"). InnerVolumeSpecName "kube-api-access-jcfjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:31:49.250736 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.250714 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-util" (OuterVolumeSpecName: "util") pod "8de75634-822c-474f-9d3d-8a4a813a72df" (UID: "8de75634-822c-474f-9d3d-8a4a813a72df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:31:49.303976 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.303941 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-util" (OuterVolumeSpecName: "util") pod "893f201e-fbf2-421c-87ef-2a503e211a79" (UID: "893f201e-fbf2-421c-87ef-2a503e211a79"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:31:49.344440 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.344411 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-util\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:49.344440 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.344436 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8de75634-822c-474f-9d3d-8a4a813a72df-util\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:49.344580 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.344444 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8bqd\" (UniqueName: \"kubernetes.io/projected/893f201e-fbf2-421c-87ef-2a503e211a79-kube-api-access-g8bqd\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:49.344580 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.344454 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcfjl\" (UniqueName: \"kubernetes.io/projected/8de75634-822c-474f-9d3d-8a4a813a72df-kube-api-access-jcfjl\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:49.344580 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.344464 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/893f201e-fbf2-421c-87ef-2a503e211a79-bundle\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:31:49.999713 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.999682 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" Jul 09 13:31:49.999713 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.999698 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6" event={"ID":"8de75634-822c-474f-9d3d-8a4a813a72df","Type":"ContainerDied","Data":"59d6c4c5b2365efbd6c21a667bb0022d4bf71764849f03cbc507b815b27e5bae"} Jul 09 13:31:50.000179 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:49.999741 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59d6c4c5b2365efbd6c21a667bb0022d4bf71764849f03cbc507b815b27e5bae" Jul 09 13:31:50.001770 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:50.001724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" event={"ID":"893f201e-fbf2-421c-87ef-2a503e211a79","Type":"ContainerDied","Data":"145877c4d4721b55d243c80355ced0e3ee7fcc39328a1a5ddced4bfd10f87603"} Jul 09 13:31:50.001947 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:50.001772 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="145877c4d4721b55d243c80355ced0e3ee7fcc39328a1a5ddced4bfd10f87603" Jul 09 13:31:50.001947 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:31:50.001796 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5" Jul 09 13:32:00.474131 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474090 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm"] Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474593 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8de75634-822c-474f-9d3d-8a4a813a72df" containerName="util" Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474613 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8de75634-822c-474f-9d3d-8a4a813a72df" containerName="util" Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474625 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f98841-6d61-478a-a5e6-b82bf94b703f" containerName="extract" Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474633 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f98841-6d61-478a-a5e6-b82bf94b703f" containerName="extract" Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474646 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893f201e-fbf2-421c-87ef-2a503e211a79" containerName="pull" Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474655 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="893f201e-fbf2-421c-87ef-2a503e211a79" containerName="pull" Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474675 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f98841-6d61-478a-a5e6-b82bf94b703f" containerName="pull" Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474684 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f98841-6d61-478a-a5e6-b82bf94b703f" containerName="pull" Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474692 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8de75634-822c-474f-9d3d-8a4a813a72df" containerName="pull" Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474700 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8de75634-822c-474f-9d3d-8a4a813a72df" containerName="pull" Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474709 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8de75634-822c-474f-9d3d-8a4a813a72df" containerName="extract" Jul 09 13:32:00.474712 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474717 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8de75634-822c-474f-9d3d-8a4a813a72df" containerName="extract" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474736 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893f201e-fbf2-421c-87ef-2a503e211a79" containerName="util" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474743 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="893f201e-fbf2-421c-87ef-2a503e211a79" containerName="util" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474759 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12447412-03d7-40fc-ae52-ea853128719a" containerName="util" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474768 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12447412-03d7-40fc-ae52-ea853128719a" containerName="util" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474786 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12447412-03d7-40fc-ae52-ea853128719a" containerName="pull" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474794 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12447412-03d7-40fc-ae52-ea853128719a" containerName="pull" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474803 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893f201e-fbf2-421c-87ef-2a503e211a79" containerName="extract" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474811 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="893f201e-fbf2-421c-87ef-2a503e211a79" containerName="extract" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474823 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12447412-03d7-40fc-ae52-ea853128719a" containerName="extract" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474831 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12447412-03d7-40fc-ae52-ea853128719a" containerName="extract" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474843 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f98841-6d61-478a-a5e6-b82bf94b703f" containerName="util" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474851 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f98841-6d61-478a-a5e6-b82bf94b703f" containerName="util" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474935 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="78f98841-6d61-478a-a5e6-b82bf94b703f" containerName="extract" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474948 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8de75634-822c-474f-9d3d-8a4a813a72df" containerName="extract" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474959 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="893f201e-fbf2-421c-87ef-2a503e211a79" containerName="extract" Jul 09 13:32:00.475328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.474967 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="12447412-03d7-40fc-ae52-ea853128719a" containerName="extract" Jul 09 13:32:00.479719 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.479701 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm" Jul 09 13:32:00.482594 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.482566 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6g8qc\"" Jul 09 13:32:00.488465 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.488438 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm"] Jul 09 13:32:00.543500 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.543460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kkqb\" (UniqueName: \"kubernetes.io/projected/f738dd63-137a-4702-9bd1-0e7eb13bf098-kube-api-access-5kkqb\") pod \"authorino-operator-75cc8d5cb7-ll7pm\" (UID: \"f738dd63-137a-4702-9bd1-0e7eb13bf098\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm" Jul 09 13:32:00.644867 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.644833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kkqb\" (UniqueName: \"kubernetes.io/projected/f738dd63-137a-4702-9bd1-0e7eb13bf098-kube-api-access-5kkqb\") pod \"authorino-operator-75cc8d5cb7-ll7pm\" (UID: \"f738dd63-137a-4702-9bd1-0e7eb13bf098\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm" Jul 09 13:32:00.653939 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.653907 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kkqb\" (UniqueName: \"kubernetes.io/projected/f738dd63-137a-4702-9bd1-0e7eb13bf098-kube-api-access-5kkqb\") pod \"authorino-operator-75cc8d5cb7-ll7pm\" (UID: \"f738dd63-137a-4702-9bd1-0e7eb13bf098\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm" Jul 09 13:32:00.791165 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.791041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm" Jul 09 13:32:00.930328 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:00.930307 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm"] Jul 09 13:32:00.932064 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:32:00.932036 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf738dd63_137a_4702_9bd1_0e7eb13bf098.slice/crio-a31849781e7175cc2ab61fae1f41c6780527c13a38c430640def3081aacb8355 WatchSource:0}: Error finding container a31849781e7175cc2ab61fae1f41c6780527c13a38c430640def3081aacb8355: Status 404 returned error can't find the container with id a31849781e7175cc2ab61fae1f41c6780527c13a38c430640def3081aacb8355 Jul 09 13:32:01.059569 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:01.059536 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm" event={"ID":"f738dd63-137a-4702-9bd1-0e7eb13bf098","Type":"ContainerStarted","Data":"a31849781e7175cc2ab61fae1f41c6780527c13a38c430640def3081aacb8355"} Jul 09 13:32:04.079553 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:04.079513 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm" event={"ID":"f738dd63-137a-4702-9bd1-0e7eb13bf098","Type":"ContainerStarted","Data":"c2f114f4afc01e1f0c525faf8788f444edf914297ef4e8533d3a67e33914fb76"} Jul 09 13:32:04.079981 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:04.079593 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm" Jul 09 13:32:04.109071 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:04.109022 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm" podStartSLOduration=1.5929831669999999 podStartE2EDuration="4.109008096s" totalImagesPullingTime="2.516024929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:32:04.108630025 +0000 UTC m=+436.779251190" watchObservedRunningTime="2026-07-09 13:32:04.109008096 +0000 UTC m=+436.779629257" Jul 09 13:32:04.932258 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:04.932202 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl"] Jul 09 13:32:04.936000 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:04.935980 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:04.940447 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:04.940430 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qmcvz\"" Jul 09 13:32:04.949216 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:04.949192 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl"] Jul 09 13:32:05.085864 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:05.085834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqtxs\" (UniqueName: \"kubernetes.io/projected/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-kube-api-access-qqtxs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" (UID: \"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:05.086242 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:05.085939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" (UID: \"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:05.186903 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:05.186828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" (UID: \"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:05.186903 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:05.186873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqtxs\" (UniqueName: \"kubernetes.io/projected/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-kube-api-access-qqtxs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" (UID: \"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:05.187225 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:05.187205 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" (UID: \"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:05.202295 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:05.202273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqtxs\" (UniqueName: \"kubernetes.io/projected/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-kube-api-access-qqtxs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" (UID: \"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:05.246396 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:05.246368 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:05.426062 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:05.426034 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl"] Jul 09 13:32:05.428152 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:32:05.428125 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd3fe4d9_1337_4e70_941e_0ace9ca30d1d.slice/crio-300adb9ce60f89f953ad055cba9adcde861c75421d901f68344aad0dd74d3686 WatchSource:0}: Error finding container 300adb9ce60f89f953ad055cba9adcde861c75421d901f68344aad0dd74d3686: Status 404 returned error can't find the container with id 300adb9ce60f89f953ad055cba9adcde861c75421d901f68344aad0dd74d3686 Jul 09 13:32:06.090993 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:06.090959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" event={"ID":"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d","Type":"ContainerStarted","Data":"300adb9ce60f89f953ad055cba9adcde861c75421d901f68344aad0dd74d3686"} Jul 09 13:32:07.172780 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:07.172751 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv"] Jul 09 13:32:07.175065 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:07.175051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv" Jul 09 13:32:07.177964 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:07.177945 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-68mj9\"" Jul 09 13:32:07.177964 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:07.177962 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 09 13:32:07.186572 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:07.186552 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv"] Jul 09 13:32:07.305526 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:07.305486 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzvkr\" (UniqueName: \"kubernetes.io/projected/acac737f-76a1-47f0-b327-1144f149e027-kube-api-access-jzvkr\") pod \"dns-operator-controller-manager-864dd78c4c-v9skv\" (UID: \"acac737f-76a1-47f0-b327-1144f149e027\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv" Jul 09 13:32:07.406797 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:07.406762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzvkr\" (UniqueName: \"kubernetes.io/projected/acac737f-76a1-47f0-b327-1144f149e027-kube-api-access-jzvkr\") pod \"dns-operator-controller-manager-864dd78c4c-v9skv\" (UID: \"acac737f-76a1-47f0-b327-1144f149e027\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv" Jul 09 13:32:07.420425 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:07.420395 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzvkr\" (UniqueName: \"kubernetes.io/projected/acac737f-76a1-47f0-b327-1144f149e027-kube-api-access-jzvkr\") pod \"dns-operator-controller-manager-864dd78c4c-v9skv\" (UID: \"acac737f-76a1-47f0-b327-1144f149e027\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv" Jul 09 13:32:07.485896 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:07.485821 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv" Jul 09 13:32:07.650170 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:07.650148 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv"] Jul 09 13:32:07.651918 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:32:07.651898 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacac737f_76a1_47f0_b327_1144f149e027.slice/crio-fbea2f1269107d9c4aa0028e05c4b53ba5015804465493c2e7618b0fd0029902 WatchSource:0}: Error finding container fbea2f1269107d9c4aa0028e05c4b53ba5015804465493c2e7618b0fd0029902: Status 404 returned error can't find the container with id fbea2f1269107d9c4aa0028e05c4b53ba5015804465493c2e7618b0fd0029902 Jul 09 13:32:08.104880 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:08.104835 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv" event={"ID":"acac737f-76a1-47f0-b327-1144f149e027","Type":"ContainerStarted","Data":"fbea2f1269107d9c4aa0028e05c4b53ba5015804465493c2e7618b0fd0029902"} Jul 09 13:32:10.120230 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:10.120130 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w"] Jul 09 13:32:10.123816 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:10.123791 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:10.126716 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:10.126690 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-b594x\"" Jul 09 13:32:10.141943 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:10.141921 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w"] Jul 09 13:32:10.230602 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:10.230569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5w5w\" (UniqueName: \"kubernetes.io/projected/c785cf2d-519e-4ae9-aa98-620b34f70c35-kube-api-access-h5w5w\") pod \"limitador-operator-controller-manager-859d7b78bd-mdd6w\" (UID: \"c785cf2d-519e-4ae9-aa98-620b34f70c35\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:10.331339 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:10.331295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5w5w\" (UniqueName: \"kubernetes.io/projected/c785cf2d-519e-4ae9-aa98-620b34f70c35-kube-api-access-h5w5w\") pod \"limitador-operator-controller-manager-859d7b78bd-mdd6w\" (UID: \"c785cf2d-519e-4ae9-aa98-620b34f70c35\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:10.340773 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:10.340743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5w5w\" (UniqueName: \"kubernetes.io/projected/c785cf2d-519e-4ae9-aa98-620b34f70c35-kube-api-access-h5w5w\") pod \"limitador-operator-controller-manager-859d7b78bd-mdd6w\" (UID: \"c785cf2d-519e-4ae9-aa98-620b34f70c35\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:10.437785 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:10.437716 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:11.452952 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:11.452919 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w"] Jul 09 13:32:11.454354 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:32:11.454332 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc785cf2d_519e_4ae9_aa98_620b34f70c35.slice/crio-5c5de275cc9d006307c286c56fb610bd403a2d5a9cfc26c5f74f538ba39c0292 WatchSource:0}: Error finding container 5c5de275cc9d006307c286c56fb610bd403a2d5a9cfc26c5f74f538ba39c0292: Status 404 returned error can't find the container with id 5c5de275cc9d006307c286c56fb610bd403a2d5a9cfc26c5f74f538ba39c0292 Jul 09 13:32:12.136105 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:12.136041 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv" event={"ID":"acac737f-76a1-47f0-b327-1144f149e027","Type":"ContainerStarted","Data":"8147c612e4c8549f73b0cf1f595a0c1d17f658c528b09df75ee9128d27678f0a"} Jul 09 13:32:12.136295 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:12.136148 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv" Jul 09 13:32:12.138093 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:12.138021 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" event={"ID":"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d","Type":"ContainerStarted","Data":"46255504d4e4eb72ab3dc053a321d1331b92ea2f186f90e58329ec9d800c1f83"} Jul 09 13:32:12.138219 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:12.138131 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:12.139426 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:12.139391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" event={"ID":"c785cf2d-519e-4ae9-aa98-620b34f70c35","Type":"ContainerStarted","Data":"5c5de275cc9d006307c286c56fb610bd403a2d5a9cfc26c5f74f538ba39c0292"} Jul 09 13:32:12.158492 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:12.158452 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv" podStartSLOduration=1.4926529290000001 podStartE2EDuration="5.158438537s" totalImagesPullingTime="3.665785608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:32:12.155711159 +0000 UTC m=+444.826332333" watchObservedRunningTime="2026-07-09 13:32:12.158438537 +0000 UTC m=+444.829059699" Jul 09 13:32:12.178366 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:12.178316 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" podStartSLOduration=2.276225182 podStartE2EDuration="8.178299424s" totalImagesPullingTime="5.902074242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:32:12.17635994 +0000 UTC m=+444.846981103" watchObservedRunningTime="2026-07-09 13:32:12.178299424 +0000 UTC m=+444.848920585" Jul 09 13:32:14.151959 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:14.151919 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" event={"ID":"c785cf2d-519e-4ae9-aa98-620b34f70c35","Type":"ContainerStarted","Data":"5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141"} Jul 09 13:32:14.152344 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:14.152053 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:14.172555 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:14.172501 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" podStartSLOduration=2.203984844 podStartE2EDuration="4.172485001s" totalImagesPullingTime="1.968500157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:32:14.171313644 +0000 UTC m=+446.841934810" watchObservedRunningTime="2026-07-09 13:32:14.172485001 +0000 UTC m=+446.843106223" Jul 09 13:32:15.086514 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:15.086487 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ll7pm" Jul 09 13:32:23.147516 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:23.147484 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:23.147948 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:23.147662 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v9skv" Jul 09 13:32:24.866168 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:24.866137 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt"] Jul 09 13:32:24.871025 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:24.871007 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:24.885176 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:24.885156 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt"] Jul 09 13:32:24.951450 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:24.951427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61eefede-1335-48c4-bd54-79ca92452d4c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-k5ndt\" (UID: \"61eefede-1335-48c4-bd54-79ca92452d4c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:24.951602 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:24.951582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlb47\" (UniqueName: \"kubernetes.io/projected/61eefede-1335-48c4-bd54-79ca92452d4c-kube-api-access-jlb47\") pod \"kuadrant-operator-controller-manager-55467d9f7-k5ndt\" (UID: \"61eefede-1335-48c4-bd54-79ca92452d4c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:24.973531 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:24.973509 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt"] Jul 09 13:32:24.973691 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:24.973675 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-jlb47], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" podUID="61eefede-1335-48c4-bd54-79ca92452d4c" Jul 09 13:32:25.025580 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.025559 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt"] Jul 09 13:32:25.032350 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.032333 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt"] Jul 09 13:32:25.044754 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.044733 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl"] Jul 09 13:32:25.044926 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.044903 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" containerName="manager" containerID="cri-o://46255504d4e4eb72ab3dc053a321d1331b92ea2f186f90e58329ec9d800c1f83" gracePeriod=2 Jul 09 13:32:25.052284 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.052256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlb47\" (UniqueName: \"kubernetes.io/projected/61eefede-1335-48c4-bd54-79ca92452d4c-kube-api-access-jlb47\") pod \"kuadrant-operator-controller-manager-55467d9f7-k5ndt\" (UID: \"61eefede-1335-48c4-bd54-79ca92452d4c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:25.052391 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.052308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61eefede-1335-48c4-bd54-79ca92452d4c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-k5ndt\" (UID: \"61eefede-1335-48c4-bd54-79ca92452d4c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:25.052806 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.052774 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61eefede-1335-48c4-bd54-79ca92452d4c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-k5ndt\" (UID: \"61eefede-1335-48c4-bd54-79ca92452d4c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:25.054166 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.054144 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl"] Jul 09 13:32:25.054341 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.054308 2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\": pods \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:25.054642 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.054614 2577 projected.go:196] Error preparing data for projected volume kube-api-access-jlb47 for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-133-150.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object Jul 09 13:32:25.054752 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.054699 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61eefede-1335-48c4-bd54-79ca92452d4c-kube-api-access-jlb47 podName:61eefede-1335-48c4-bd54-79ca92452d4c nodeName:}" failed. No retries permitted until 2026-07-09 13:32:25.554678893 +0000 UTC m=+458.225300045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jlb47" (UniqueName: "kubernetes.io/projected/61eefede-1335-48c4-bd54-79ca92452d4c-kube-api-access-jlb47") pod "kuadrant-operator-controller-manager-55467d9f7-k5ndt" (UID: "61eefede-1335-48c4-bd54-79ca92452d4c") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-133-150.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object Jul 09 13:32:25.070458 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.070438 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9"] Jul 09 13:32:25.070859 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.070848 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" containerName="manager" Jul 09 13:32:25.070906 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.070861 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" containerName="manager" Jul 09 13:32:25.070940 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.070927 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" containerName="manager" Jul 09 13:32:25.074028 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.074010 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:25.077345 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.077321 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:25.090615 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.090586 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9"] Jul 09 13:32:25.101414 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.097335 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w"] Jul 09 13:32:25.102093 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.102041 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" containerName="manager" containerID="cri-o://5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141" gracePeriod=2 Jul 09 13:32:25.104153 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.104135 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:25.104490 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.104461 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:25.106634 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.106561 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mdd6w\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:25.107039 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.106877 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd"] Jul 09 13:32:25.109531 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.108947 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:25.111445 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.110901 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mdd6w\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:25.114820 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.114796 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w"] Jul 09 13:32:25.114926 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.114896 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" Jul 09 13:32:25.117159 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.117102 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:25.118454 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.118410 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd"] Jul 09 13:32:25.119143 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.119112 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mdd6w\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:25.121505 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.121484 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4"] Jul 09 13:32:25.121822 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.121810 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" containerName="manager" Jul 09 13:32:25.121822 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.121822 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" containerName="manager" Jul 09 13:32:25.121972 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.121892 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" containerName="manager" Jul 09 13:32:25.124778 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.124763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4" Jul 09 13:32:25.136541 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.136518 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4"] Jul 09 13:32:25.141821 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.141791 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:25.144046 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.144009 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mdd6w\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:25.154907 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.152907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xmhj\" (UniqueName: \"kubernetes.io/projected/30e6139f-4c46-4bab-a5b2-3271e82c9077-kube-api-access-8xmhj\") pod \"kuadrant-operator-controller-manager-86878c769f-dfsxd\" (UID: \"30e6139f-4c46-4bab-a5b2-3271e82c9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" Jul 09 13:32:25.154907 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.153006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b4xn\" (UniqueName: \"kubernetes.io/projected/fd465be3-13d6-4e28-b3c9-7f684aff10a8-kube-api-access-5b4xn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49lk9\" (UID: \"fd465be3-13d6-4e28-b3c9-7f684aff10a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:25.154907 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.153111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30e6139f-4c46-4bab-a5b2-3271e82c9077-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dfsxd\" (UID: \"30e6139f-4c46-4bab-a5b2-3271e82c9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" Jul 09 13:32:25.154907 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.153166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfjs2\" (UniqueName: \"kubernetes.io/projected/a99a8d21-b422-4340-8103-cf63f98536b7-kube-api-access-lfjs2\") pod \"limitador-operator-controller-manager-859d7b78bd-lbfw4\" (UID: \"a99a8d21-b422-4340-8103-cf63f98536b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4" Jul 09 13:32:25.154907 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.153238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd465be3-13d6-4e28-b3c9-7f684aff10a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49lk9\" (UID: \"fd465be3-13d6-4e28-b3c9-7f684aff10a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:25.213372 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.213342 2577 generic.go:356] "Generic (PLEG): container finished" podID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" containerID="46255504d4e4eb72ab3dc053a321d1331b92ea2f186f90e58329ec9d800c1f83" exitCode=0 Jul 09 13:32:25.213509 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.213497 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:25.216182 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.216150 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:25.218162 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.218130 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mdd6w\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:25.220149 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.220123 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-k5ndt\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="61eefede-1335-48c4-bd54-79ca92452d4c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:25.221468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.221111 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:25.223360 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.223336 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:25.225428 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.225405 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mdd6w\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:25.227562 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.227535 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-k5ndt\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="61eefede-1335-48c4-bd54-79ca92452d4c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:25.254186 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.254142 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61eefede-1335-48c4-bd54-79ca92452d4c-extensions-socket-volume\") pod \"61eefede-1335-48c4-bd54-79ca92452d4c\" (UID: \"61eefede-1335-48c4-bd54-79ca92452d4c\") " Jul 09 13:32:25.254394 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.254313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b4xn\" (UniqueName: \"kubernetes.io/projected/fd465be3-13d6-4e28-b3c9-7f684aff10a8-kube-api-access-5b4xn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49lk9\" (UID: \"fd465be3-13d6-4e28-b3c9-7f684aff10a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:25.254394 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.254376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30e6139f-4c46-4bab-a5b2-3271e82c9077-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dfsxd\" (UID: \"30e6139f-4c46-4bab-a5b2-3271e82c9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" Jul 09 13:32:25.254780 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.254410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfjs2\" (UniqueName: \"kubernetes.io/projected/a99a8d21-b422-4340-8103-cf63f98536b7-kube-api-access-lfjs2\") pod \"limitador-operator-controller-manager-859d7b78bd-lbfw4\" (UID: \"a99a8d21-b422-4340-8103-cf63f98536b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4" Jul 09 13:32:25.254780 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.254416 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61eefede-1335-48c4-bd54-79ca92452d4c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "61eefede-1335-48c4-bd54-79ca92452d4c" (UID: "61eefede-1335-48c4-bd54-79ca92452d4c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:32:25.254780 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.254485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd465be3-13d6-4e28-b3c9-7f684aff10a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49lk9\" (UID: \"fd465be3-13d6-4e28-b3c9-7f684aff10a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:25.254780 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.254566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmhj\" (UniqueName: \"kubernetes.io/projected/30e6139f-4c46-4bab-a5b2-3271e82c9077-kube-api-access-8xmhj\") pod \"kuadrant-operator-controller-manager-86878c769f-dfsxd\" (UID: \"30e6139f-4c46-4bab-a5b2-3271e82c9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" Jul 09 13:32:25.254780 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.254658 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlb47\" (UniqueName: \"kubernetes.io/projected/61eefede-1335-48c4-bd54-79ca92452d4c-kube-api-access-jlb47\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:32:25.254780 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.254677 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61eefede-1335-48c4-bd54-79ca92452d4c-extensions-socket-volume\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:32:25.255175 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.254952 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30e6139f-4c46-4bab-a5b2-3271e82c9077-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dfsxd\" (UID: \"30e6139f-4c46-4bab-a5b2-3271e82c9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" Jul 09 13:32:25.255175 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.255051 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd465be3-13d6-4e28-b3c9-7f684aff10a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49lk9\" (UID: \"fd465be3-13d6-4e28-b3c9-7f684aff10a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:25.265502 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.265453 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xmhj\" (UniqueName: \"kubernetes.io/projected/30e6139f-4c46-4bab-a5b2-3271e82c9077-kube-api-access-8xmhj\") pod \"kuadrant-operator-controller-manager-86878c769f-dfsxd\" (UID: \"30e6139f-4c46-4bab-a5b2-3271e82c9077\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" Jul 09 13:32:25.265887 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.265866 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfjs2\" (UniqueName: \"kubernetes.io/projected/a99a8d21-b422-4340-8103-cf63f98536b7-kube-api-access-lfjs2\") pod \"limitador-operator-controller-manager-859d7b78bd-lbfw4\" (UID: \"a99a8d21-b422-4340-8103-cf63f98536b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4" Jul 09 13:32:25.266014 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.265991 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b4xn\" (UniqueName: \"kubernetes.io/projected/fd465be3-13d6-4e28-b3c9-7f684aff10a8-kube-api-access-5b4xn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49lk9\" (UID: \"fd465be3-13d6-4e28-b3c9-7f684aff10a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:25.351071 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.351050 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:25.353533 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.353501 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-k5ndt\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="61eefede-1335-48c4-bd54-79ca92452d4c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:25.355273 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.355232 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqtxs\" (UniqueName: \"kubernetes.io/projected/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-kube-api-access-qqtxs\") pod \"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d\" (UID: \"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d\") " Jul 09 13:32:25.355506 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.355477 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-extensions-socket-volume\") pod \"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d\" (UID: \"fd3fe4d9-1337-4e70-941e-0ace9ca30d1d\") " Jul 09 13:32:25.355941 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.355823 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:25.356320 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.356298 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:25.356489 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.356467 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" (UID: "fd3fe4d9-1337-4e70-941e-0ace9ca30d1d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:32:25.357858 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.357837 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mdd6w\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:25.358059 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.358036 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-kube-api-access-qqtxs" (OuterVolumeSpecName: "kube-api-access-qqtxs") pod "fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" (UID: "fd3fe4d9-1337-4e70-941e-0ace9ca30d1d"). InnerVolumeSpecName "kube-api-access-qqtxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:32:25.360358 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.360338 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tsmkl\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:25.362241 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.362218 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mdd6w\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:25.364153 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:25.364131 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-k5ndt\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="61eefede-1335-48c4-bd54-79ca92452d4c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:25.456560 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.456491 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5w5w\" (UniqueName: \"kubernetes.io/projected/c785cf2d-519e-4ae9-aa98-620b34f70c35-kube-api-access-h5w5w\") pod \"c785cf2d-519e-4ae9-aa98-620b34f70c35\" (UID: \"c785cf2d-519e-4ae9-aa98-620b34f70c35\") " Jul 09 13:32:25.456671 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.456636 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-extensions-socket-volume\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:32:25.456671 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.456647 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqtxs\" (UniqueName: \"kubernetes.io/projected/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d-kube-api-access-qqtxs\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:32:25.458391 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.458370 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c785cf2d-519e-4ae9-aa98-620b34f70c35-kube-api-access-h5w5w" (OuterVolumeSpecName: "kube-api-access-h5w5w") pod "c785cf2d-519e-4ae9-aa98-620b34f70c35" (UID: "c785cf2d-519e-4ae9-aa98-620b34f70c35"). InnerVolumeSpecName "kube-api-access-h5w5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:32:25.482309 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.482286 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:25.491183 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.491167 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" Jul 09 13:32:25.496017 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.496001 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4" Jul 09 13:32:25.558344 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.558306 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5w5w\" (UniqueName: \"kubernetes.io/projected/c785cf2d-519e-4ae9-aa98-620b34f70c35-kube-api-access-h5w5w\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:32:25.642666 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.642642 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9"] Jul 09 13:32:25.645099 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:32:25.645044 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd465be3_13d6_4e28_b3c9_7f684aff10a8.slice/crio-5d6341dabc7b859d1b7c3839e382bf87885e95f76b3c9a7c0f1362c01a3703d8 WatchSource:0}: Error finding container 5d6341dabc7b859d1b7c3839e382bf87885e95f76b3c9a7c0f1362c01a3703d8: Status 404 returned error can't find the container with id 5d6341dabc7b859d1b7c3839e382bf87885e95f76b3c9a7c0f1362c01a3703d8 Jul 09 13:32:25.867390 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:32:25.867358 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99a8d21_b422_4340_8103_cf63f98536b7.slice/crio-0dee41c64c084b239c8f905956e2908d35c7162d5eaddca7a6223d2e5a4e9d93 WatchSource:0}: Error finding container 0dee41c64c084b239c8f905956e2908d35c7162d5eaddca7a6223d2e5a4e9d93: Status 404 returned error can't find the container with id 0dee41c64c084b239c8f905956e2908d35c7162d5eaddca7a6223d2e5a4e9d93 Jul 09 13:32:25.868338 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.868311 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4"] Jul 09 13:32:25.869964 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:32:25.869931 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e6139f_4c46_4bab_a5b2_3271e82c9077.slice/crio-f10d1800bbb174c09d035bda4f5cae37cbd24cee2d6793010f57a24173a02817 WatchSource:0}: Error finding container f10d1800bbb174c09d035bda4f5cae37cbd24cee2d6793010f57a24173a02817: Status 404 returned error can't find the container with id f10d1800bbb174c09d035bda4f5cae37cbd24cee2d6793010f57a24173a02817 Jul 09 13:32:25.870553 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.870534 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd"] Jul 09 13:32:25.904531 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.904505 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61eefede-1335-48c4-bd54-79ca92452d4c" path="/var/lib/kubelet/pods/61eefede-1335-48c4-bd54-79ca92452d4c/volumes" Jul 09 13:32:25.904853 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.904836 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c785cf2d-519e-4ae9-aa98-620b34f70c35" path="/var/lib/kubelet/pods/c785cf2d-519e-4ae9-aa98-620b34f70c35/volumes" Jul 09 13:32:25.905371 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:25.905355 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd3fe4d9-1337-4e70-941e-0ace9ca30d1d" path="/var/lib/kubelet/pods/fd3fe4d9-1337-4e70-941e-0ace9ca30d1d/volumes" Jul 09 13:32:26.222439 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.222338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4" event={"ID":"a99a8d21-b422-4340-8103-cf63f98536b7","Type":"ContainerStarted","Data":"1661ee10409889504c06c2ec7b7ebfb9474958eea3d07c72f23e150b22a52cf5"} Jul 09 13:32:26.222439 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.222414 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4" Jul 09 13:32:26.222633 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.222442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4" event={"ID":"a99a8d21-b422-4340-8103-cf63f98536b7","Type":"ContainerStarted","Data":"0dee41c64c084b239c8f905956e2908d35c7162d5eaddca7a6223d2e5a4e9d93"} Jul 09 13:32:26.224153 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.224127 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" event={"ID":"fd465be3-13d6-4e28-b3c9-7f684aff10a8","Type":"ContainerStarted","Data":"40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d"} Jul 09 13:32:26.224281 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.224175 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" event={"ID":"fd465be3-13d6-4e28-b3c9-7f684aff10a8","Type":"ContainerStarted","Data":"5d6341dabc7b859d1b7c3839e382bf87885e95f76b3c9a7c0f1362c01a3703d8"} Jul 09 13:32:26.224281 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.224215 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:26.225601 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.225587 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tsmkl" Jul 09 13:32:26.225686 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.225605 2577 scope.go:117] "RemoveContainer" containerID="46255504d4e4eb72ab3dc053a321d1331b92ea2f186f90e58329ec9d800c1f83" Jul 09 13:32:26.227131 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.227109 2577 generic.go:356] "Generic (PLEG): container finished" podID="c785cf2d-519e-4ae9-aa98-620b34f70c35" containerID="5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141" exitCode=0 Jul 09 13:32:26.227235 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.227216 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdd6w" Jul 09 13:32:26.229052 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.229025 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:26.229495 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.229421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" event={"ID":"30e6139f-4c46-4bab-a5b2-3271e82c9077","Type":"ContainerStarted","Data":"0045758f2c5754dc64d2402c115fec8e28ad79b8da7b9f0d90e23c74eb7540fd"} Jul 09 13:32:26.229495 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.229469 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" event={"ID":"30e6139f-4c46-4bab-a5b2-3271e82c9077","Type":"ContainerStarted","Data":"f10d1800bbb174c09d035bda4f5cae37cbd24cee2d6793010f57a24173a02817"} Jul 09 13:32:26.229624 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.229506 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" Jul 09 13:32:26.236111 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.236095 2577 scope.go:117] "RemoveContainer" containerID="5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141" Jul 09 13:32:26.246348 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.246332 2577 scope.go:117] "RemoveContainer" containerID="5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141" Jul 09 13:32:26.246596 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:26.246572 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141\": container with ID starting with 5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141 not found: ID does not exist" containerID="5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141" Jul 09 13:32:26.246676 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.246607 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141"} err="failed to get container status \"5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141\": rpc error: code = NotFound desc = could not find container \"5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141\": container with ID starting with 5506457d3570fd0d2a02de86adf62d16e4ad83a1815eab5c654c586b1dec7141 not found: ID does not exist" Jul 09 13:32:26.252507 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.252464 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4" podStartSLOduration=1.252452997 podStartE2EDuration="1.252452997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:32:26.251490312 +0000 UTC m=+458.922111473" watchObservedRunningTime="2026-07-09 13:32:26.252452997 +0000 UTC m=+458.923074159" Jul 09 13:32:26.279319 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.279280 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" podStartSLOduration=1.279268527 podStartE2EDuration="1.279268527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:32:26.276769048 +0000 UTC m=+458.947390234" watchObservedRunningTime="2026-07-09 13:32:26.279268527 +0000 UTC m=+458.949889689" Jul 09 13:32:26.299818 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:26.299773 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" podStartSLOduration=1.29975956 podStartE2EDuration="1.29975956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:32:26.297631699 +0000 UTC m=+458.968252862" watchObservedRunningTime="2026-07-09 13:32:26.29975956 +0000 UTC m=+458.970380721" Jul 09 13:32:26.301371 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:26.301347 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-k5ndt\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="61eefede-1335-48c4-bd54-79ca92452d4c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:27.901289 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:27.901205 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-k5ndt\" is forbidden: User \"system:node:ip-10-0-133-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-150.ec2.internal' and this object" podUID="61eefede-1335-48c4-bd54-79ca92452d4c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k5ndt" Jul 09 13:32:37.238931 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.238895 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfsxd" Jul 09 13:32:37.239502 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.238970 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:37.239502 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.239319 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbfw4" Jul 09 13:32:37.323200 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.323172 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9"] Jul 09 13:32:37.323385 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.323364 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" podUID="fd465be3-13d6-4e28-b3c9-7f684aff10a8" containerName="manager" containerID="cri-o://40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d" gracePeriod=10 Jul 09 13:32:37.575950 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.575930 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:37.659185 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.659145 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b4xn\" (UniqueName: \"kubernetes.io/projected/fd465be3-13d6-4e28-b3c9-7f684aff10a8-kube-api-access-5b4xn\") pod \"fd465be3-13d6-4e28-b3c9-7f684aff10a8\" (UID: \"fd465be3-13d6-4e28-b3c9-7f684aff10a8\") " Jul 09 13:32:37.659335 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.659221 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd465be3-13d6-4e28-b3c9-7f684aff10a8-extensions-socket-volume\") pod \"fd465be3-13d6-4e28-b3c9-7f684aff10a8\" (UID: \"fd465be3-13d6-4e28-b3c9-7f684aff10a8\") " Jul 09 13:32:37.659598 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.659576 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd465be3-13d6-4e28-b3c9-7f684aff10a8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd465be3-13d6-4e28-b3c9-7f684aff10a8" (UID: "fd465be3-13d6-4e28-b3c9-7f684aff10a8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:32:37.661049 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.661024 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd465be3-13d6-4e28-b3c9-7f684aff10a8-kube-api-access-5b4xn" (OuterVolumeSpecName: "kube-api-access-5b4xn") pod "fd465be3-13d6-4e28-b3c9-7f684aff10a8" (UID: "fd465be3-13d6-4e28-b3c9-7f684aff10a8"). InnerVolumeSpecName "kube-api-access-5b4xn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:32:37.760409 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.760378 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b4xn\" (UniqueName: \"kubernetes.io/projected/fd465be3-13d6-4e28-b3c9-7f684aff10a8-kube-api-access-5b4xn\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:32:37.760409 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:37.760402 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd465be3-13d6-4e28-b3c9-7f684aff10a8-extensions-socket-volume\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:32:38.296192 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:38.296106 2577 generic.go:356] "Generic (PLEG): container finished" podID="fd465be3-13d6-4e28-b3c9-7f684aff10a8" containerID="40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d" exitCode=0 Jul 09 13:32:38.296192 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:38.296170 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" Jul 09 13:32:38.296192 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:38.296177 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" event={"ID":"fd465be3-13d6-4e28-b3c9-7f684aff10a8","Type":"ContainerDied","Data":"40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d"} Jul 09 13:32:38.296672 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:38.296218 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9" event={"ID":"fd465be3-13d6-4e28-b3c9-7f684aff10a8","Type":"ContainerDied","Data":"5d6341dabc7b859d1b7c3839e382bf87885e95f76b3c9a7c0f1362c01a3703d8"} Jul 09 13:32:38.296672 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:38.296241 2577 scope.go:117] "RemoveContainer" containerID="40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d" Jul 09 13:32:38.304933 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:38.304909 2577 scope.go:117] "RemoveContainer" containerID="40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d" Jul 09 13:32:38.305200 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:32:38.305170 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d\": container with ID starting with 40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d not found: ID does not exist" containerID="40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d" Jul 09 13:32:38.305267 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:38.305208 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d"} err="failed to get container status \"40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d\": rpc error: code = NotFound desc = could not find container \"40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d\": container with ID starting with 40ec10e4ae6ea67a8d0f606aee0e110eb8f9dd73663d914adc0e6e79c498134d not found: ID does not exist" Jul 09 13:32:38.318369 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:38.318350 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9"] Jul 09 13:32:38.325966 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:38.325944 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49lk9"] Jul 09 13:32:39.903518 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:39.903484 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd465be3-13d6-4e28-b3c9-7f684aff10a8" path="/var/lib/kubelet/pods/fd465be3-13d6-4e28-b3c9-7f684aff10a8/volumes" Jul 09 13:32:53.710468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.710432 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm"] Jul 09 13:32:53.711037 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.711007 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd465be3-13d6-4e28-b3c9-7f684aff10a8" containerName="manager" Jul 09 13:32:53.711037 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.711033 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd465be3-13d6-4e28-b3c9-7f684aff10a8" containerName="manager" Jul 09 13:32:53.711231 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.711216 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd465be3-13d6-4e28-b3c9-7f684aff10a8" containerName="manager" Jul 09 13:32:53.715050 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.715032 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.717889 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.717871 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 13:32:53.718001 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.717872 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wwnhw\"" Jul 09 13:32:53.728931 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.728908 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm"] Jul 09 13:32:53.799120 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.799059 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trxxc\" (UniqueName: \"kubernetes.io/projected/23d37880-c034-4e0e-891e-66a4b84afc6b-kube-api-access-trxxc\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.799312 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.799154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.799312 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.799177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.799312 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.799197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.799312 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.799247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.799312 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.799291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23d37880-c034-4e0e-891e-66a4b84afc6b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.799312 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.799311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.799550 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.799338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.799550 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.799401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.900363 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.900331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23d37880-c034-4e0e-891e-66a4b84afc6b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.900363 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.900368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.900621 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.900414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.900621 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.900467 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.900621 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.900513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trxxc\" (UniqueName: \"kubernetes.io/projected/23d37880-c034-4e0e-891e-66a4b84afc6b-kube-api-access-trxxc\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.900778 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.900645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.900778 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.900686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.900778 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.900714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.900778 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.900746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.900977 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.900803 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.901074 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.901053 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.901282 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.901256 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23d37880-c034-4e0e-891e-66a4b84afc6b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.901506 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.901314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.901772 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.901388 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.903236 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.903212 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.910752 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.910724 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.910865 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.910732 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23d37880-c034-4e0e-891e-66a4b84afc6b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:53.911206 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:53.911187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trxxc\" (UniqueName: \"kubernetes.io/projected/23d37880-c034-4e0e-891e-66a4b84afc6b-kube-api-access-trxxc\") pod \"maas-default-gateway-openshift-default-56654dcf7-kkkkm\" (UID: \"23d37880-c034-4e0e-891e-66a4b84afc6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:54.025444 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:54.025346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:54.168819 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:54.168787 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm"] Jul 09 13:32:54.170499 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:32:54.170470 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d37880_c034_4e0e_891e_66a4b84afc6b.slice/crio-a96a61f415f7383868fd186374e1da9f77272ea3b9a1222c362500d66e24b226 WatchSource:0}: Error finding container a96a61f415f7383868fd186374e1da9f77272ea3b9a1222c362500d66e24b226: Status 404 returned error can't find the container with id a96a61f415f7383868fd186374e1da9f77272ea3b9a1222c362500d66e24b226 Jul 09 13:32:54.386992 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:54.386960 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" event={"ID":"23d37880-c034-4e0e-891e-66a4b84afc6b","Type":"ContainerStarted","Data":"a96a61f415f7383868fd186374e1da9f77272ea3b9a1222c362500d66e24b226"} Jul 09 13:32:56.633609 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:56.633572 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 13:32:56.633899 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:56.633651 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 13:32:56.633899 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:56.633681 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 13:32:57.408272 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:57.408239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" event={"ID":"23d37880-c034-4e0e-891e-66a4b84afc6b","Type":"ContainerStarted","Data":"c59b3d720b7ac906afb0e87a13e8adc5bbb5f34d09ca4b76f4d3ededdac695a8"} Jul 09 13:32:57.431415 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:57.431364 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" podStartSLOduration=1.970457044 podStartE2EDuration="4.431347572s" totalImagesPullingTime="2.460890528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:32:57.429652589 +0000 UTC m=+490.100273752" watchObservedRunningTime="2026-07-09 13:32:57.431347572 +0000 UTC m=+490.101968733" Jul 09 13:32:58.026010 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.025986 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:58.031180 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.031157 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:58.413904 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.413874 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:58.414804 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.414784 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kkkkm" Jul 09 13:32:58.549286 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.549254 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwfn2"] Jul 09 13:32:58.551973 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.551953 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:32:58.554583 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.554562 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lh4gm\"" Jul 09 13:32:58.554680 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.554565 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 13:32:58.565016 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.564997 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwfn2"] Jul 09 13:32:58.648244 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.648054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb6f0012-413d-4d2b-abce-50e591b0d83b-config-file\") pod \"limitador-limitador-64c94fd64f-xwfn2\" (UID: \"eb6f0012-413d-4d2b-abce-50e591b0d83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:32:58.648244 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.648177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fz4v\" (UniqueName: \"kubernetes.io/projected/eb6f0012-413d-4d2b-abce-50e591b0d83b-kube-api-access-5fz4v\") pod \"limitador-limitador-64c94fd64f-xwfn2\" (UID: \"eb6f0012-413d-4d2b-abce-50e591b0d83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:32:58.651236 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.651204 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwfn2"] Jul 09 13:32:58.749333 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.749237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb6f0012-413d-4d2b-abce-50e591b0d83b-config-file\") pod \"limitador-limitador-64c94fd64f-xwfn2\" (UID: \"eb6f0012-413d-4d2b-abce-50e591b0d83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:32:58.749333 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.749318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fz4v\" (UniqueName: \"kubernetes.io/projected/eb6f0012-413d-4d2b-abce-50e591b0d83b-kube-api-access-5fz4v\") pod \"limitador-limitador-64c94fd64f-xwfn2\" (UID: \"eb6f0012-413d-4d2b-abce-50e591b0d83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:32:58.749991 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.749967 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb6f0012-413d-4d2b-abce-50e591b0d83b-config-file\") pod \"limitador-limitador-64c94fd64f-xwfn2\" (UID: \"eb6f0012-413d-4d2b-abce-50e591b0d83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:32:58.758700 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.758676 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fz4v\" (UniqueName: \"kubernetes.io/projected/eb6f0012-413d-4d2b-abce-50e591b0d83b-kube-api-access-5fz4v\") pod \"limitador-limitador-64c94fd64f-xwfn2\" (UID: \"eb6f0012-413d-4d2b-abce-50e591b0d83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:32:58.862829 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:58.862787 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:32:59.002923 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:59.002881 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwfn2"] Jul 09 13:32:59.003723 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:32:59.003692 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6f0012_413d_4d2b_abce_50e591b0d83b.slice/crio-646183c522ec652318407ba20da2a964c54e547d55687676e4e89b3844d1f438 WatchSource:0}: Error finding container 646183c522ec652318407ba20da2a964c54e547d55687676e4e89b3844d1f438: Status 404 returned error can't find the container with id 646183c522ec652318407ba20da2a964c54e547d55687676e4e89b3844d1f438 Jul 09 13:32:59.423369 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:59.423334 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" event={"ID":"eb6f0012-413d-4d2b-abce-50e591b0d83b","Type":"ContainerStarted","Data":"646183c522ec652318407ba20da2a964c54e547d55687676e4e89b3844d1f438"} Jul 09 13:32:59.591763 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:59.591726 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5d8b"] Jul 09 13:32:59.594330 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:59.594307 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5d8b" Jul 09 13:32:59.596912 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:59.596887 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cn94t\"" Jul 09 13:32:59.606535 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:59.606507 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5d8b"] Jul 09 13:32:59.758778 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:59.758597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8ns8\" (UniqueName: \"kubernetes.io/projected/33eb786c-e9db-485a-b51e-f056052e1778-kube-api-access-f8ns8\") pod \"authorino-75d556bd77-n5d8b\" (UID: \"33eb786c-e9db-485a-b51e-f056052e1778\") " pod="kuadrant-system/authorino-75d556bd77-n5d8b" Jul 09 13:32:59.859972 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:59.859513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8ns8\" (UniqueName: \"kubernetes.io/projected/33eb786c-e9db-485a-b51e-f056052e1778-kube-api-access-f8ns8\") pod \"authorino-75d556bd77-n5d8b\" (UID: \"33eb786c-e9db-485a-b51e-f056052e1778\") " pod="kuadrant-system/authorino-75d556bd77-n5d8b" Jul 09 13:32:59.879850 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:59.879788 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8ns8\" (UniqueName: \"kubernetes.io/projected/33eb786c-e9db-485a-b51e-f056052e1778-kube-api-access-f8ns8\") pod \"authorino-75d556bd77-n5d8b\" (UID: \"33eb786c-e9db-485a-b51e-f056052e1778\") " pod="kuadrant-system/authorino-75d556bd77-n5d8b" Jul 09 13:32:59.904266 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:32:59.904235 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5d8b" Jul 09 13:33:00.075421 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:00.075391 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5d8b"] Jul 09 13:33:00.076216 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:33:00.076186 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33eb786c_e9db_485a_b51e_f056052e1778.slice/crio-b79d1c9f2814c16a7ae48b5a5c50d3d5557c3ed7a7a91fc7d60d2d0523ae1d05 WatchSource:0}: Error finding container b79d1c9f2814c16a7ae48b5a5c50d3d5557c3ed7a7a91fc7d60d2d0523ae1d05: Status 404 returned error can't find the container with id b79d1c9f2814c16a7ae48b5a5c50d3d5557c3ed7a7a91fc7d60d2d0523ae1d05 Jul 09 13:33:00.431990 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:00.431948 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5d8b" event={"ID":"33eb786c-e9db-485a-b51e-f056052e1778","Type":"ContainerStarted","Data":"b79d1c9f2814c16a7ae48b5a5c50d3d5557c3ed7a7a91fc7d60d2d0523ae1d05"} Jul 09 13:33:02.450934 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:02.450892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" event={"ID":"eb6f0012-413d-4d2b-abce-50e591b0d83b","Type":"ContainerStarted","Data":"c19d4b501d492bef05eb1a4bb1f4616af942fd1c95f6e9a02d0c0f19e02e19da"} Jul 09 13:33:02.451468 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:02.451446 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:33:02.469844 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:02.469754 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" podStartSLOduration=1.691683946 podStartE2EDuration="4.469733856s" totalImagesPullingTime="2.77804991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:33:02.468942234 +0000 UTC m=+495.139563397" watchObservedRunningTime="2026-07-09 13:33:02.469733856 +0000 UTC m=+495.140355019" Jul 09 13:33:04.465243 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:04.465202 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5d8b" event={"ID":"33eb786c-e9db-485a-b51e-f056052e1778","Type":"ContainerStarted","Data":"278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6"} Jul 09 13:33:04.487889 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:04.487838 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-n5d8b" podStartSLOduration=1.8558192770000002 podStartE2EDuration="5.487823746s" totalImagesPullingTime="3.632004469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:33:04.486633792 +0000 UTC m=+497.157254955" watchObservedRunningTime="2026-07-09 13:33:04.487823746 +0000 UTC m=+497.158444908" Jul 09 13:33:14.466806 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:14.466774 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:33:15.018194 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:15.018153 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwfn2"] Jul 09 13:33:15.018503 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:15.018465 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" podUID="eb6f0012-413d-4d2b-abce-50e591b0d83b" containerName="limitador" containerID="cri-o://c19d4b501d492bef05eb1a4bb1f4616af942fd1c95f6e9a02d0c0f19e02e19da" gracePeriod=30 Jul 09 13:33:15.530201 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:15.530170 2577 generic.go:356] "Generic (PLEG): container finished" podID="eb6f0012-413d-4d2b-abce-50e591b0d83b" containerID="c19d4b501d492bef05eb1a4bb1f4616af942fd1c95f6e9a02d0c0f19e02e19da" exitCode=0 Jul 09 13:33:15.530595 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:15.530249 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" event={"ID":"eb6f0012-413d-4d2b-abce-50e591b0d83b","Type":"ContainerDied","Data":"c19d4b501d492bef05eb1a4bb1f4616af942fd1c95f6e9a02d0c0f19e02e19da"} Jul 09 13:33:15.980754 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:15.980730 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:33:16.001233 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:16.001207 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb6f0012-413d-4d2b-abce-50e591b0d83b-config-file\") pod \"eb6f0012-413d-4d2b-abce-50e591b0d83b\" (UID: \"eb6f0012-413d-4d2b-abce-50e591b0d83b\") " Jul 09 13:33:16.001401 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:16.001309 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fz4v\" (UniqueName: \"kubernetes.io/projected/eb6f0012-413d-4d2b-abce-50e591b0d83b-kube-api-access-5fz4v\") pod \"eb6f0012-413d-4d2b-abce-50e591b0d83b\" (UID: \"eb6f0012-413d-4d2b-abce-50e591b0d83b\") " Jul 09 13:33:16.001640 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:16.001615 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb6f0012-413d-4d2b-abce-50e591b0d83b-config-file" (OuterVolumeSpecName: "config-file") pod "eb6f0012-413d-4d2b-abce-50e591b0d83b" (UID: "eb6f0012-413d-4d2b-abce-50e591b0d83b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:33:16.003362 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:16.003340 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb6f0012-413d-4d2b-abce-50e591b0d83b-kube-api-access-5fz4v" (OuterVolumeSpecName: "kube-api-access-5fz4v") pod "eb6f0012-413d-4d2b-abce-50e591b0d83b" (UID: "eb6f0012-413d-4d2b-abce-50e591b0d83b"). InnerVolumeSpecName "kube-api-access-5fz4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:33:16.102443 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:16.102352 2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb6f0012-413d-4d2b-abce-50e591b0d83b-config-file\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:33:16.102443 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:16.102383 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fz4v\" (UniqueName: \"kubernetes.io/projected/eb6f0012-413d-4d2b-abce-50e591b0d83b-kube-api-access-5fz4v\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:33:16.537062 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:16.536985 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" Jul 09 13:33:16.537528 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:16.536980 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwfn2" event={"ID":"eb6f0012-413d-4d2b-abce-50e591b0d83b","Type":"ContainerDied","Data":"646183c522ec652318407ba20da2a964c54e547d55687676e4e89b3844d1f438"} Jul 09 13:33:16.537528 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:16.537136 2577 scope.go:117] "RemoveContainer" containerID="c19d4b501d492bef05eb1a4bb1f4616af942fd1c95f6e9a02d0c0f19e02e19da" Jul 09 13:33:16.558954 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:16.558932 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwfn2"] Jul 09 13:33:16.563106 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:16.563069 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwfn2"] Jul 09 13:33:17.903283 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:17.903249 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb6f0012-413d-4d2b-abce-50e591b0d83b" path="/var/lib/kubelet/pods/eb6f0012-413d-4d2b-abce-50e591b0d83b/volumes" Jul 09 13:33:20.086376 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.086346 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nzvts"] Jul 09 13:33:20.086767 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.086737 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb6f0012-413d-4d2b-abce-50e591b0d83b" containerName="limitador" Jul 09 13:33:20.086767 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.086748 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb6f0012-413d-4d2b-abce-50e591b0d83b" containerName="limitador" Jul 09 13:33:20.086845 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.086829 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb6f0012-413d-4d2b-abce-50e591b0d83b" containerName="limitador" Jul 09 13:33:20.091170 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.091150 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" Jul 09 13:33:20.093844 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.093828 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qkxc7\"" Jul 09 13:33:20.095200 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.095044 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 13:33:20.095200 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.095183 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 13:33:20.095409 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.095374 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 09 13:33:20.097796 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.097767 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nzvts"] Jul 09 13:33:20.138859 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.138838 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e105d680-e4fd-464d-a92b-69e6e6cba00b-data\") pod \"postgres-69fb4594cf-nzvts\" (UID: \"e105d680-e4fd-464d-a92b-69e6e6cba00b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" Jul 09 13:33:20.138957 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.138872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8cqt\" (UniqueName: \"kubernetes.io/projected/e105d680-e4fd-464d-a92b-69e6e6cba00b-kube-api-access-n8cqt\") pod \"postgres-69fb4594cf-nzvts\" (UID: \"e105d680-e4fd-464d-a92b-69e6e6cba00b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" Jul 09 13:33:20.240149 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.240108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e105d680-e4fd-464d-a92b-69e6e6cba00b-data\") pod \"postgres-69fb4594cf-nzvts\" (UID: \"e105d680-e4fd-464d-a92b-69e6e6cba00b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" Jul 09 13:33:20.240149 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.240153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8cqt\" (UniqueName: \"kubernetes.io/projected/e105d680-e4fd-464d-a92b-69e6e6cba00b-kube-api-access-n8cqt\") pod \"postgres-69fb4594cf-nzvts\" (UID: \"e105d680-e4fd-464d-a92b-69e6e6cba00b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" Jul 09 13:33:20.240499 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.240478 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e105d680-e4fd-464d-a92b-69e6e6cba00b-data\") pod \"postgres-69fb4594cf-nzvts\" (UID: \"e105d680-e4fd-464d-a92b-69e6e6cba00b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" Jul 09 13:33:20.251781 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.251757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8cqt\" (UniqueName: \"kubernetes.io/projected/e105d680-e4fd-464d-a92b-69e6e6cba00b-kube-api-access-n8cqt\") pod \"postgres-69fb4594cf-nzvts\" (UID: \"e105d680-e4fd-464d-a92b-69e6e6cba00b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" Jul 09 13:33:20.404224 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.404137 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" Jul 09 13:33:20.538853 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.538829 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nzvts"] Jul 09 13:33:20.541133 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:33:20.541109 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode105d680_e4fd_464d_a92b_69e6e6cba00b.slice/crio-f46fdfb154fd51a8f8f48a1dc06d089ba9b649d787eb593deaeb10e4da42e80c WatchSource:0}: Error finding container f46fdfb154fd51a8f8f48a1dc06d089ba9b649d787eb593deaeb10e4da42e80c: Status 404 returned error can't find the container with id f46fdfb154fd51a8f8f48a1dc06d089ba9b649d787eb593deaeb10e4da42e80c Jul 09 13:33:20.561343 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:20.561318 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" event={"ID":"e105d680-e4fd-464d-a92b-69e6e6cba00b","Type":"ContainerStarted","Data":"f46fdfb154fd51a8f8f48a1dc06d089ba9b649d787eb593deaeb10e4da42e80c"} Jul 09 13:33:26.602313 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:26.602273 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" event={"ID":"e105d680-e4fd-464d-a92b-69e6e6cba00b","Type":"ContainerStarted","Data":"b7d8a5fbf6a71fd96dce4726cfb1a696e920274e596393366bc082d1edc0d784"} Jul 09 13:33:26.602683 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:26.602400 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" Jul 09 13:33:26.620853 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:26.620803 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" podStartSLOduration=1.629149266 podStartE2EDuration="6.620787841s" totalImagesPullingTime="4.991638575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:33:26.619024676 +0000 UTC m=+519.289645834" watchObservedRunningTime="2026-07-09 13:33:26.620787841 +0000 UTC m=+519.291409002" Jul 09 13:33:32.638233 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:32.638202 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzvts" Jul 09 13:33:33.219409 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.219374 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zz24t"] Jul 09 13:33:33.319042 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.319010 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zz24t"] Jul 09 13:33:33.319218 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.319126 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zz24t" Jul 09 13:33:33.350351 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.350327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j954\" (UniqueName: \"kubernetes.io/projected/341ef751-0466-4198-b2fb-f66df36a4363-kube-api-access-6j954\") pod \"authorino-5d4b67c446-zz24t\" (UID: \"341ef751-0466-4198-b2fb-f66df36a4363\") " pod="kuadrant-system/authorino-5d4b67c446-zz24t" Jul 09 13:33:33.451021 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.450990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j954\" (UniqueName: \"kubernetes.io/projected/341ef751-0466-4198-b2fb-f66df36a4363-kube-api-access-6j954\") pod \"authorino-5d4b67c446-zz24t\" (UID: \"341ef751-0466-4198-b2fb-f66df36a4363\") " pod="kuadrant-system/authorino-5d4b67c446-zz24t" Jul 09 13:33:33.461147 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.461126 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j954\" (UniqueName: \"kubernetes.io/projected/341ef751-0466-4198-b2fb-f66df36a4363-kube-api-access-6j954\") pod \"authorino-5d4b67c446-zz24t\" (UID: \"341ef751-0466-4198-b2fb-f66df36a4363\") " pod="kuadrant-system/authorino-5d4b67c446-zz24t" Jul 09 13:33:33.464285 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.464263 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zz24t"] Jul 09 13:33:33.464480 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.464465 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zz24t" Jul 09 13:33:33.504900 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.504865 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-658d4d8d65-mxdzt"] Jul 09 13:33:33.533571 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.533549 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-658d4d8d65-mxdzt"] Jul 09 13:33:33.533701 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.533636 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-658d4d8d65-mxdzt" Jul 09 13:33:33.652355 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.652318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbvgz\" (UniqueName: \"kubernetes.io/projected/c00e103a-08e4-458a-8a3f-5e93a44ec9e9-kube-api-access-lbvgz\") pod \"authorino-658d4d8d65-mxdzt\" (UID: \"c00e103a-08e4-458a-8a3f-5e93a44ec9e9\") " pod="kuadrant-system/authorino-658d4d8d65-mxdzt" Jul 09 13:33:33.753509 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.753421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbvgz\" (UniqueName: \"kubernetes.io/projected/c00e103a-08e4-458a-8a3f-5e93a44ec9e9-kube-api-access-lbvgz\") pod \"authorino-658d4d8d65-mxdzt\" (UID: \"c00e103a-08e4-458a-8a3f-5e93a44ec9e9\") " pod="kuadrant-system/authorino-658d4d8d65-mxdzt" Jul 09 13:33:33.753845 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.753823 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-658d4d8d65-mxdzt"] Jul 09 13:33:33.754058 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:33:33.754038 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lbvgz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-658d4d8d65-mxdzt" podUID="c00e103a-08e4-458a-8a3f-5e93a44ec9e9" Jul 09 13:33:33.765464 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.765435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbvgz\" (UniqueName: \"kubernetes.io/projected/c00e103a-08e4-458a-8a3f-5e93a44ec9e9-kube-api-access-lbvgz\") pod \"authorino-658d4d8d65-mxdzt\" (UID: \"c00e103a-08e4-458a-8a3f-5e93a44ec9e9\") " pod="kuadrant-system/authorino-658d4d8d65-mxdzt" Jul 09 13:33:33.785819 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.785788 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bd9df4877-zg48g"] Jul 09 13:33:33.806090 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.806049 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bd9df4877-zg48g"] Jul 09 13:33:33.806255 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.806176 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd9df4877-zg48g" Jul 09 13:33:33.808925 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.808901 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 09 13:33:33.835752 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.835728 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zz24t"] Jul 09 13:33:33.837606 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:33:33.837580 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod341ef751_0466_4198_b2fb_f66df36a4363.slice/crio-bd0d4efd11a0998d0af84cca7ccd9062e63fc08a80619483e069ce47c00fe212 WatchSource:0}: Error finding container bd0d4efd11a0998d0af84cca7ccd9062e63fc08a80619483e069ce47c00fe212: Status 404 returned error can't find the container with id bd0d4efd11a0998d0af84cca7ccd9062e63fc08a80619483e069ce47c00fe212 Jul 09 13:33:33.854973 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.854944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cfdb6fe8-368c-4349-8fc1-90571bb5ac15-tls-cert\") pod \"authorino-5bd9df4877-zg48g\" (UID: \"cfdb6fe8-368c-4349-8fc1-90571bb5ac15\") " pod="kuadrant-system/authorino-5bd9df4877-zg48g" Jul 09 13:33:33.855120 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.854984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwpss\" (UniqueName: \"kubernetes.io/projected/cfdb6fe8-368c-4349-8fc1-90571bb5ac15-kube-api-access-zwpss\") pod \"authorino-5bd9df4877-zg48g\" (UID: \"cfdb6fe8-368c-4349-8fc1-90571bb5ac15\") " pod="kuadrant-system/authorino-5bd9df4877-zg48g" Jul 09 13:33:33.956537 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.956500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cfdb6fe8-368c-4349-8fc1-90571bb5ac15-tls-cert\") pod \"authorino-5bd9df4877-zg48g\" (UID: \"cfdb6fe8-368c-4349-8fc1-90571bb5ac15\") " pod="kuadrant-system/authorino-5bd9df4877-zg48g" Jul 09 13:33:33.956719 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.956548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwpss\" (UniqueName: \"kubernetes.io/projected/cfdb6fe8-368c-4349-8fc1-90571bb5ac15-kube-api-access-zwpss\") pod \"authorino-5bd9df4877-zg48g\" (UID: \"cfdb6fe8-368c-4349-8fc1-90571bb5ac15\") " pod="kuadrant-system/authorino-5bd9df4877-zg48g" Jul 09 13:33:33.958904 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.958873 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cfdb6fe8-368c-4349-8fc1-90571bb5ac15-tls-cert\") pod \"authorino-5bd9df4877-zg48g\" (UID: \"cfdb6fe8-368c-4349-8fc1-90571bb5ac15\") " pod="kuadrant-system/authorino-5bd9df4877-zg48g" Jul 09 13:33:33.965113 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:33.965091 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwpss\" (UniqueName: \"kubernetes.io/projected/cfdb6fe8-368c-4349-8fc1-90571bb5ac15-kube-api-access-zwpss\") pod \"authorino-5bd9df4877-zg48g\" (UID: \"cfdb6fe8-368c-4349-8fc1-90571bb5ac15\") " pod="kuadrant-system/authorino-5bd9df4877-zg48g" Jul 09 13:33:34.117212 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.117180 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd9df4877-zg48g" Jul 09 13:33:34.277508 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.277474 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bd9df4877-zg48g"] Jul 09 13:33:34.278184 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:33:34.278153 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfdb6fe8_368c_4349_8fc1_90571bb5ac15.slice/crio-399e472af9d48609046ea478a7f66525d85ca37648ae9336905bcf617c46b477 WatchSource:0}: Error finding container 399e472af9d48609046ea478a7f66525d85ca37648ae9336905bcf617c46b477: Status 404 returned error can't find the container with id 399e472af9d48609046ea478a7f66525d85ca37648ae9336905bcf617c46b477 Jul 09 13:33:34.649616 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.649524 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd9df4877-zg48g" event={"ID":"cfdb6fe8-368c-4349-8fc1-90571bb5ac15","Type":"ContainerStarted","Data":"399e472af9d48609046ea478a7f66525d85ca37648ae9336905bcf617c46b477"} Jul 09 13:33:34.651132 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.651108 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zz24t" event={"ID":"341ef751-0466-4198-b2fb-f66df36a4363","Type":"ContainerStarted","Data":"59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e"} Jul 09 13:33:34.651283 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.651143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zz24t" event={"ID":"341ef751-0466-4198-b2fb-f66df36a4363","Type":"ContainerStarted","Data":"bd0d4efd11a0998d0af84cca7ccd9062e63fc08a80619483e069ce47c00fe212"} Jul 09 13:33:34.651283 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.651114 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-658d4d8d65-mxdzt" Jul 09 13:33:34.651283 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.651160 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-zz24t" podUID="341ef751-0466-4198-b2fb-f66df36a4363" containerName="authorino" containerID="cri-o://59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e" gracePeriod=30 Jul 09 13:33:34.658269 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.658245 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-658d4d8d65-mxdzt" Jul 09 13:33:34.672378 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.672331 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-zz24t" podStartSLOduration=1.122025464 podStartE2EDuration="1.672314037s" totalImagesPullingTime="550.288573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:33:34.670555802 +0000 UTC m=+527.341176965" watchObservedRunningTime="2026-07-09 13:33:34.672314037 +0000 UTC m=+527.342935199" Jul 09 13:33:34.762675 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.762646 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbvgz\" (UniqueName: \"kubernetes.io/projected/c00e103a-08e4-458a-8a3f-5e93a44ec9e9-kube-api-access-lbvgz\") pod \"c00e103a-08e4-458a-8a3f-5e93a44ec9e9\" (UID: \"c00e103a-08e4-458a-8a3f-5e93a44ec9e9\") " Jul 09 13:33:34.764647 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.764616 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00e103a-08e4-458a-8a3f-5e93a44ec9e9-kube-api-access-lbvgz" (OuterVolumeSpecName: "kube-api-access-lbvgz") pod "c00e103a-08e4-458a-8a3f-5e93a44ec9e9" (UID: "c00e103a-08e4-458a-8a3f-5e93a44ec9e9"). InnerVolumeSpecName "kube-api-access-lbvgz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:33:34.863715 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.863675 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbvgz\" (UniqueName: \"kubernetes.io/projected/c00e103a-08e4-458a-8a3f-5e93a44ec9e9-kube-api-access-lbvgz\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:33:34.908340 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.908268 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zz24t" Jul 09 13:33:34.964009 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.963979 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j954\" (UniqueName: \"kubernetes.io/projected/341ef751-0466-4198-b2fb-f66df36a4363-kube-api-access-6j954\") pod \"341ef751-0466-4198-b2fb-f66df36a4363\" (UID: \"341ef751-0466-4198-b2fb-f66df36a4363\") " Jul 09 13:33:34.966069 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:34.966041 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/341ef751-0466-4198-b2fb-f66df36a4363-kube-api-access-6j954" (OuterVolumeSpecName: "kube-api-access-6j954") pod "341ef751-0466-4198-b2fb-f66df36a4363" (UID: "341ef751-0466-4198-b2fb-f66df36a4363"). InnerVolumeSpecName "kube-api-access-6j954". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:33:35.065325 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.065280 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j954\" (UniqueName: \"kubernetes.io/projected/341ef751-0466-4198-b2fb-f66df36a4363-kube-api-access-6j954\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:33:35.658619 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.658581 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd9df4877-zg48g" event={"ID":"cfdb6fe8-368c-4349-8fc1-90571bb5ac15","Type":"ContainerStarted","Data":"4934e056d9f4ab01f19d29c58f9893b27e9702712640069694e092c76237d23b"} Jul 09 13:33:35.660306 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.660266 2577 generic.go:356] "Generic (PLEG): container finished" podID="341ef751-0466-4198-b2fb-f66df36a4363" containerID="59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e" exitCode=0 Jul 09 13:33:35.660660 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.660646 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-658d4d8d65-mxdzt" Jul 09 13:33:35.663444 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.663422 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zz24t" Jul 09 13:33:35.666623 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.666590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zz24t" event={"ID":"341ef751-0466-4198-b2fb-f66df36a4363","Type":"ContainerDied","Data":"59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e"} Jul 09 13:33:35.666623 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.666649 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zz24t" event={"ID":"341ef751-0466-4198-b2fb-f66df36a4363","Type":"ContainerDied","Data":"bd0d4efd11a0998d0af84cca7ccd9062e63fc08a80619483e069ce47c00fe212"} Jul 09 13:33:35.666850 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.666689 2577 scope.go:117] "RemoveContainer" containerID="59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e" Jul 09 13:33:35.678924 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.678874 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bd9df4877-zg48g" podStartSLOduration=2.282161986 podStartE2EDuration="2.678856863s" totalImagesPullingTime="396.694877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:33:35.67874258 +0000 UTC m=+528.349363747" watchObservedRunningTime="2026-07-09 13:33:35.678856863 +0000 UTC m=+528.349478026" Jul 09 13:33:35.698563 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.692338 2577 scope.go:117] "RemoveContainer" containerID="59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e" Jul 09 13:33:35.706105 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:33:35.703294 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e\": container with ID starting with 59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e not found: ID does not exist" containerID="59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e" Jul 09 13:33:35.706105 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.703383 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e"} err="failed to get container status \"59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e\": rpc error: code = NotFound desc = could not find container \"59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e\": container with ID starting with 59bf3279df43ab619c975cd0b0c06e6fadcb80337be63d8e7862afc7f3cfaf3e not found: ID does not exist" Jul 09 13:33:35.714465 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.714340 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5d8b"] Jul 09 13:33:35.714617 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.714564 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-n5d8b" podUID="33eb786c-e9db-485a-b51e-f056052e1778" containerName="authorino" containerID="cri-o://278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6" gracePeriod=30 Jul 09 13:33:35.741290 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.741262 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-658d4d8d65-mxdzt"] Jul 09 13:33:35.745534 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.745511 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-658d4d8d65-mxdzt"] Jul 09 13:33:35.755297 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.755275 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zz24t"] Jul 09 13:33:35.758694 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.758672 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zz24t"] Jul 09 13:33:35.905169 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.905130 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="341ef751-0466-4198-b2fb-f66df36a4363" path="/var/lib/kubelet/pods/341ef751-0466-4198-b2fb-f66df36a4363/volumes" Jul 09 13:33:35.905508 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.905494 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00e103a-08e4-458a-8a3f-5e93a44ec9e9" path="/var/lib/kubelet/pods/c00e103a-08e4-458a-8a3f-5e93a44ec9e9/volumes" Jul 09 13:33:35.970942 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:35.970916 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5d8b" Jul 09 13:33:36.082217 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.082188 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8ns8\" (UniqueName: \"kubernetes.io/projected/33eb786c-e9db-485a-b51e-f056052e1778-kube-api-access-f8ns8\") pod \"33eb786c-e9db-485a-b51e-f056052e1778\" (UID: \"33eb786c-e9db-485a-b51e-f056052e1778\") " Jul 09 13:33:36.084214 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.084180 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33eb786c-e9db-485a-b51e-f056052e1778-kube-api-access-f8ns8" (OuterVolumeSpecName: "kube-api-access-f8ns8") pod "33eb786c-e9db-485a-b51e-f056052e1778" (UID: "33eb786c-e9db-485a-b51e-f056052e1778"). InnerVolumeSpecName "kube-api-access-f8ns8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:33:36.183058 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.183023 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8ns8\" (UniqueName: \"kubernetes.io/projected/33eb786c-e9db-485a-b51e-f056052e1778-kube-api-access-f8ns8\") on node \"ip-10-0-133-150.ec2.internal\" DevicePath \"\"" Jul 09 13:33:36.668389 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.668354 2577 generic.go:356] "Generic (PLEG): container finished" podID="33eb786c-e9db-485a-b51e-f056052e1778" containerID="278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6" exitCode=0 Jul 09 13:33:36.668872 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.668402 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5d8b" Jul 09 13:33:36.668872 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.668441 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5d8b" event={"ID":"33eb786c-e9db-485a-b51e-f056052e1778","Type":"ContainerDied","Data":"278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6"} Jul 09 13:33:36.668872 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.668486 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5d8b" event={"ID":"33eb786c-e9db-485a-b51e-f056052e1778","Type":"ContainerDied","Data":"b79d1c9f2814c16a7ae48b5a5c50d3d5557c3ed7a7a91fc7d60d2d0523ae1d05"} Jul 09 13:33:36.668872 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.668508 2577 scope.go:117] "RemoveContainer" containerID="278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6" Jul 09 13:33:36.677474 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.677455 2577 scope.go:117] "RemoveContainer" containerID="278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6" Jul 09 13:33:36.677696 ip-10-0-133-150 kubenswrapper[2577]: E0709 13:33:36.677679 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6\": container with ID starting with 278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6 not found: ID does not exist" containerID="278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6" Jul 09 13:33:36.677746 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.677704 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6"} err="failed to get container status \"278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6\": rpc error: code = NotFound desc = could not find container \"278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6\": container with ID starting with 278da8f6afe73cb836a1ce3c021731936decd122820bf8e7ffe5003d70e135a6 not found: ID does not exist" Jul 09 13:33:36.692515 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.692482 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5d8b"] Jul 09 13:33:36.694875 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:36.694853 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5d8b"] Jul 09 13:33:37.903036 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:37.903008 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33eb786c-e9db-485a-b51e-f056052e1778" path="/var/lib/kubelet/pods/33eb786c-e9db-485a-b51e-f056052e1778/volumes" Jul 09 13:33:39.798931 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:39.798902 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bd9df4877-zg48g_cfdb6fe8-368c-4349-8fc1-90571bb5ac15/authorino/0.log" Jul 09 13:33:43.358831 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:43.358803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rcnh8_b4c9c45d-617b-427b-bdf9-04ae8c8d6c33/manager/0.log" Jul 09 13:33:43.481687 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:43.481656 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-x8ctq_a6b5a664-fb48-48af-a48b-4be3ced29aaa/manager/0.log" Jul 09 13:33:43.735745 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:43.735665 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2gvlq_1f218686-1a13-4ec5-bc8c-a92c17dcf183/manager/0.log" Jul 09 13:33:44.141450 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:44.141424 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c95977c-rgz4l_ce97c625-8840-42a1-884a-d15b56493a88/copy-manifests/0.log" Jul 09 13:33:44.150405 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:44.150383 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c95977c-rgz4l_ce97c625-8840-42a1-884a-d15b56493a88/manager/0.log" Jul 09 13:33:44.489992 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:44.489907 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-nzvts_e105d680-e4fd-464d-a92b-69e6e6cba00b/postgres/0.log" Jul 09 13:33:45.149776 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.149738 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6_8de75634-822c-474f-9d3d-8a4a813a72df/util/0.log" Jul 09 13:33:45.156409 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.156384 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6_8de75634-822c-474f-9d3d-8a4a813a72df/pull/0.log" Jul 09 13:33:45.162607 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.162587 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6_8de75634-822c-474f-9d3d-8a4a813a72df/extract/0.log" Jul 09 13:33:45.277603 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.277572 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw_78f98841-6d61-478a-a5e6-b82bf94b703f/util/0.log" Jul 09 13:33:45.284157 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.284135 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw_78f98841-6d61-478a-a5e6-b82bf94b703f/pull/0.log" Jul 09 13:33:45.290880 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.290863 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw_78f98841-6d61-478a-a5e6-b82bf94b703f/extract/0.log" Jul 09 13:33:45.405040 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.404967 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z_12447412-03d7-40fc-ae52-ea853128719a/util/0.log" Jul 09 13:33:45.419615 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.419587 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z_12447412-03d7-40fc-ae52-ea853128719a/pull/0.log" Jul 09 13:33:45.429266 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.429244 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z_12447412-03d7-40fc-ae52-ea853128719a/extract/0.log" Jul 09 13:33:45.537781 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.537753 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5_893f201e-fbf2-421c-87ef-2a503e211a79/util/0.log" Jul 09 13:33:45.544426 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.544407 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5_893f201e-fbf2-421c-87ef-2a503e211a79/pull/0.log" Jul 09 13:33:45.551385 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.551365 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5_893f201e-fbf2-421c-87ef-2a503e211a79/extract/0.log" Jul 09 13:33:45.658145 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.658044 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bd9df4877-zg48g_cfdb6fe8-368c-4349-8fc1-90571bb5ac15/authorino/0.log" Jul 09 13:33:45.768862 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.768830 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ll7pm_f738dd63-137a-4702-9bd1-0e7eb13bf098/manager/0.log" Jul 09 13:33:45.883781 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:45.883752 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-v9skv_acac737f-76a1-47f0-b327-1144f149e027/manager/0.log" Jul 09 13:33:46.098961 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:46.098936 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kf76r_c057951d-70e9-4530-be69-7df2fe6d1947/registry-server/0.log" Jul 09 13:33:46.225872 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:46.225845 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dfsxd_30e6139f-4c46-4bab-a5b2-3271e82c9077/manager/0.log" Jul 09 13:33:46.453621 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:46.453542 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lbfw4_a99a8d21-b422-4340-8103-cf63f98536b7/manager/0.log" Jul 09 13:33:47.107473 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:47.107445 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65b545db8f-2nkjm_6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2/kube-auth-proxy/0.log" Jul 09 13:33:47.390938 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:47.390851 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kkkkm_23d37880-c034-4e0e-891e-66a4b84afc6b/istio-proxy/0.log" Jul 09 13:33:54.301518 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:54.301481 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6rhhv_4b3939c7-9b8d-4139-b09c-18df0eab4813/global-pull-secret-syncer/0.log" Jul 09 13:33:54.508909 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:54.508876 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gssd4_28144e94-6c28-4d5c-90ff-e3f548590536/konnectivity-agent/0.log" Jul 09 13:33:54.590269 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:54.590239 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-150.ec2.internal_e79c4d080c88104a74e6d82e667d4c5e/haproxy/0.log" Jul 09 13:33:59.317221 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.317189 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6_8de75634-822c-474f-9d3d-8a4a813a72df/extract/0.log" Jul 09 13:33:59.342834 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.342808 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6_8de75634-822c-474f-9d3d-8a4a813a72df/util/0.log" Jul 09 13:33:59.377034 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.377002 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xd7r6_8de75634-822c-474f-9d3d-8a4a813a72df/pull/0.log" Jul 09 13:33:59.412132 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.412109 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw_78f98841-6d61-478a-a5e6-b82bf94b703f/extract/0.log" Jul 09 13:33:59.441920 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.441893 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw_78f98841-6d61-478a-a5e6-b82bf94b703f/util/0.log" Jul 09 13:33:59.467145 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.467124 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pr8bw_78f98841-6d61-478a-a5e6-b82bf94b703f/pull/0.log" Jul 09 13:33:59.504855 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.504833 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z_12447412-03d7-40fc-ae52-ea853128719a/extract/0.log" Jul 09 13:33:59.529667 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.529645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z_12447412-03d7-40fc-ae52-ea853128719a/util/0.log" Jul 09 13:33:59.555518 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.555498 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sk57z_12447412-03d7-40fc-ae52-ea853128719a/pull/0.log" Jul 09 13:33:59.623293 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.623217 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5_893f201e-fbf2-421c-87ef-2a503e211a79/extract/0.log" Jul 09 13:33:59.652142 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.652123 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5_893f201e-fbf2-421c-87ef-2a503e211a79/util/0.log" Jul 09 13:33:59.679066 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.679043 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hwcv5_893f201e-fbf2-421c-87ef-2a503e211a79/pull/0.log" Jul 09 13:33:59.713250 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.713230 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bd9df4877-zg48g_cfdb6fe8-368c-4349-8fc1-90571bb5ac15/authorino/0.log" Jul 09 13:33:59.747218 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.747199 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ll7pm_f738dd63-137a-4702-9bd1-0e7eb13bf098/manager/0.log" Jul 09 13:33:59.777765 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.777744 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-v9skv_acac737f-76a1-47f0-b327-1144f149e027/manager/0.log" Jul 09 13:33:59.836306 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.836280 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kf76r_c057951d-70e9-4530-be69-7df2fe6d1947/registry-server/0.log" Jul 09 13:33:59.872883 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.872858 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dfsxd_30e6139f-4c46-4bab-a5b2-3271e82c9077/manager/0.log" Jul 09 13:33:59.938695 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:33:59.938621 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lbfw4_a99a8d21-b422-4340-8103-cf63f98536b7/manager/0.log" Jul 09 13:34:02.061452 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.061418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xh44k_c35fa013-1973-4125-94e9-a0752ac0ec6b/node-exporter/0.log" Jul 09 13:34:02.085282 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.085258 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xh44k_c35fa013-1973-4125-94e9-a0752ac0ec6b/kube-rbac-proxy/0.log" Jul 09 13:34:02.109131 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.109116 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xh44k_c35fa013-1973-4125-94e9-a0752ac0ec6b/init-textfile/0.log" Jul 09 13:34:02.143742 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.143698 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-bjn7d_67073693-85bf-49b3-8d5a-6bb2d4289f88/kube-rbac-proxy-main/0.log" Jul 09 13:34:02.170551 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.170525 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-bjn7d_67073693-85bf-49b3-8d5a-6bb2d4289f88/kube-rbac-proxy-self/0.log" Jul 09 13:34:02.203641 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.203623 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-bjn7d_67073693-85bf-49b3-8d5a-6bb2d4289f88/openshift-state-metrics/0.log" Jul 09 13:34:02.452902 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.452814 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-7cr9b_83821609-14cc-400c-aed7-c8aca8ab8a72/prometheus-operator/0.log" Jul 09 13:34:02.475778 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.475742 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-7cr9b_83821609-14cc-400c-aed7-c8aca8ab8a72/kube-rbac-proxy/0.log" Jul 09 13:34:02.502668 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.502645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-dzjtm_ed3f5122-c6c7-4806-be8b-05386fb41602/prometheus-operator-admission-webhook/0.log" Jul 09 13:34:02.553800 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.553782 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8fdbdf867-4k675_1541ce9c-50ea-41e6-a099-7478d8e22b19/telemeter-client/0.log" Jul 09 13:34:02.577075 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.577054 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8fdbdf867-4k675_1541ce9c-50ea-41e6-a099-7478d8e22b19/reload/0.log" Jul 09 13:34:02.601475 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.601449 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8fdbdf867-4k675_1541ce9c-50ea-41e6-a099-7478d8e22b19/kube-rbac-proxy/0.log" Jul 09 13:34:02.635495 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.635476 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784b8978c7-mdct8_fb659efd-84ba-417a-b5cc-1207b54e963f/thanos-query/0.log" Jul 09 13:34:02.659221 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.659204 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784b8978c7-mdct8_fb659efd-84ba-417a-b5cc-1207b54e963f/kube-rbac-proxy-web/0.log" Jul 09 13:34:02.690640 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.690623 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784b8978c7-mdct8_fb659efd-84ba-417a-b5cc-1207b54e963f/kube-rbac-proxy/0.log" Jul 09 13:34:02.713769 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.713716 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784b8978c7-mdct8_fb659efd-84ba-417a-b5cc-1207b54e963f/prom-label-proxy/0.log" Jul 09 13:34:02.740673 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.740655 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784b8978c7-mdct8_fb659efd-84ba-417a-b5cc-1207b54e963f/kube-rbac-proxy-rules/0.log" Jul 09 13:34:02.765156 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:02.765128 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784b8978c7-mdct8_fb659efd-84ba-417a-b5cc-1207b54e963f/kube-rbac-proxy-metrics/0.log" Jul 09 13:34:04.221090 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.221053 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx"] Jul 09 13:34:04.221496 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.221482 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="341ef751-0466-4198-b2fb-f66df36a4363" containerName="authorino" Jul 09 13:34:04.221574 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.221499 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="341ef751-0466-4198-b2fb-f66df36a4363" containerName="authorino" Jul 09 13:34:04.221574 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.221513 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33eb786c-e9db-485a-b51e-f056052e1778" containerName="authorino" Jul 09 13:34:04.221574 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.221521 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="33eb786c-e9db-485a-b51e-f056052e1778" containerName="authorino" Jul 09 13:34:04.221673 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.221600 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="33eb786c-e9db-485a-b51e-f056052e1778" containerName="authorino" Jul 09 13:34:04.221673 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.221608 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="341ef751-0466-4198-b2fb-f66df36a4363" containerName="authorino" Jul 09 13:34:04.240442 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.240419 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx"] Jul 09 13:34:04.240579 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.240513 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.243365 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.243342 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wbb25\"/\"kube-root-ca.crt\"" Jul 09 13:34:04.244255 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.244222 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wbb25\"/\"openshift-service-ca.crt\"" Jul 09 13:34:04.244367 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.244282 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wbb25\"/\"default-dockercfg-t4gpj\"" Jul 09 13:34:04.339022 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.338996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-sys\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.339174 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.339043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-podres\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.339174 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.339069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-proc\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.339174 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.339156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs8s9\" (UniqueName: \"kubernetes.io/projected/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-kube-api-access-xs8s9\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.339285 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.339188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-lib-modules\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.440129 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.440106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-sys\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.440240 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.440150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-podres\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.440240 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.440170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-proc\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.440240 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.440200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs8s9\" (UniqueName: \"kubernetes.io/projected/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-kube-api-access-xs8s9\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.440240 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.440202 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-sys\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.440240 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.440218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-lib-modules\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.440430 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.440247 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-proc\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.440430 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.440261 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-podres\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.440430 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.440382 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-lib-modules\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.449215 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.449194 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs8s9\" (UniqueName: \"kubernetes.io/projected/f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d-kube-api-access-xs8s9\") pod \"perf-node-gather-daemonset-mmkmx\" (UID: \"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.550594 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.550542 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.681970 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.681890 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx"] Jul 09 13:34:04.684311 ip-10-0-133-150 kubenswrapper[2577]: W0709 13:34:04.684284 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf0d8d421_6a81_4c99_aeb9_58a3ea37fb6d.slice/crio-e84af2bd5fa34ae47f9c94f82d05055a6334ec7897c5a45b1621af72161997f5 WatchSource:0}: Error finding container e84af2bd5fa34ae47f9c94f82d05055a6334ec7897c5a45b1621af72161997f5: Status 404 returned error can't find the container with id e84af2bd5fa34ae47f9c94f82d05055a6334ec7897c5a45b1621af72161997f5 Jul 09 13:34:04.833706 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.833678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" event={"ID":"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d","Type":"ContainerStarted","Data":"38816bac8dba0c092a335f49a724442cd46fb1ad68d4f86c07e7726deb6fe251"} Jul 09 13:34:04.833813 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.833722 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" event={"ID":"f0d8d421-6a81-4c99-aeb9-58a3ea37fb6d","Type":"ContainerStarted","Data":"e84af2bd5fa34ae47f9c94f82d05055a6334ec7897c5a45b1621af72161997f5"} Jul 09 13:34:04.833813 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.833806 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:04.850754 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:04.850714 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" podStartSLOduration=0.850702033 podStartE2EDuration="850.702033ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:34:04.850069344 +0000 UTC m=+557.520690505" watchObservedRunningTime="2026-07-09 13:34:04.850702033 +0000 UTC m=+557.521323196" Jul 09 13:34:05.173210 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:05.173132 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86449859b5-nm7zv_1baf7529-f570-46b3-bea5-f133b329a073/console/0.log" Jul 09 13:34:05.205296 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:05.205269 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-xrc6r_b3fcc641-47af-4790-94f1-a1610299ba1d/download-server/0.log" Jul 09 13:34:07.094260 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:07.094230 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vgj7q_303c8633-3135-4ae1-a729-f0e986937ae4/dns/0.log" Jul 09 13:34:07.117855 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:07.117806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vgj7q_303c8633-3135-4ae1-a729-f0e986937ae4/kube-rbac-proxy/0.log" Jul 09 13:34:07.142257 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:07.142237 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2bxw7_bf332382-6a36-4625-9ce5-691f6e74a58d/dns-node-resolver/0.log" Jul 09 13:34:07.815775 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:07.815737 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6tvhm_f7967fba-b519-4892-a817-330df52c8d2a/node-ca/0.log" Jul 09 13:34:09.016952 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:09.016918 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65b545db8f-2nkjm_6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2/kube-auth-proxy/0.log" Jul 09 13:34:09.088252 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:09.088224 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kkkkm_23d37880-c034-4e0e-891e-66a4b84afc6b/istio-proxy/0.log" Jul 09 13:34:09.827511 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:09.827487 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cvvfr_41f9db11-5a3e-498a-b528-99125e01d56a/serve-healthcheck-canary/0.log" Jul 09 13:34:10.354160 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:10.354132 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-g4vlh_5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1/insights-operator/1.log" Jul 09 13:34:10.354553 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:10.354423 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-g4vlh_5f64cc1e-73ca-4def-aa6d-c27dfdedf8e1/insights-operator/0.log" Jul 09 13:34:10.378976 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:10.378948 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s9z2_f41f0cf3-3899-41b9-a529-7dd9bdda0bd0/kube-rbac-proxy/0.log" Jul 09 13:34:10.405346 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:10.405317 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s9z2_f41f0cf3-3899-41b9-a529-7dd9bdda0bd0/exporter/0.log" Jul 09 13:34:10.428855 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:10.428827 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s9z2_f41f0cf3-3899-41b9-a529-7dd9bdda0bd0/extractor/0.log" Jul 09 13:34:10.848216 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:10.848192 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-mmkmx" Jul 09 13:34:13.018840 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:13.018810 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rcnh8_b4c9c45d-617b-427b-bdf9-04ae8c8d6c33/manager/0.log" Jul 09 13:34:13.066849 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:13.066817 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-x8ctq_a6b5a664-fb48-48af-a48b-4be3ced29aaa/manager/0.log" Jul 09 13:34:13.186633 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:13.186544 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2gvlq_1f218686-1a13-4ec5-bc8c-a92c17dcf183/manager/0.log" Jul 09 13:34:13.418998 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:13.418968 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c95977c-rgz4l_ce97c625-8840-42a1-884a-d15b56493a88/manager/0.log" Jul 09 13:34:13.448214 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:13.448138 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c95977c-rgz4l_ce97c625-8840-42a1-884a-d15b56493a88/copy-manifests/0.log" Jul 09 13:34:14.857653 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:14.857622 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-td2zw_ba33b7bd-99d3-4872-81b7-c4874d48d8e2/openshift-lws-operator/0.log" Jul 09 13:34:14.975200 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:14.975172 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65b545db8f-2nkjm_6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2/kube-auth-proxy/0.log" Jul 09 13:34:15.014404 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:15.014380 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kkkkm_23d37880-c034-4e0e-891e-66a4b84afc6b/istio-proxy/0.log" Jul 09 13:34:16.266418 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:16.266389 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65b545db8f-2nkjm_6cafd6ab-4f7e-4089-949b-9a50dd7ce9d2/kube-auth-proxy/0.log" Jul 09 13:34:16.302296 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:16.302266 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kkkkm_23d37880-c034-4e0e-891e-66a4b84afc6b/istio-proxy/0.log" Jul 09 13:34:20.336562 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:20.336530 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7545h_acd9dc4b-bd23-4d64-8f25-252d5b443483/migrator/0.log" Jul 09 13:34:20.398792 ip-10-0-133-150 kubenswrapper[2577]: I0709 13:34:20.398766 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7545h_acd9dc4b-bd23-4d64-8f25-252d5b443483/graceful-termination/0.log"