Jul 08 17:17:17.137256 ip-10-0-135-225 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 17:17:17.137267 ip-10-0-135-225 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 17:17:17.137274 ip-10-0-135-225 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 17:17:17.137500 ip-10-0-135-225 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 17:17:27.386636 ip-10-0-135-225 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 17:17:27.386654 ip-10-0-135-225 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 40cdb0d740f14bc28d6b46a26fb27a14 -- Jul 08 17:19:21.940695 ip-10-0-135-225 systemd[1]: Starting Kubernetes Kubelet... Jul 08 17:19:22.341106 ip-10-0-135-225 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:19:22.341106 ip-10-0-135-225 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 17:19:22.341106 ip-10-0-135-225 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:19:22.341106 ip-10-0-135-225 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 17:19:22.341106 ip-10-0-135-225 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:19:22.343658 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.343575 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 17:19:22.347089 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347074 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:22.347089 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347090 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347094 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347097 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347100 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347103 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347106 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347109 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347112 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347115 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347120 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347123 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347126 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347129 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347131 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347134 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347136 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347139 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347142 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347144 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:22.347152 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347147 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347150 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347155 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347157 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347160 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347162 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347166 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347168 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347171 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347173 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347175 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347178 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347180 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347183 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347185 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347188 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347190 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347192 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347194 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:22.347612 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347197 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347199 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347201 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347204 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347207 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347209 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347211 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347213 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347216 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347218 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347220 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347223 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347225 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347227 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347231 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347234 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347236 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347239 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347241 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347244 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347246 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:22.348074 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347249 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347251 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347254 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347256 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347259 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347263 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347265 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347268 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347270 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347272 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347275 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347277 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347279 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347282 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347286 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347289 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347292 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347295 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347297 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:22.348585 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347301 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347304 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347307 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347309 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347312 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347316 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347319 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347322 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347324 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347327 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347330 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347332 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347334 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347337 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347339 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347342 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347344 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347346 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347349 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.347351 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:22.349033 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348046 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348052 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348055 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348060 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348062 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348065 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348067 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348070 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348072 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348075 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348079 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348082 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348084 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348087 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348089 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348092 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348094 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348096 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348099 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348102 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:22.349522 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348104 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348107 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348109 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348112 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348114 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348117 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348119 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348122 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348124 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348127 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348129 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348132 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348135 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348139 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348142 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348145 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348147 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348150 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348152 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348155 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:22.350024 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348157 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348160 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348163 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348165 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348168 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348171 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348174 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348176 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348178 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348181 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348183 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348188 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348191 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348193 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348195 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348198 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348200 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348203 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348206 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348208 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:22.350519 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348210 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348213 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348215 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348218 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348220 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348223 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348225 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348229 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348232 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348234 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348237 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348239 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348242 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348245 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348247 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348250 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348253 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348255 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348258 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348260 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:22.351012 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348267 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348270 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348273 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348277 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348280 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348283 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348285 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348288 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348290 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348293 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348295 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348299 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348302 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348306 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348309 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348312 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348315 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348318 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348321 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:22.351508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348716 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348722 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348725 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348728 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348731 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348734 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348736 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348739 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348742 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348745 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348747 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348750 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348752 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348755 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348757 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348760 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348764 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348767 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348770 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348772 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:22.351980 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348775 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348777 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348780 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348782 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348785 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348787 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348790 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348792 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348795 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348797 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348799 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348802 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348806 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348809 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348811 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348813 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348816 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348818 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348821 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:22.352492 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348823 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348825 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348829 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348831 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348833 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348836 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348838 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348841 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348843 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348848 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348850 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348852 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348855 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348857 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348860 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348862 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348864 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348867 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348869 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348872 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:22.352943 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348874 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348877 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348880 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348882 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348885 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348889 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348891 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348893 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348896 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348898 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348902 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348906 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348909 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348913 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348916 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348919 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348922 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348925 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348928 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:22.353431 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348930 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348935 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348940 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348942 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348945 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348947 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348950 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348953 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348955 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348958 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348960 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348963 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348965 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348968 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348970 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348973 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348975 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348977 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348981 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348983 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:22.353932 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.348985 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349047 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349054 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349060 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349064 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349067 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349070 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349074 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349078 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349082 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349084 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349088 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349091 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349094 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349098 2577 flags.go:64] FLAG: --cgroup-root="" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349100 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349103 2577 flags.go:64] FLAG: --client-ca-file="" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349105 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349108 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349112 2577 flags.go:64] FLAG: --cluster-domain="" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349114 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349117 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349120 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349123 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 17:19:22.354430 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349126 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349129 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349132 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349135 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349138 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349141 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349145 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349148 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349151 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349154 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349157 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349160 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349162 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349165 2577 flags.go:64] FLAG: --enable-server="true" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349168 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349172 2577 flags.go:64] FLAG: --event-burst="100" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349175 2577 flags.go:64] FLAG: --event-qps="50" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349178 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349181 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349184 2577 flags.go:64] FLAG: --eviction-hard="" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349187 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349190 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349195 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349198 2577 flags.go:64] FLAG: --eviction-soft="" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349200 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 17:19:22.355023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349203 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349205 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349208 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349211 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349214 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349216 2577 flags.go:64] FLAG: --feature-gates="" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349219 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349222 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349225 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349228 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349231 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349234 2577 flags.go:64] FLAG: --help="false" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349236 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349240 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349243 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349246 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349250 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349253 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349255 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349258 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349261 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349263 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349266 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349269 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 17:19:22.355664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349272 2577 flags.go:64] FLAG: --kube-reserved="" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349274 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349278 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349280 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349283 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349287 2577 flags.go:64] FLAG: --lock-file="" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349290 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349293 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349295 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349300 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349303 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349306 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349308 2577 flags.go:64] FLAG: --logging-format="text" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349311 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349314 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349317 2577 flags.go:64] FLAG: --manifest-url="" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349320 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349324 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349327 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349331 2577 flags.go:64] FLAG: --max-pods="110" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349334 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349338 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349341 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349343 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349346 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 17:19:22.356245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349349 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349351 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349358 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349360 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349363 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349366 2577 flags.go:64] FLAG: --pod-cidr="" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349386 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349394 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349398 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349403 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349407 2577 flags.go:64] FLAG: --port="10250" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349410 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349413 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06b9a0a98f97e255d" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349418 2577 flags.go:64] FLAG: --qos-reserved="" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349421 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349423 2577 flags.go:64] FLAG: --register-node="true" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349426 2577 flags.go:64] FLAG: --register-with-taints="" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349430 2577 flags.go:64] FLAG: --registry-burst="10" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349432 2577 flags.go:64] FLAG: --registry-qps="5" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349435 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349438 2577 flags.go:64] FLAG: --reserved-memory="" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349441 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349444 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349447 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349450 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 17:19:22.356982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349452 2577 flags.go:64] FLAG: --runonce="false" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349455 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349458 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349462 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349464 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349467 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349470 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349473 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349476 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349479 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349481 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349484 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349487 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349490 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349492 2577 flags.go:64] FLAG: --system-cgroups="" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349495 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349501 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349503 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349507 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349510 2577 flags.go:64] FLAG: --tls-min-version="" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349514 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349517 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349519 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349522 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349525 2577 flags.go:64] FLAG: --v="2" Jul 08 17:19:22.357867 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349529 2577 flags.go:64] FLAG: --version="false" Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349533 2577 flags.go:64] FLAG: --vmodule="" Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349537 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.349540 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349680 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349684 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349687 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349690 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349693 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349695 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349699 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349702 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349704 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349707 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349709 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349711 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349714 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349716 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349718 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349721 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349723 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:22.358491 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349726 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349728 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349731 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349733 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349736 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349742 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349746 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349748 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349751 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349753 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349756 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349758 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349760 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349763 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349766 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349768 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349771 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349773 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349775 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:22.359042 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349778 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349780 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349782 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349785 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349787 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349789 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349793 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349796 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349799 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349801 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349803 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349806 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349808 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349810 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349813 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349815 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349818 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349820 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349822 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:22.359531 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349826 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349828 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349831 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349833 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349836 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349838 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349842 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349845 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349848 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349850 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349853 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349856 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349858 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349861 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349863 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349865 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349867 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349870 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349873 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349875 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:22.360004 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349877 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349880 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349882 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349885 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349887 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349891 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349894 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349897 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349900 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349902 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349905 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349907 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349913 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349922 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349925 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349928 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349930 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349932 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349935 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349938 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:22.360508 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349940 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349942 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349945 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.349947 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.350633 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.358521 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.358536 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.358556 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.358562 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358621 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358627 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358631 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358634 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358637 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358640 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:22.360986 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358643 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358645 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358648 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358650 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358653 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358656 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358658 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358661 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358663 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358666 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358668 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358671 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358673 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358676 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358678 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358681 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358683 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358686 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358688 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358690 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:22.361408 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358693 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358696 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358700 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358702 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358704 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358707 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358709 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358712 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358714 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358717 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358719 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358722 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358724 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358727 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358730 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358734 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358737 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358739 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358742 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:22.361904 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358744 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358746 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358749 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358752 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358754 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358757 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358759 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358761 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358764 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358766 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358768 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358771 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358774 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358776 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358779 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358782 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358785 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358787 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358790 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358792 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:22.362362 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358795 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358797 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358800 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358802 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358806 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358810 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358812 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358815 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358818 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358821 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358824 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358826 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358829 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358831 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358833 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358836 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358839 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358841 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358844 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:22.362859 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358846 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358849 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358852 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358855 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358858 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358861 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358863 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358866 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358869 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358872 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358875 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358877 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358880 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358882 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:22.363320 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358885 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.358890 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.358997 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359001 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359005 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359009 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359012 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359015 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359017 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359020 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359022 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359025 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359027 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359029 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:22.363678 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359032 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359035 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359037 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359039 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359042 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359044 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359047 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359049 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359052 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359055 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359057 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359060 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359062 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359065 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359068 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359070 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359073 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359075 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359077 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359080 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:22.364015 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359082 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359084 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359087 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359089 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359092 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359094 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359097 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359099 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359101 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359104 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359107 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359109 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359112 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359114 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359117 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359119 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359121 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359124 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359126 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:22.364506 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359129 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359132 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359135 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359138 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359141 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359143 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359146 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359150 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359153 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359156 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359159 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359161 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359164 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359166 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359168 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359171 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359173 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359175 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359178 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:22.364953 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359180 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359183 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359185 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359187 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359190 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359192 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359194 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359197 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359200 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359202 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359205 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359207 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359209 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359212 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359214 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359216 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359218 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359221 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359224 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359226 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:22.365417 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359229 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359231 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359234 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359237 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359239 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359241 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359244 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359246 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:22.359248 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.359253 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.359354 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.362867 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.364127 2577 server.go:1019] "Starting client certificate rotation" Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.364229 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:19:22.365896 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.364266 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:19:22.366653 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.366639 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:19:22.367808 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.367790 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:19:22.378470 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.378430 2577 log.go:25] "Validated CRI v1 runtime API" Jul 08 17:19:22.381646 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.381630 2577 log.go:25] "Validated CRI v1 image API" Jul 08 17:19:22.382411 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.382395 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 17:19:22.384681 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.384664 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 80e1de7e-63b6-4750-bed5-2a5a8a0cf399:/dev/nvme0n1p3 91512aaa-5c26-48c5-a157-a020fa4dcacf:/dev/nvme0n1p4] Jul 08 17:19:22.384735 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.384682 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 17:19:22.391170 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.391052 2577 manager.go:216] Machine: {Timestamp:2026-07-08 17:19:22.389658671 +0000 UTC m=+0.332417990 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103497 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c1517a748e8364c81f65c7a6f9abc SystemUUID:ec2c1517-a748-e836-4c81-f65c7a6f9abc BootID:40cdb0d7-40f1-4bc2-8d6b-46a26fb27a14 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6e:50:4d:8e:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6e:50:4d:8e:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:b7:b0:9d:31:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 17:19:22.391170 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.391160 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 17:19:22.391286 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.391233 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 17:19:22.394649 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.394632 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:19:22.395385 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.395176 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 17:19:22.395522 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.395395 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-225.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 17:19:22.396068 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.396057 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 17:19:22.396106 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.396072 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 17:19:22.396106 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.396079 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:19:22.396106 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.396093 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:19:22.397325 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.397314 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 17:19:22.399910 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.399898 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:19:22.400053 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.400044 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 17:19:22.400134 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.400074 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 08 17:19:22.400134 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.400083 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 17:19:22.400134 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.400103 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 17:19:22.400134 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.400112 2577 kubelet.go:398] "Adding apiserver pod source" Jul 08 17:19:22.400134 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.400125 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 17:19:22.400426 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.400416 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:19:22.400467 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.400433 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:19:22.402601 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.402585 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 17:19:22.404123 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.404106 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 17:19:22.404187 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.404142 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 17:19:22.405068 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405057 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 17:19:22.405106 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405074 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 17:19:22.405106 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405080 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 17:19:22.405106 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405086 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 17:19:22.405106 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405095 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 17:19:22.405106 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405101 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 17:19:22.405244 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405109 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 17:19:22.405244 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405114 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 17:19:22.405244 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405120 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 17:19:22.405244 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405126 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 17:19:22.405244 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405134 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 17:19:22.405244 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.405139 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 17:19:22.406253 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.406240 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 17:19:22.406315 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.406254 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 17:19:22.409444 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.409391 2577 server.go:1268] "Started kubelet" Jul 08 17:19:22.409525 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.409452 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 17:19:22.409667 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.409622 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 17:19:22.409770 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.409691 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 17:19:22.410099 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.410082 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-225.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 17:19:22.410200 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.410123 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 17:19:22.410249 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.410193 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 17:19:22.410275 ip-10-0-135-225 systemd[1]: Started Kubernetes Kubelet. Jul 08 17:19:22.411033 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.411017 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 08 17:19:22.411271 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.411154 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 17:19:22.414656 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.413692 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-225.ec2.internal.18c06024853f8be3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-225.ec2.internal,UID:ip-10-0-135-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-225.ec2.internal,},FirstTimestamp:2026-07-08 17:19:22.409339875 +0000 UTC m=+0.352099179,LastTimestamp:2026-07-08 17:19:22.409339875 +0000 UTC m=+0.352099179,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-225.ec2.internal,}" Jul 08 17:19:22.415365 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.415348 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 17:19:22.416638 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.416619 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 17:19:22.416713 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.416621 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 17:19:22.416822 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.416803 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:22.417267 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417198 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 17:19:22.417348 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417266 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 17:19:22.417348 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417295 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 17:19:22.417469 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417439 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 08 17:19:22.417469 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417452 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 08 17:19:22.417740 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417726 2577 factory.go:153] Registering CRI-O factory Jul 08 17:19:22.417839 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417757 2577 factory.go:223] Registration of the crio container factory successfully Jul 08 17:19:22.417839 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417803 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 17:19:22.417839 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417809 2577 factory.go:55] Registering systemd factory Jul 08 17:19:22.417839 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417817 2577 factory.go:223] Registration of the systemd container factory successfully Jul 08 17:19:22.417839 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417838 2577 factory.go:103] Registering Raw factory Jul 08 17:19:22.418086 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.417850 2577 manager.go:1196] Started watching for new ooms in manager Jul 08 17:19:22.418239 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.418223 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-drzd5" Jul 08 17:19:22.418425 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.418413 2577 manager.go:349] Starting recovery of all containers Jul 08 17:19:22.419018 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.418996 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 17:19:22.419115 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.419094 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 17:19:22.424245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.424219 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-drzd5" Jul 08 17:19:22.429618 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.429600 2577 manager.go:354] Recovery completed Jul 08 17:19:22.433969 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.433957 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:22.435880 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.435864 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:22.435940 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.435896 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:22.435940 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.435909 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:22.436416 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.436397 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 17:19:22.436496 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.436417 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 17:19:22.436496 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.436437 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:19:22.436716 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.436694 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:22.437342 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.437328 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:22.437424 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.437354 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:22.437424 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.437364 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:22.437537 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.437526 2577 policy_none.go:49] "None policy: Start" Jul 08 17:19:22.437605 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.437541 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 17:19:22.437605 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.437551 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 17:19:22.438421 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.438410 2577 policy_none.go:47] "Start" Jul 08 17:19:22.470929 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.470907 2577 manager.go:337] "Starting Device Plugin manager" Jul 08 17:19:22.471006 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.470936 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 17:19:22.471006 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.470945 2577 server.go:87] "Starting device plugin registration server" Jul 08 17:19:22.471180 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.471166 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 17:19:22.471238 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.471182 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 17:19:22.471319 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.471264 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 17:19:22.471402 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.471345 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 17:19:22.471402 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.471355 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 17:19:22.471903 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.471885 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 17:19:22.471959 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.471938 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:22.550718 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.550673 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 17:19:22.552062 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.552048 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 17:19:22.552128 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.552086 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 17:19:22.552128 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.552116 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 17:19:22.552232 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.552156 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 17:19:22.554819 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.554798 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:19:22.571980 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.571965 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:22.572790 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.572770 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:22.572891 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.572805 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:22.572891 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.572819 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:22.572891 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.572854 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.581781 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.581766 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.581845 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.581790 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-225.ec2.internal\": node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:22.603170 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.603115 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:22.652421 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.652405 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal"] Jul 08 17:19:22.652497 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.652482 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:22.653811 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.653797 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:22.653878 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.653824 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:22.653878 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.653833 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:22.654857 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.654846 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:22.655018 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.654995 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.655090 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.655050 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:22.655585 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.655568 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:22.655655 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.655594 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:22.655655 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.655604 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:22.655753 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.655568 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:22.655753 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.655691 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:22.655753 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.655726 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:22.656779 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.656758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.656874 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.656788 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:22.657468 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.657452 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:22.657554 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.657476 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:22.657554 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.657500 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:22.688904 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.688886 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-225.ec2.internal\" not found" node="ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.693234 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.693220 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-225.ec2.internal\" not found" node="ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.704093 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.704079 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:22.718411 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.718391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/670c0e119250ff548cdf2ae2ee0e9dc5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"670c0e119250ff548cdf2ae2ee0e9dc5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.718467 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.718417 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/670c0e119250ff548cdf2ae2ee0e9dc5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"670c0e119250ff548cdf2ae2ee0e9dc5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.718467 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.718433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21c6eb4a75675630f6b8228d54bfaa3a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.ec2.internal\" (UID: \"21c6eb4a75675630f6b8228d54bfaa3a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.804583 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.804561 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:22.818691 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.818671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/670c0e119250ff548cdf2ae2ee0e9dc5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"670c0e119250ff548cdf2ae2ee0e9dc5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.818757 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.818704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/670c0e119250ff548cdf2ae2ee0e9dc5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"670c0e119250ff548cdf2ae2ee0e9dc5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.818757 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.818727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21c6eb4a75675630f6b8228d54bfaa3a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.ec2.internal\" (UID: \"21c6eb4a75675630f6b8228d54bfaa3a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.818828 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.818769 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/670c0e119250ff548cdf2ae2ee0e9dc5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"670c0e119250ff548cdf2ae2ee0e9dc5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.818828 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.818773 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/670c0e119250ff548cdf2ae2ee0e9dc5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal\" (UID: \"670c0e119250ff548cdf2ae2ee0e9dc5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.818828 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.818826 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21c6eb4a75675630f6b8228d54bfaa3a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-225.ec2.internal\" (UID: \"21c6eb4a75675630f6b8228d54bfaa3a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.904879 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:22.904818 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:22.996157 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.996114 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" Jul 08 17:19:22.996157 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:22.996152 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" Jul 08 17:19:23.005144 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:23.005124 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:23.106064 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:23.106029 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:23.207243 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:23.207163 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:23.309496 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:23.309458 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:23.366193 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.366166 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 17:19:23.366713 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.366310 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 17:19:23.409885 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:23.409847 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:23.426147 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.426114 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 17:14:23 +0000 UTC" deadline="2027-12-30 21:16:24.543046678 +0000 UTC" Jul 08 17:19:23.426147 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.426140 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12963h57m1.116912255s" Jul 08 17:19:23.510601 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:23.510572 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-225.ec2.internal\" not found" Jul 08 17:19:23.525971 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.525949 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:19:23.579811 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:23.579763 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670c0e119250ff548cdf2ae2ee0e9dc5.slice/crio-35ad6d932156c16e8e31b631d54bc81515774d9b47d43265b16c6e950eb9eb20 WatchSource:0}: Error finding container 35ad6d932156c16e8e31b631d54bc81515774d9b47d43265b16c6e950eb9eb20: Status 404 returned error can't find the container with id 35ad6d932156c16e8e31b631d54bc81515774d9b47d43265b16c6e950eb9eb20 Jul 08 17:19:23.580014 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:23.579987 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c6eb4a75675630f6b8228d54bfaa3a.slice/crio-8271d68038e8c6f1bbe327300af23cc75ecd7e1ed772f60b2ebe6d2abea1e7a5 WatchSource:0}: Error finding container 8271d68038e8c6f1bbe327300af23cc75ecd7e1ed772f60b2ebe6d2abea1e7a5: Status 404 returned error can't find the container with id 8271d68038e8c6f1bbe327300af23cc75ecd7e1ed772f60b2ebe6d2abea1e7a5 Jul 08 17:19:23.584955 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.584930 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:19:23.592193 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.592171 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:19:23.617733 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.617709 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" Jul 08 17:19:23.629480 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.629465 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:19:23.630546 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.630533 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" Jul 08 17:19:23.640295 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.640282 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:19:23.788914 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:23.788859 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:19:24.238782 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.238698 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:19:24.401864 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.401831 2577 apiserver.go:52] "Watching apiserver" Jul 08 17:19:24.410453 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.410419 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 17:19:24.410922 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.410894 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-qggbz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp","openshift-cluster-node-tuning-operator/tuned-9xwtx","openshift-dns/node-resolver-mlbvh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal","openshift-multus/multus-9sszx","openshift-network-diagnostics/network-check-target-t6pnw","openshift-network-operator/iptables-alerter-7gpxr","kube-system/global-pull-secret-syncer-g5x8g","kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal","openshift-image-registry/node-ca-q6j5f","openshift-multus/multus-additional-cni-plugins-55zf6","openshift-multus/network-metrics-daemon-7d42f","openshift-ovn-kubernetes/ovnkube-node-zcsh6"] Jul 08 17:19:24.412553 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.412528 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:24.412675 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:24.412629 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:24.413721 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.413694 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q6j5f" Jul 08 17:19:24.415098 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.415077 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.416368 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.416347 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mlbvh" Jul 08 17:19:24.416870 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.416852 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d6gwx\"" Jul 08 17:19:24.416988 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.416893 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 17:19:24.416988 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.416963 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 17:19:24.417130 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.416893 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 17:19:24.417130 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.417099 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 17:19:24.418054 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.417398 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:19:24.418054 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.417645 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dghgk\"" Jul 08 17:19:24.418054 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.417663 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 17:19:24.418269 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.418078 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.419017 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.418734 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 17:19:24.419017 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.418789 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 17:19:24.419017 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.418821 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bhbhr\"" Jul 08 17:19:24.419533 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.419516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.421024 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.421004 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:24.421148 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:24.421080 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:24.421708 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.421572 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 17:19:24.421708 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.421587 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 17:19:24.421708 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.421594 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 17:19:24.421926 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.421900 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 17:19:24.421981 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.421970 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 17:19:24.422037 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.422017 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p567b\"" Jul 08 17:19:24.422158 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.422141 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 17:19:24.422309 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.422286 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 17:19:24.422436 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.422403 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 17:19:24.422516 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.422449 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l68k6\"" Jul 08 17:19:24.422932 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.422913 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 17:19:24.423025 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.422947 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 17:19:24.423315 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.423296 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:24.423456 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:24.423427 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:24.424990 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.424968 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.427980 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.427952 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 17:19:24.428081 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428042 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4c4dq\"" Jul 08 17:19:24.428255 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428231 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 17:19:24.428360 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxp7s\" (UniqueName: \"kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s\") pod \"network-check-target-t6pnw\" (UID: \"60291575-8ddc-4865-9843-7c1dce4ae577\") " pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:24.428360 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1add5133-1160-4faa-9d29-bfbca1e93373-hosts-file\") pod \"node-resolver-mlbvh\" (UID: \"1add5133-1160-4faa-9d29-bfbca1e93373\") " pod="openshift-dns/node-resolver-mlbvh" Jul 08 17:19:24.428503 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-kubelet\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.428503 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428407 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 17:19:24.428503 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-slash\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.428699 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-var-lib-openvswitch\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.428699 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428542 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-run-ovn\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.428699 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-modprobe-d\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.428699 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-kubernetes\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.428699 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-run\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.428954 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428709 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7gpxr" Jul 08 17:19:24.428954 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428724 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-var-lib-kubelet\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.428954 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-host\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.428954 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428810 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-systemd-units\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.428954 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428859 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-node-log\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.428954 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-tuned\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.428954 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428935 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:19:24.428954 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428942 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63794e53-b258-4081-9d26-401596bea6c0-ovn-node-metrics-cert\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.429412 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.428975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63794e53-b258-4081-9d26-401596bea6c0-ovnkube-script-lib\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.429412 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/597b3e12-58cb-48f4-af62-539544a7652b-host\") pod \"node-ca-q6j5f\" (UID: \"597b3e12-58cb-48f4-af62-539544a7652b\") " pod="openshift-image-registry/node-ca-q6j5f" Jul 08 17:19:24.429412 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxx67\" (UniqueName: \"kubernetes.io/projected/597b3e12-58cb-48f4-af62-539544a7652b-kube-api-access-bxx67\") pod \"node-ca-q6j5f\" (UID: \"597b3e12-58cb-48f4-af62-539544a7652b\") " pod="openshift-image-registry/node-ca-q6j5f" Jul 08 17:19:24.429412 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-systemd\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.429412 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-run-systemd\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.429412 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-cni-netd\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.429412 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63794e53-b258-4081-9d26-401596bea6c0-env-overrides\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.429412 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg66x\" (UniqueName: \"kubernetes.io/projected/63794e53-b258-4081-9d26-401596bea6c0-kube-api-access-cg66x\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.429412 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-run-netns\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.429412 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-sysconfig\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.429412 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-lib-modules\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.429957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-tmp\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.429957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmsgg\" (UniqueName: \"kubernetes.io/projected/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-kube-api-access-fmsgg\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.429957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429565 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:24.429957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429647 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-log-socket\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.429957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-cni-bin\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.429957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.429957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-sys\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.429957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1add5133-1160-4faa-9d29-bfbca1e93373-tmp-dir\") pod \"node-resolver-mlbvh\" (UID: \"1add5133-1160-4faa-9d29-bfbca1e93373\") " pod="openshift-dns/node-resolver-mlbvh" Jul 08 17:19:24.430341 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.429971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-sysctl-d\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.430341 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.430009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-sysctl-conf\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.430341 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.430046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-etc-openvswitch\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.430341 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.430090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.430341 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.430129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63794e53-b258-4081-9d26-401596bea6c0-ovnkube-config\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.430341 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.430166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/597b3e12-58cb-48f4-af62-539544a7652b-serviceca\") pod \"node-ca-q6j5f\" (UID: \"597b3e12-58cb-48f4-af62-539544a7652b\") " pod="openshift-image-registry/node-ca-q6j5f" Jul 08 17:19:24.430341 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.430205 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmg9j\" (UniqueName: \"kubernetes.io/projected/1add5133-1160-4faa-9d29-bfbca1e93373-kube-api-access-xmg9j\") pod \"node-resolver-mlbvh\" (UID: \"1add5133-1160-4faa-9d29-bfbca1e93373\") " pod="openshift-dns/node-resolver-mlbvh" Jul 08 17:19:24.430341 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.430249 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-run-openvswitch\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.431226 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.431190 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:19:24.431966 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.431944 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 17:19:24.432860 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.432837 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.432860 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.432855 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5kv99\"" Jul 08 17:19:24.433424 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.433405 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 17:19:24.433534 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.433482 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 17:19:24.433741 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.433716 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 17:19:24.433900 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.433877 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b4qdq\"" Jul 08 17:19:24.435374 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.435348 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 17:19:24.435488 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.435469 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jzw72\"" Jul 08 17:19:24.435544 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.435473 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 17:19:24.453728 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.453711 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9thl" Jul 08 17:19:24.462012 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.461988 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9thl" Jul 08 17:19:24.518361 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.518281 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 17:19:24.530729 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.530683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-run-netns\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.530729 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.530728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-os-release\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.530941 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.530759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86e3f01d-8af0-45df-9b21-276e36b3ca00-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.530941 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.530793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/597b3e12-58cb-48f4-af62-539544a7652b-host\") pod \"node-ca-q6j5f\" (UID: \"597b3e12-58cb-48f4-af62-539544a7652b\") " pod="openshift-image-registry/node-ca-q6j5f" Jul 08 17:19:24.530941 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.530822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-cni-netd\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.530941 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.530850 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63794e53-b258-4081-9d26-401596bea6c0-env-overrides\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.530941 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.530870 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/597b3e12-58cb-48f4-af62-539544a7652b-host\") pod \"node-ca-q6j5f\" (UID: \"597b3e12-58cb-48f4-af62-539544a7652b\") " pod="openshift-image-registry/node-ca-q6j5f" Jul 08 17:19:24.530941 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.530875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-registration-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.530941 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.530923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47998b75-892f-4065-9222-416856399578-multus-daemon-config\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.530941 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.530927 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-cni-netd\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.531408 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531056 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b3df453-5011-4e82-8b55-e20ea1915796-dbus\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:24.531408 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-cni-bin\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.531408 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.531408 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531173 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-cni-bin\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.531408 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-multus-socket-dir-parent\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.531408 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctxbq\" (UniqueName: \"kubernetes.io/projected/46fce0f4-ee71-4245-88a4-80ead266f9ba-kube-api-access-ctxbq\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:24.531408 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531248 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.531408 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-sys\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.531408 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531358 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-sys\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.531408 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531392 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63794e53-b258-4081-9d26-401596bea6c0-env-overrides\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3bb8c29e-576c-41f9-ab48-231b2f9b39b9-agent-certs\") pod \"konnectivity-agent-qggbz\" (UID: \"3bb8c29e-576c-41f9-ab48-231b2f9b39b9\") " pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-run-multus-certs\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-sysctl-d\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531598 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-sysctl-conf\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63794e53-b258-4081-9d26-401596bea6c0-ovnkube-config\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-cnibin\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jlxw\" (UniqueName: \"kubernetes.io/projected/47998b75-892f-4065-9222-416856399578-kube-api-access-6jlxw\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmg9j\" (UniqueName: \"kubernetes.io/projected/1add5133-1160-4faa-9d29-bfbca1e93373-kube-api-access-xmg9j\") pod \"node-resolver-mlbvh\" (UID: \"1add5133-1160-4faa-9d29-bfbca1e93373\") " pod="openshift-dns/node-resolver-mlbvh" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-run-openvswitch\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531705 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp977\" (UniqueName: \"kubernetes.io/projected/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-kube-api-access-fp977\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-device-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-kubelet\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531750 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-var-lib-openvswitch\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-socket-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-os-release\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.531951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-multus-conf-dir\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-tuning-conf-dir\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86e3f01d-8af0-45df-9b21-276e36b3ca00-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-var-lib-kubelet\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-node-log\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63794e53-b258-4081-9d26-401596bea6c0-ovnkube-script-lib\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-tuned\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63794e53-b258-4081-9d26-401596bea6c0-ovn-node-metrics-cert\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-var-lib-kubelet\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.531993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-cnibin\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b3df453-5011-4e82-8b55-e20ea1915796-kubelet-config\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxx67\" (UniqueName: \"kubernetes.io/projected/597b3e12-58cb-48f4-af62-539544a7652b-kube-api-access-bxx67\") pod \"node-ca-q6j5f\" (UID: \"597b3e12-58cb-48f4-af62-539544a7652b\") " pod="openshift-image-registry/node-ca-q6j5f" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-systemd\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-run-systemd\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg66x\" (UniqueName: \"kubernetes.io/projected/63794e53-b258-4081-9d26-401596bea6c0-kube-api-access-cg66x\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-run-netns\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.532771 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-sysconfig\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-lib-modules\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-tmp\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmsgg\" (UniqueName: \"kubernetes.io/projected/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-kube-api-access-fmsgg\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-log-socket\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-run-k8s-cni-cncf-io\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532264 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-hostroot\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1add5133-1160-4faa-9d29-bfbca1e93373-tmp-dir\") pod \"node-resolver-mlbvh\" (UID: \"1add5133-1160-4faa-9d29-bfbca1e93373\") " pod="openshift-dns/node-resolver-mlbvh" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-var-lib-cni-bin\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e755baff-cb61-49f1-affa-6b3c1206644d-iptables-alerter-script\") pod \"iptables-alerter-7gpxr\" (UID: \"e755baff-cb61-49f1-affa-6b3c1206644d\") " pod="openshift-network-operator/iptables-alerter-7gpxr" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp9jj\" (UniqueName: \"kubernetes.io/projected/e755baff-cb61-49f1-affa-6b3c1206644d-kube-api-access-jp9jj\") pod \"iptables-alerter-7gpxr\" (UID: \"e755baff-cb61-49f1-affa-6b3c1206644d\") " pod="openshift-network-operator/iptables-alerter-7gpxr" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86e3f01d-8af0-45df-9b21-276e36b3ca00-cni-binary-copy\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-etc-openvswitch\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-etc-kubernetes\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-system-cni-dir\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.533644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brg8b\" (UniqueName: \"kubernetes.io/projected/86e3f01d-8af0-45df-9b21-276e36b3ca00-kube-api-access-brg8b\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/597b3e12-58cb-48f4-af62-539544a7652b-serviceca\") pod \"node-ca-q6j5f\" (UID: \"597b3e12-58cb-48f4-af62-539544a7652b\") " pod="openshift-image-registry/node-ca-q6j5f" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-sys-fs\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-var-lib-cni-multus\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e755baff-cb61-49f1-affa-6b3c1206644d-host-slash\") pod \"iptables-alerter-7gpxr\" (UID: \"e755baff-cb61-49f1-affa-6b3c1206644d\") " pod="openshift-network-operator/iptables-alerter-7gpxr" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxp7s\" (UniqueName: \"kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s\") pod \"network-check-target-t6pnw\" (UID: \"60291575-8ddc-4865-9843-7c1dce4ae577\") " pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1add5133-1160-4faa-9d29-bfbca1e93373-hosts-file\") pod \"node-resolver-mlbvh\" (UID: \"1add5133-1160-4faa-9d29-bfbca1e93373\") " pod="openshift-dns/node-resolver-mlbvh" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-slash\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532656 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-run-ovn\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47998b75-892f-4065-9222-416856399578-cni-binary-copy\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-modprobe-d\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-kubernetes\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-run\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-host\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-systemd-units\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-system-cni-dir\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.534520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-multus-cni-dir\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.532918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3bb8c29e-576c-41f9-ab48-231b2f9b39b9-konnectivity-ca\") pod \"konnectivity-agent-qggbz\" (UID: \"3bb8c29e-576c-41f9-ab48-231b2f9b39b9\") " pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.533154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-sysctl-d\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.533297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-sysctl-conf\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.533825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63794e53-b258-4081-9d26-401596bea6c0-ovnkube-config\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.534187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1add5133-1160-4faa-9d29-bfbca1e93373-tmp-dir\") pod \"node-resolver-mlbvh\" (UID: \"1add5133-1160-4faa-9d29-bfbca1e93373\") " pod="openshift-dns/node-resolver-mlbvh" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.534342 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-etc-openvswitch\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.534342 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-run-openvswitch\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.534407 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.534494 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-kubelet\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.534541 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-var-lib-openvswitch\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.534639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-var-lib-kubelet\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.534684 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-node-log\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.534838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/597b3e12-58cb-48f4-af62-539544a7652b-serviceca\") pod \"node-ca-q6j5f\" (UID: \"597b3e12-58cb-48f4-af62-539544a7652b\") " pod="openshift-image-registry/node-ca-q6j5f" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535131 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1add5133-1160-4faa-9d29-bfbca1e93373-hosts-file\") pod \"node-resolver-mlbvh\" (UID: \"1add5133-1160-4faa-9d29-bfbca1e93373\") " pod="openshift-dns/node-resolver-mlbvh" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535150 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63794e53-b258-4081-9d26-401596bea6c0-ovnkube-script-lib\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535182 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-slash\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535227 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-run-ovn\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.535379 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-modprobe-d\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.536293 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535414 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 17:19:24.536293 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-kubernetes\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.536293 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535526 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-run\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.536293 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535571 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-host\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.536293 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535610 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-systemd-units\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.536293 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-run-systemd\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.536293 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.535924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-lib-modules\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.536293 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.536172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-host-run-netns\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.536293 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.536234 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-sysconfig\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.537957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.537004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-systemd\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.537957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.537055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63794e53-b258-4081-9d26-401596bea6c0-log-socket\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.540695 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:24.540663 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:24.540695 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:24.540691 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:24.540975 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:24.540709 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mxp7s for pod openshift-network-diagnostics/network-check-target-t6pnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:24.540975 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:24.540792 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s podName:60291575-8ddc-4865-9843-7c1dce4ae577 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:25.040768138 +0000 UTC m=+2.983527450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mxp7s" (UniqueName: "kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s") pod "network-check-target-t6pnw" (UID: "60291575-8ddc-4865-9843-7c1dce4ae577") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:24.543688 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.543655 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-etc-tuned\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.545224 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.545163 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg66x\" (UniqueName: \"kubernetes.io/projected/63794e53-b258-4081-9d26-401596bea6c0-kube-api-access-cg66x\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.546787 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.546767 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-tmp\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.548993 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.548513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63794e53-b258-4081-9d26-401596bea6c0-ovn-node-metrics-cert\") pod \"ovnkube-node-zcsh6\" (UID: \"63794e53-b258-4081-9d26-401596bea6c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.550328 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.550307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmg9j\" (UniqueName: \"kubernetes.io/projected/1add5133-1160-4faa-9d29-bfbca1e93373-kube-api-access-xmg9j\") pod \"node-resolver-mlbvh\" (UID: \"1add5133-1160-4faa-9d29-bfbca1e93373\") " pod="openshift-dns/node-resolver-mlbvh" Jul 08 17:19:24.555483 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.554868 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmsgg\" (UniqueName: \"kubernetes.io/projected/b95ea97b-d55a-4d69-b6c9-cf2441ab0461-kube-api-access-fmsgg\") pod \"tuned-9xwtx\" (UID: \"b95ea97b-d55a-4d69-b6c9-cf2441ab0461\") " pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.555991 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.555946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxx67\" (UniqueName: \"kubernetes.io/projected/597b3e12-58cb-48f4-af62-539544a7652b-kube-api-access-bxx67\") pod \"node-ca-q6j5f\" (UID: \"597b3e12-58cb-48f4-af62-539544a7652b\") " pod="openshift-image-registry/node-ca-q6j5f" Jul 08 17:19:24.557578 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.557527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" event={"ID":"21c6eb4a75675630f6b8228d54bfaa3a","Type":"ContainerStarted","Data":"8271d68038e8c6f1bbe327300af23cc75ecd7e1ed772f60b2ebe6d2abea1e7a5"} Jul 08 17:19:24.559622 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.559589 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" event={"ID":"670c0e119250ff548cdf2ae2ee0e9dc5","Type":"ContainerStarted","Data":"35ad6d932156c16e8e31b631d54bc81515774d9b47d43265b16c6e950eb9eb20"} Jul 08 17:19:24.633688 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-multus-conf-dir\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.633892 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-tuning-conf-dir\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.633892 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86e3f01d-8af0-45df-9b21-276e36b3ca00-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.633892 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-var-lib-kubelet\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.633892 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-cnibin\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.633892 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b3df453-5011-4e82-8b55-e20ea1915796-kubelet-config\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:24.633892 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.633892 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-run-k8s-cni-cncf-io\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.633892 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-hostroot\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-var-lib-cni-bin\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e755baff-cb61-49f1-affa-6b3c1206644d-iptables-alerter-script\") pod \"iptables-alerter-7gpxr\" (UID: \"e755baff-cb61-49f1-affa-6b3c1206644d\") " pod="openshift-network-operator/iptables-alerter-7gpxr" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9jj\" (UniqueName: \"kubernetes.io/projected/e755baff-cb61-49f1-affa-6b3c1206644d-kube-api-access-jp9jj\") pod \"iptables-alerter-7gpxr\" (UID: \"e755baff-cb61-49f1-affa-6b3c1206644d\") " pod="openshift-network-operator/iptables-alerter-7gpxr" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.633978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86e3f01d-8af0-45df-9b21-276e36b3ca00-cni-binary-copy\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-etc-kubernetes\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-system-cni-dir\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brg8b\" (UniqueName: \"kubernetes.io/projected/86e3f01d-8af0-45df-9b21-276e36b3ca00-kube-api-access-brg8b\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-sys-fs\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-var-lib-cni-multus\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e755baff-cb61-49f1-affa-6b3c1206644d-host-slash\") pod \"iptables-alerter-7gpxr\" (UID: \"e755baff-cb61-49f1-affa-6b3c1206644d\") " pod="openshift-network-operator/iptables-alerter-7gpxr" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634198 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47998b75-892f-4065-9222-416856399578-cni-binary-copy\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-system-cni-dir\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.634305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-multus-cni-dir\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3bb8c29e-576c-41f9-ab48-231b2f9b39b9-konnectivity-ca\") pod \"konnectivity-agent-qggbz\" (UID: \"3bb8c29e-576c-41f9-ab48-231b2f9b39b9\") " pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-run-netns\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634373 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-os-release\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86e3f01d-8af0-45df-9b21-276e36b3ca00-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-registration-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47998b75-892f-4065-9222-416856399578-multus-daemon-config\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b3df453-5011-4e82-8b55-e20ea1915796-dbus\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-multus-socket-dir-parent\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctxbq\" (UniqueName: \"kubernetes.io/projected/46fce0f4-ee71-4245-88a4-80ead266f9ba-kube-api-access-ctxbq\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3bb8c29e-576c-41f9-ab48-231b2f9b39b9-agent-certs\") pod \"konnectivity-agent-qggbz\" (UID: \"3bb8c29e-576c-41f9-ab48-231b2f9b39b9\") " pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634617 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-run-multus-certs\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-cnibin\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jlxw\" (UniqueName: \"kubernetes.io/projected/47998b75-892f-4065-9222-416856399578-kube-api-access-6jlxw\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp977\" (UniqueName: \"kubernetes.io/projected/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-kube-api-access-fp977\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-device-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.635074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-socket-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.635976 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.634824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-os-release\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.635976 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.635008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-os-release\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.635976 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.635096 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-multus-conf-dir\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.635976 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.635270 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-tuning-conf-dir\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.635976 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.635961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86e3f01d-8af0-45df-9b21-276e36b3ca00-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.636223 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.636032 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-var-lib-kubelet\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.636223 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.636092 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-cnibin\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.636223 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.636144 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b3df453-5011-4e82-8b55-e20ea1915796-kubelet-config\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:24.636378 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.636252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.636378 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.636341 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-run-k8s-cni-cncf-io\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.636508 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.636383 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-hostroot\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.636508 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.636422 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-var-lib-cni-bin\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.636922 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.636903 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e755baff-cb61-49f1-affa-6b3c1206644d-iptables-alerter-script\") pod \"iptables-alerter-7gpxr\" (UID: \"e755baff-cb61-49f1-affa-6b3c1206644d\") " pod="openshift-network-operator/iptables-alerter-7gpxr" Jul 08 17:19:24.637511 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.637491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86e3f01d-8af0-45df-9b21-276e36b3ca00-cni-binary-copy\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.637616 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:24.637592 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:24.637685 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:24.637672 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs podName:46fce0f4-ee71-4245-88a4-80ead266f9ba nodeName:}" failed. No retries permitted until 2026-07-08 17:19:25.13765329 +0000 UTC m=+3.080412609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs") pod "network-metrics-daemon-7d42f" (UID: "46fce0f4-ee71-4245-88a4-80ead266f9ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:24.637861 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.637838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-etc-kubernetes\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.637951 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.637888 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-system-cni-dir\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.638137 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.638119 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-sys-fs\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.638221 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.638169 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-var-lib-cni-multus\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.638221 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.638212 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e755baff-cb61-49f1-affa-6b3c1206644d-host-slash\") pod \"iptables-alerter-7gpxr\" (UID: \"e755baff-cb61-49f1-affa-6b3c1206644d\") " pod="openshift-network-operator/iptables-alerter-7gpxr" Jul 08 17:19:24.638335 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.638262 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.638780 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.638747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47998b75-892f-4065-9222-416856399578-cni-binary-copy\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.638880 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.638827 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-system-cni-dir\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.638983 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.638967 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-multus-cni-dir\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.639555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-registration-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.639618 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-run-netns\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.639728 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86e3f01d-8af0-45df-9b21-276e36b3ca00-os-release\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:24.639758 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:24.639823 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret podName:4b3df453-5011-4e82-8b55-e20ea1915796 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:25.139806898 +0000 UTC m=+3.082566204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret") pod "global-pull-secret-syncer-g5x8g" (UID: "4b3df453-5011-4e82-8b55-e20ea1915796") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.639891 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-cnibin\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.640020 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-socket-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.640049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47998b75-892f-4065-9222-416856399578-multus-daemon-config\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.640141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-host-run-multus-certs\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.640154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47998b75-892f-4065-9222-416856399578-multus-socket-dir-parent\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.640212 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86e3f01d-8af0-45df-9b21-276e36b3ca00-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.640386 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.640281 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b3df453-5011-4e82-8b55-e20ea1915796-dbus\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:24.641020 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.640442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-device-dir\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.641191 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.641167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3bb8c29e-576c-41f9-ab48-231b2f9b39b9-konnectivity-ca\") pod \"konnectivity-agent-qggbz\" (UID: \"3bb8c29e-576c-41f9-ab48-231b2f9b39b9\") " pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:24.646673 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.646646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3bb8c29e-576c-41f9-ab48-231b2f9b39b9-agent-certs\") pod \"konnectivity-agent-qggbz\" (UID: \"3bb8c29e-576c-41f9-ab48-231b2f9b39b9\") " pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:24.649786 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.649762 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp9jj\" (UniqueName: \"kubernetes.io/projected/e755baff-cb61-49f1-affa-6b3c1206644d-kube-api-access-jp9jj\") pod \"iptables-alerter-7gpxr\" (UID: \"e755baff-cb61-49f1-affa-6b3c1206644d\") " pod="openshift-network-operator/iptables-alerter-7gpxr" Jul 08 17:19:24.653840 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.653816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp977\" (UniqueName: \"kubernetes.io/projected/76b83cd7-9338-4189-aeed-0aa1d8f9b56b-kube-api-access-fp977\") pod \"aws-ebs-csi-driver-node-rs2jp\" (UID: \"76b83cd7-9338-4189-aeed-0aa1d8f9b56b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.655278 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.655249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jlxw\" (UniqueName: \"kubernetes.io/projected/47998b75-892f-4065-9222-416856399578-kube-api-access-6jlxw\") pod \"multus-9sszx\" (UID: \"47998b75-892f-4065-9222-416856399578\") " pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.655956 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.655931 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brg8b\" (UniqueName: \"kubernetes.io/projected/86e3f01d-8af0-45df-9b21-276e36b3ca00-kube-api-access-brg8b\") pod \"multus-additional-cni-plugins-55zf6\" (UID: \"86e3f01d-8af0-45df-9b21-276e36b3ca00\") " pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.656372 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.656322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctxbq\" (UniqueName: \"kubernetes.io/projected/46fce0f4-ee71-4245-88a4-80ead266f9ba-kube-api-access-ctxbq\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:24.727915 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.727885 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q6j5f" Jul 08 17:19:24.736595 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.736573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" Jul 08 17:19:24.739652 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:24.739626 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597b3e12_58cb_48f4_af62_539544a7652b.slice/crio-2a67ea8df16fef5ae0e8c311f7a4edc909ace29be828b6d40d17313d9e2a7da4 WatchSource:0}: Error finding container 2a67ea8df16fef5ae0e8c311f7a4edc909ace29be828b6d40d17313d9e2a7da4: Status 404 returned error can't find the container with id 2a67ea8df16fef5ae0e8c311f7a4edc909ace29be828b6d40d17313d9e2a7da4 Jul 08 17:19:24.745293 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.745270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mlbvh" Jul 08 17:19:24.754272 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.754253 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:24.754930 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:24.754905 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1add5133_1160_4faa_9d29_bfbca1e93373.slice/crio-7c3a3a8bd15c3a09f4c30ed04048c8522ed8e1098dd3037a5d8d03c077bd4ca2 WatchSource:0}: Error finding container 7c3a3a8bd15c3a09f4c30ed04048c8522ed8e1098dd3037a5d8d03c077bd4ca2: Status 404 returned error can't find the container with id 7c3a3a8bd15c3a09f4c30ed04048c8522ed8e1098dd3037a5d8d03c077bd4ca2 Jul 08 17:19:24.759914 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.759891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9sszx" Jul 08 17:19:24.762873 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:24.762828 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63794e53_b258_4081_9d26_401596bea6c0.slice/crio-481ec646227c315e30b5608a162694a5cbe619131e4557c3dd7077b80a360aec WatchSource:0}: Error finding container 481ec646227c315e30b5608a162694a5cbe619131e4557c3dd7077b80a360aec: Status 404 returned error can't find the container with id 481ec646227c315e30b5608a162694a5cbe619131e4557c3dd7077b80a360aec Jul 08 17:19:24.771806 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:24.771773 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47998b75_892f_4065_9222_416856399578.slice/crio-dfcf86a66ee9f97faf8ad661529a95c2fc1c7952a0ad0caecf626364a931f347 WatchSource:0}: Error finding container dfcf86a66ee9f97faf8ad661529a95c2fc1c7952a0ad0caecf626364a931f347: Status 404 returned error can't find the container with id dfcf86a66ee9f97faf8ad661529a95c2fc1c7952a0ad0caecf626364a931f347 Jul 08 17:19:24.772794 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.772633 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" Jul 08 17:19:24.783890 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.783854 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7gpxr" Jul 08 17:19:24.785482 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:24.785302 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b83cd7_9338_4189_aeed_0aa1d8f9b56b.slice/crio-86244e49eac80fe25af47afbba717618e1973b5fe1d936dc7c5b3b0079679e46 WatchSource:0}: Error finding container 86244e49eac80fe25af47afbba717618e1973b5fe1d936dc7c5b3b0079679e46: Status 404 returned error can't find the container with id 86244e49eac80fe25af47afbba717618e1973b5fe1d936dc7c5b3b0079679e46 Jul 08 17:19:24.790520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.790472 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:24.792251 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:24.792222 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode755baff_cb61_49f1_affa_6b3c1206644d.slice/crio-e2909d1bc540ed7f6df8c9cf06b55fd288ab0b867c606e736a01c76190b3cf6b WatchSource:0}: Error finding container e2909d1bc540ed7f6df8c9cf06b55fd288ab0b867c606e736a01c76190b3cf6b: Status 404 returned error can't find the container with id e2909d1bc540ed7f6df8c9cf06b55fd288ab0b867c606e736a01c76190b3cf6b Jul 08 17:19:24.796889 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:24.796867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-55zf6" Jul 08 17:19:24.798779 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:24.798756 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb8c29e_576c_41f9_ab48_231b2f9b39b9.slice/crio-a3d88d4528c276978304ca1f3bf8d74c2018f9dcf4fa1d7b13efc14e5d0158bc WatchSource:0}: Error finding container a3d88d4528c276978304ca1f3bf8d74c2018f9dcf4fa1d7b13efc14e5d0158bc: Status 404 returned error can't find the container with id a3d88d4528c276978304ca1f3bf8d74c2018f9dcf4fa1d7b13efc14e5d0158bc Jul 08 17:19:24.808467 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:24.808440 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e3f01d_8af0_45df_9b21_276e36b3ca00.slice/crio-dfd74ed21247972f668e37ef430c4b9d3aa50cecc591c51e535adc92ce0af4fd WatchSource:0}: Error finding container dfd74ed21247972f668e37ef430c4b9d3aa50cecc591c51e535adc92ce0af4fd: Status 404 returned error can't find the container with id dfd74ed21247972f668e37ef430c4b9d3aa50cecc591c51e535adc92ce0af4fd Jul 08 17:19:25.138909 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.138874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:25.139057 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.138923 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxp7s\" (UniqueName: \"kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s\") pod \"network-check-target-t6pnw\" (UID: \"60291575-8ddc-4865-9843-7c1dce4ae577\") " pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:25.139098 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:25.139052 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:25.139098 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:25.139074 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:25.139098 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:25.139089 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:25.139216 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:25.139102 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mxp7s for pod openshift-network-diagnostics/network-check-target-t6pnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:25.139216 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:25.139129 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs podName:46fce0f4-ee71-4245-88a4-80ead266f9ba nodeName:}" failed. No retries permitted until 2026-07-08 17:19:26.139109289 +0000 UTC m=+4.081868604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs") pod "network-metrics-daemon-7d42f" (UID: "46fce0f4-ee71-4245-88a4-80ead266f9ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:25.139216 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:25.139147 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s podName:60291575-8ddc-4865-9843-7c1dce4ae577 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:26.139135719 +0000 UTC m=+4.081895013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxp7s" (UniqueName: "kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s") pod "network-check-target-t6pnw" (UID: "60291575-8ddc-4865-9843-7c1dce4ae577") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:25.240097 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.240057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:25.240280 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:25.240207 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:25.240280 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:25.240272 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret podName:4b3df453-5011-4e82-8b55-e20ea1915796 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:26.240258919 +0000 UTC m=+4.183018212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret") pod "global-pull-secret-syncer-g5x8g" (UID: "4b3df453-5011-4e82-8b55-e20ea1915796") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:25.464848 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.464758 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:14:25 +0000 UTC" deadline="2028-02-04 08:30:56.774562806 +0000 UTC" Jul 08 17:19:25.464848 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.464805 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13815h11m31.309760577s" Jul 08 17:19:25.562551 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.562502 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" event={"ID":"76b83cd7-9338-4189-aeed-0aa1d8f9b56b","Type":"ContainerStarted","Data":"86244e49eac80fe25af47afbba717618e1973b5fe1d936dc7c5b3b0079679e46"} Jul 08 17:19:25.563872 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.563836 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9sszx" event={"ID":"47998b75-892f-4065-9222-416856399578","Type":"ContainerStarted","Data":"dfcf86a66ee9f97faf8ad661529a95c2fc1c7952a0ad0caecf626364a931f347"} Jul 08 17:19:25.565224 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.565200 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" event={"ID":"63794e53-b258-4081-9d26-401596bea6c0","Type":"ContainerStarted","Data":"481ec646227c315e30b5608a162694a5cbe619131e4557c3dd7077b80a360aec"} Jul 08 17:19:25.566464 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.566424 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55zf6" event={"ID":"86e3f01d-8af0-45df-9b21-276e36b3ca00","Type":"ContainerStarted","Data":"dfd74ed21247972f668e37ef430c4b9d3aa50cecc591c51e535adc92ce0af4fd"} Jul 08 17:19:25.567681 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.567656 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qggbz" event={"ID":"3bb8c29e-576c-41f9-ab48-231b2f9b39b9","Type":"ContainerStarted","Data":"a3d88d4528c276978304ca1f3bf8d74c2018f9dcf4fa1d7b13efc14e5d0158bc"} Jul 08 17:19:25.568908 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.568879 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7gpxr" event={"ID":"e755baff-cb61-49f1-affa-6b3c1206644d","Type":"ContainerStarted","Data":"e2909d1bc540ed7f6df8c9cf06b55fd288ab0b867c606e736a01c76190b3cf6b"} Jul 08 17:19:25.570190 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.570159 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mlbvh" event={"ID":"1add5133-1160-4faa-9d29-bfbca1e93373","Type":"ContainerStarted","Data":"7c3a3a8bd15c3a09f4c30ed04048c8522ed8e1098dd3037a5d8d03c077bd4ca2"} Jul 08 17:19:25.571525 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.571497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" event={"ID":"b95ea97b-d55a-4d69-b6c9-cf2441ab0461","Type":"ContainerStarted","Data":"6e79e5950e664d499f758da99908915a56f9fd13a84a0429e131d61a8a9e5ed1"} Jul 08 17:19:25.572763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:25.572743 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q6j5f" event={"ID":"597b3e12-58cb-48f4-af62-539544a7652b","Type":"ContainerStarted","Data":"2a67ea8df16fef5ae0e8c311f7a4edc909ace29be828b6d40d17313d9e2a7da4"} Jul 08 17:19:26.149711 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:26.148838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:26.149711 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:26.148895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxp7s\" (UniqueName: \"kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s\") pod \"network-check-target-t6pnw\" (UID: \"60291575-8ddc-4865-9843-7c1dce4ae577\") " pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:26.149711 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:26.149098 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:26.149711 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:26.149118 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:26.149711 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:26.149132 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mxp7s for pod openshift-network-diagnostics/network-check-target-t6pnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:26.149711 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:26.149194 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s podName:60291575-8ddc-4865-9843-7c1dce4ae577 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:28.149174349 +0000 UTC m=+6.091933646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxp7s" (UniqueName: "kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s") pod "network-check-target-t6pnw" (UID: "60291575-8ddc-4865-9843-7c1dce4ae577") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:26.149711 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:26.149668 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:26.149711 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:26.149728 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs podName:46fce0f4-ee71-4245-88a4-80ead266f9ba nodeName:}" failed. No retries permitted until 2026-07-08 17:19:28.149710898 +0000 UTC m=+6.092470211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs") pod "network-metrics-daemon-7d42f" (UID: "46fce0f4-ee71-4245-88a4-80ead266f9ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:26.249350 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:26.249307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:26.249542 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:26.249475 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:26.249542 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:26.249543 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret podName:4b3df453-5011-4e82-8b55-e20ea1915796 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:28.249523977 +0000 UTC m=+6.192283278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret") pod "global-pull-secret-syncer-g5x8g" (UID: "4b3df453-5011-4e82-8b55-e20ea1915796") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:26.465093 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:26.464990 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:14:25 +0000 UTC" deadline="2027-12-02 16:17:04.594442836 +0000 UTC" Jul 08 17:19:26.465093 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:26.465034 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12286h57m38.12941343s" Jul 08 17:19:26.555446 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:26.555403 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:26.555626 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:26.555573 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:26.556042 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:26.556017 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:26.556139 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:26.556119 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:26.556201 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:26.556177 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:26.556283 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:26.556244 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:27.604372 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:27.604032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" event={"ID":"21c6eb4a75675630f6b8228d54bfaa3a","Type":"ContainerStarted","Data":"b5a5b32dc058c70eac7542d1795864df86a90c584d442ddf3cfbd95f1936ac7e"} Jul 08 17:19:28.175234 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:28.175144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:28.175234 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:28.175204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxp7s\" (UniqueName: \"kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s\") pod \"network-check-target-t6pnw\" (UID: \"60291575-8ddc-4865-9843-7c1dce4ae577\") " pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:28.175502 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:28.175361 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:28.175502 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:28.175365 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:28.175502 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:28.175461 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs podName:46fce0f4-ee71-4245-88a4-80ead266f9ba nodeName:}" failed. No retries permitted until 2026-07-08 17:19:32.175436996 +0000 UTC m=+10.118196309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs") pod "network-metrics-daemon-7d42f" (UID: "46fce0f4-ee71-4245-88a4-80ead266f9ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:28.175502 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:28.175466 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:28.175502 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:28.175482 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mxp7s for pod openshift-network-diagnostics/network-check-target-t6pnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:28.175776 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:28.175538 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s podName:60291575-8ddc-4865-9843-7c1dce4ae577 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:32.175518311 +0000 UTC m=+10.118277663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxp7s" (UniqueName: "kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s") pod "network-check-target-t6pnw" (UID: "60291575-8ddc-4865-9843-7c1dce4ae577") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:28.276594 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:28.276551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:28.276790 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:28.276772 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:28.276855 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:28.276840 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret podName:4b3df453-5011-4e82-8b55-e20ea1915796 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:32.276821179 +0000 UTC m=+10.219580475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret") pod "global-pull-secret-syncer-g5x8g" (UID: "4b3df453-5011-4e82-8b55-e20ea1915796") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:28.553624 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:28.553545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:28.553797 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:28.553686 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:28.554108 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:28.554085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:28.554221 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:28.554197 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:28.554587 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:28.554560 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:28.554685 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:28.554661 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:28.612477 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:28.612219 2577 generic.go:356] "Generic (PLEG): container finished" podID="670c0e119250ff548cdf2ae2ee0e9dc5" containerID="bed1780f8dc1ae9aa7ec8e8c2813796a955180da3d559724ba0cbdbd419c7b16" exitCode=0 Jul 08 17:19:28.613328 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:28.612982 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" event={"ID":"670c0e119250ff548cdf2ae2ee0e9dc5","Type":"ContainerDied","Data":"bed1780f8dc1ae9aa7ec8e8c2813796a955180da3d559724ba0cbdbd419c7b16"} Jul 08 17:19:28.631647 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:28.630863 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-225.ec2.internal" podStartSLOduration=4.630840137 podStartE2EDuration="4.630840137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:27.624636653 +0000 UTC m=+5.567395974" watchObservedRunningTime="2026-07-08 17:19:28.630840137 +0000 UTC m=+6.573599459" Jul 08 17:19:30.554622 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:30.554539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:30.555096 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:30.554670 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:30.555096 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:30.555070 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:30.555226 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:30.555168 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:30.555284 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:30.555228 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:30.555341 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:30.555314 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:32.208675 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:32.208357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:32.208675 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:32.208440 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxp7s\" (UniqueName: \"kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s\") pod \"network-check-target-t6pnw\" (UID: \"60291575-8ddc-4865-9843-7c1dce4ae577\") " pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:32.208675 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:32.208495 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:32.208675 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:32.208567 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs podName:46fce0f4-ee71-4245-88a4-80ead266f9ba nodeName:}" failed. No retries permitted until 2026-07-08 17:19:40.208544773 +0000 UTC m=+18.151304067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs") pod "network-metrics-daemon-7d42f" (UID: "46fce0f4-ee71-4245-88a4-80ead266f9ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:32.208675 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:32.208591 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:32.208675 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:32.208607 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:32.208675 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:32.208617 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mxp7s for pod openshift-network-diagnostics/network-check-target-t6pnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:32.208675 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:32.208654 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s podName:60291575-8ddc-4865-9843-7c1dce4ae577 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:40.208643124 +0000 UTC m=+18.151402417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxp7s" (UniqueName: "kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s") pod "network-check-target-t6pnw" (UID: "60291575-8ddc-4865-9843-7c1dce4ae577") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:32.309238 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:32.309140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:32.309429 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:32.309289 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:32.309429 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:32.309361 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret podName:4b3df453-5011-4e82-8b55-e20ea1915796 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:40.309342447 +0000 UTC m=+18.252101749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret") pod "global-pull-secret-syncer-g5x8g" (UID: "4b3df453-5011-4e82-8b55-e20ea1915796") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:32.554734 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:32.554230 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:32.554734 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:32.554285 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:32.554734 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:32.554354 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:32.554734 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:32.554428 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:32.554734 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:32.554502 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:32.554734 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:32.554573 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:34.553361 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:34.552896 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:34.553361 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:34.553022 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:34.553361 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:34.553326 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:34.553940 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:34.553468 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:34.553940 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:34.553514 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:34.553940 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:34.553582 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:36.552642 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:36.552598 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:36.552642 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:36.552616 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:36.553147 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:36.552702 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:36.553147 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:36.552790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:36.553147 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:36.552791 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:36.553147 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:36.552874 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:38.552480 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:38.552442 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:38.552925 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:38.552441 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:38.552925 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:38.552572 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:38.552925 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:38.552624 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:38.552925 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:38.552725 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:38.552925 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:38.552795 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:40.268488 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:40.268454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:40.268488 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:40.268505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxp7s\" (UniqueName: \"kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s\") pod \"network-check-target-t6pnw\" (UID: \"60291575-8ddc-4865-9843-7c1dce4ae577\") " pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:40.269038 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:40.268612 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:40.269038 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:40.268630 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:40.269038 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:40.268649 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:40.269038 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:40.268662 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mxp7s for pod openshift-network-diagnostics/network-check-target-t6pnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:40.269038 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:40.268685 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs podName:46fce0f4-ee71-4245-88a4-80ead266f9ba nodeName:}" failed. No retries permitted until 2026-07-08 17:19:56.268663552 +0000 UTC m=+34.211422848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs") pod "network-metrics-daemon-7d42f" (UID: "46fce0f4-ee71-4245-88a4-80ead266f9ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:40.269038 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:40.268713 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s podName:60291575-8ddc-4865-9843-7c1dce4ae577 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:56.268696837 +0000 UTC m=+34.211456150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxp7s" (UniqueName: "kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s") pod "network-check-target-t6pnw" (UID: "60291575-8ddc-4865-9843-7c1dce4ae577") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:40.369677 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:40.369619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:40.369840 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:40.369747 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:40.369840 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:40.369816 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret podName:4b3df453-5011-4e82-8b55-e20ea1915796 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:56.369795921 +0000 UTC m=+34.312555221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret") pod "global-pull-secret-syncer-g5x8g" (UID: "4b3df453-5011-4e82-8b55-e20ea1915796") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:40.552953 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:40.552931 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:40.552953 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:40.552948 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:40.553135 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:40.552932 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:40.553135 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:40.553024 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:40.553135 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:40.553097 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:40.553275 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:40.553199 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:42.553689 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:42.553657 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:42.554136 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:42.553759 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:42.554136 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:42.553812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:42.554136 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:42.553921 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:42.554136 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:42.553954 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:42.554136 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:42.554033 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:44.552684 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:44.552649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:44.553325 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:44.552664 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:44.553325 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:44.552776 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:44.553325 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:44.552782 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:44.553325 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:44.552879 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:44.553325 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:44.552959 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:45.650602 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.650211 2577 generic.go:356] "Generic (PLEG): container finished" podID="86e3f01d-8af0-45df-9b21-276e36b3ca00" containerID="8006129f3ccb873378dfb7a1e47649df0ffd0de2bb444788a5a8670341e73b0f" exitCode=0 Jul 08 17:19:45.650602 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.650298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55zf6" event={"ID":"86e3f01d-8af0-45df-9b21-276e36b3ca00","Type":"ContainerDied","Data":"8006129f3ccb873378dfb7a1e47649df0ffd0de2bb444788a5a8670341e73b0f"} Jul 08 17:19:45.652163 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.652128 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qggbz" event={"ID":"3bb8c29e-576c-41f9-ab48-231b2f9b39b9","Type":"ContainerStarted","Data":"77577df41a7ec53000eed0f3d4db7502a602e9d722c71dde39b76c23afb0f87a"} Jul 08 17:19:45.653971 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.653942 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mlbvh" event={"ID":"1add5133-1160-4faa-9d29-bfbca1e93373","Type":"ContainerStarted","Data":"ab5388807f6510c97c837505be6e308000dd569386caa123eb5e7da4214e7a47"} Jul 08 17:19:45.655483 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.655460 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" event={"ID":"b95ea97b-d55a-4d69-b6c9-cf2441ab0461","Type":"ContainerStarted","Data":"a2134375107a47fc0d968ee2204c4caed9426a751efdd79c3880ed0d2afbb90b"} Jul 08 17:19:45.656976 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.656955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q6j5f" event={"ID":"597b3e12-58cb-48f4-af62-539544a7652b","Type":"ContainerStarted","Data":"339fecdb8f0bb4ff13aa116a52497dada5f726d548e44c54fa1b7393255fa069"} Jul 08 17:19:45.658909 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.658884 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" event={"ID":"670c0e119250ff548cdf2ae2ee0e9dc5","Type":"ContainerStarted","Data":"f414c38d53c59068e81246685a080d806177829939eaf092509708fe1a5d395b"} Jul 08 17:19:45.660303 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.660284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" event={"ID":"76b83cd7-9338-4189-aeed-0aa1d8f9b56b","Type":"ContainerStarted","Data":"01e9dc9f3be456ac35012bcbe37bd3fa48a75d8904410b70bf0c85d199d03a34"} Jul 08 17:19:45.661738 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.661717 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9sszx" event={"ID":"47998b75-892f-4065-9222-416856399578","Type":"ContainerStarted","Data":"1a0fdbe0447686937f26cccc707d13f5e10053b6f5811ebb048419d27b7a7cdb"} Jul 08 17:19:45.664640 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.664621 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" event={"ID":"63794e53-b258-4081-9d26-401596bea6c0","Type":"ContainerStarted","Data":"42e75f0c134b7f95c22c571093c2860b06ac6781cf77a4319d1fe52750fe7830"} Jul 08 17:19:45.664725 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.664677 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" event={"ID":"63794e53-b258-4081-9d26-401596bea6c0","Type":"ContainerStarted","Data":"0bb50087bcbeb58593e8c091a69045245193fc79ad3a76a0944005d3bf04fc84"} Jul 08 17:19:45.664725 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.664720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" event={"ID":"63794e53-b258-4081-9d26-401596bea6c0","Type":"ContainerStarted","Data":"10698e172dad5ecbe55fca173960382df4d0598354cd5d0b18e04f583acd4117"} Jul 08 17:19:45.664807 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.664748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" event={"ID":"63794e53-b258-4081-9d26-401596bea6c0","Type":"ContainerStarted","Data":"260b2234b3f2a1bd73cefa03200d6b94d28e9d3d51801085fc59c9e180d34a92"} Jul 08 17:19:45.664807 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.664774 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" event={"ID":"63794e53-b258-4081-9d26-401596bea6c0","Type":"ContainerStarted","Data":"22c0ab596c1659f6ff974a8705edf3e7b4ce4675e4af586e8dd9ef55cfafe5a9"} Jul 08 17:19:45.664807 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.664799 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" event={"ID":"63794e53-b258-4081-9d26-401596bea6c0","Type":"ContainerStarted","Data":"ab06537a5576415ecda44ef368d9342b30e154c4895bef64fed446a299a71afb"} Jul 08 17:19:45.694535 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.694500 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qggbz" podStartSLOduration=6.963983499 podStartE2EDuration="22.694487796s" totalImagesPullingTime="15.730504297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:45.693985423 +0000 UTC m=+23.636744740" watchObservedRunningTime="2026-07-08 17:19:45.694487796 +0000 UTC m=+23.637247110" Jul 08 17:19:45.708097 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.708054 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q6j5f" podStartSLOduration=2.622815439 podStartE2EDuration="22.708039005s" totalImagesPullingTime="20.085223566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:45.708024397 +0000 UTC m=+23.650783714" watchObservedRunningTime="2026-07-08 17:19:45.708039005 +0000 UTC m=+23.650798319" Jul 08 17:19:45.741450 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.741412 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-225.ec2.internal" podStartSLOduration=21.741401411 podStartE2EDuration="21.741401411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:45.741169871 +0000 UTC m=+23.683929187" watchObservedRunningTime="2026-07-08 17:19:45.741401411 +0000 UTC m=+23.684160726" Jul 08 17:19:45.741574 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.741469 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9sszx" podStartSLOduration=2.641669103 podStartE2EDuration="22.741465382s" totalImagesPullingTime="20.099796279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:45.72526517 +0000 UTC m=+23.668024485" watchObservedRunningTime="2026-07-08 17:19:45.741465382 +0000 UTC m=+23.684224696" Jul 08 17:19:45.757869 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:45.757835 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9xwtx" podStartSLOduration=2.676623066 podStartE2EDuration="22.757824322s" totalImagesPullingTime="20.081201256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:45.757611306 +0000 UTC m=+23.700370619" watchObservedRunningTime="2026-07-08 17:19:45.757824322 +0000 UTC m=+23.700583636" Jul 08 17:19:46.553003 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:46.552973 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:46.553271 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:46.552973 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:46.553271 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:46.553117 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:46.553271 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:46.553179 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:46.553271 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:46.553084 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:46.553486 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:46.553298 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:46.668224 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:46.668186 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7gpxr" event={"ID":"e755baff-cb61-49f1-affa-6b3c1206644d","Type":"ContainerStarted","Data":"57248f3222705b27ebdf0f5ddc82ca14bbefebc8aac21a9e4f160bb630375697"} Jul 08 17:19:46.686697 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:46.686652 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mlbvh" podStartSLOduration=3.621129946 podStartE2EDuration="23.686632579s" totalImagesPullingTime="20.065502633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:45.772012769 +0000 UTC m=+23.714772083" watchObservedRunningTime="2026-07-08 17:19:46.686632579 +0000 UTC m=+24.629391893" Jul 08 17:19:46.686984 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:46.686950 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7gpxr" podStartSLOduration=7.951239725 podStartE2EDuration="23.68693952s" totalImagesPullingTime="15.735699795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:46.686218541 +0000 UTC m=+24.628977855" watchObservedRunningTime="2026-07-08 17:19:46.68693952 +0000 UTC m=+24.629698834" Jul 08 17:19:46.789406 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:46.789268 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 17:19:47.486339 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:47.486222 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T17:19:46.789286054Z","UUID":"b7000eed-f872-4c87-a75a-32cfd710af14","Handler":null,"Name":"","Endpoint":""} Jul 08 17:19:47.488019 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:47.487994 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 17:19:47.488164 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:47.488041 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 17:19:47.499227 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:47.499204 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:47.499811 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:47.499791 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:47.673538 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:47.673510 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" event={"ID":"76b83cd7-9338-4189-aeed-0aa1d8f9b56b","Type":"ContainerStarted","Data":"2786bcdfebbc53603659eb8b70ca9f6c0db007f7e735bd8e3fd0526483d9d646"} Jul 08 17:19:47.677405 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:47.674236 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:47.677405 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:47.674733 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qggbz" Jul 08 17:19:48.553269 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:48.553240 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:48.553448 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:48.553240 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:48.553448 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:48.553347 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:48.553448 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:48.553241 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:48.553599 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:48.553449 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:48.553599 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:48.553514 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:48.678008 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:48.677919 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" event={"ID":"76b83cd7-9338-4189-aeed-0aa1d8f9b56b","Type":"ContainerStarted","Data":"7de9edf599f8533946c1d88c9229721583a72f785839b0a10c75af9d48056226"} Jul 08 17:19:48.684495 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:48.684470 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" event={"ID":"63794e53-b258-4081-9d26-401596bea6c0","Type":"ContainerStarted","Data":"0cc990b0dec408aa39c2c582ee1056bf709d75d4c3f7a3c2fb488bd962b48a37"} Jul 08 17:19:48.697182 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:48.697137 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs2jp" podStartSLOduration=2.555613815 podStartE2EDuration="25.697122766s" totalImagesPullingTime="23.141508951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:48.696537595 +0000 UTC m=+26.639296929" watchObservedRunningTime="2026-07-08 17:19:48.697122766 +0000 UTC m=+26.639882080" Jul 08 17:19:50.553221 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:50.553009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:50.553983 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:50.553033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:50.553983 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:50.553332 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:50.553983 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:50.553084 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:50.553983 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:50.553435 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:50.553983 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:50.553519 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:50.696424 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:50.696346 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" event={"ID":"63794e53-b258-4081-9d26-401596bea6c0","Type":"ContainerStarted","Data":"e5b7d0bf3f8ae32bd611450f247a39b141e2d61d876551d46b78515534e3b31f"} Jul 08 17:19:50.696843 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:50.696761 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:50.714427 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:50.714402 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:50.730205 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:50.730167 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" podStartSLOduration=7.595540336 podStartE2EDuration="27.730155146s" totalImagesPullingTime="20.13461481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:50.729728342 +0000 UTC m=+28.672487704" watchObservedRunningTime="2026-07-08 17:19:50.730155146 +0000 UTC m=+28.672914461" Jul 08 17:19:51.699790 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:51.699546 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:51.700145 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:51.699853 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:51.715994 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:51.715959 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:19:52.107385 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:52.107347 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g5x8g"] Jul 08 17:19:52.107489 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:52.107476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:52.107590 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:52.107570 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:52.110774 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:52.110741 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t6pnw"] Jul 08 17:19:52.110863 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:52.110835 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:52.110978 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:52.110947 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:52.111612 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:52.111594 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7d42f"] Jul 08 17:19:52.111694 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:52.111685 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:52.111809 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:52.111788 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:52.701917 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:52.701883 2577 generic.go:356] "Generic (PLEG): container finished" podID="86e3f01d-8af0-45df-9b21-276e36b3ca00" containerID="57e3d56888096db01c0fcdfa64f43590b633946456338b2ba3dec10d555a2312" exitCode=0 Jul 08 17:19:52.702329 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:52.701970 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55zf6" event={"ID":"86e3f01d-8af0-45df-9b21-276e36b3ca00","Type":"ContainerDied","Data":"57e3d56888096db01c0fcdfa64f43590b633946456338b2ba3dec10d555a2312"} Jul 08 17:19:53.552911 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:53.552888 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:53.552911 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:53.552903 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:53.553055 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:53.552898 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:53.553055 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:53.553015 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:53.553136 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:53.553088 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:53.553179 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:53.553164 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:53.705667 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:53.705632 2577 generic.go:356] "Generic (PLEG): container finished" podID="86e3f01d-8af0-45df-9b21-276e36b3ca00" containerID="1afac4a5bc32b018007e385a508020d688f3c7b51a89e7402622c0b621c24d50" exitCode=0 Jul 08 17:19:53.706062 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:53.705710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55zf6" event={"ID":"86e3f01d-8af0-45df-9b21-276e36b3ca00","Type":"ContainerDied","Data":"1afac4a5bc32b018007e385a508020d688f3c7b51a89e7402622c0b621c24d50"} Jul 08 17:19:54.710100 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:54.709913 2577 generic.go:356] "Generic (PLEG): container finished" podID="86e3f01d-8af0-45df-9b21-276e36b3ca00" containerID="b4a668b05af9727a125a4ea51c024196fd5cc7faec9c4f627e4a326d8b06a9cb" exitCode=0 Jul 08 17:19:54.710537 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:54.710002 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55zf6" event={"ID":"86e3f01d-8af0-45df-9b21-276e36b3ca00","Type":"ContainerDied","Data":"b4a668b05af9727a125a4ea51c024196fd5cc7faec9c4f627e4a326d8b06a9cb"} Jul 08 17:19:55.552894 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:55.552859 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:55.553050 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:55.552954 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:55.553050 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:55.552962 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:55.553112 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:55.553042 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:55.553112 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:55.552958 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:55.553112 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:55.553105 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:56.290330 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:56.290299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:56.290795 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:56.290340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxp7s\" (UniqueName: \"kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s\") pod \"network-check-target-t6pnw\" (UID: \"60291575-8ddc-4865-9843-7c1dce4ae577\") " pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:56.290795 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:56.290495 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:56.290795 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:56.290533 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:56.290795 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:56.290550 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:56.290795 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:56.290560 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs podName:46fce0f4-ee71-4245-88a4-80ead266f9ba nodeName:}" failed. No retries permitted until 2026-07-08 17:20:28.290541259 +0000 UTC m=+66.233300563 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs") pod "network-metrics-daemon-7d42f" (UID: "46fce0f4-ee71-4245-88a4-80ead266f9ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:56.290795 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:56.290561 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mxp7s for pod openshift-network-diagnostics/network-check-target-t6pnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:56.290795 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:56.290616 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s podName:60291575-8ddc-4865-9843-7c1dce4ae577 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:28.290600176 +0000 UTC m=+66.233359469 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxp7s" (UniqueName: "kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s") pod "network-check-target-t6pnw" (UID: "60291575-8ddc-4865-9843-7c1dce4ae577") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:56.390911 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:56.390879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:56.391048 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:56.390975 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:56.391048 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:56.391020 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret podName:4b3df453-5011-4e82-8b55-e20ea1915796 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:28.391007439 +0000 UTC m=+66.333766730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret") pod "global-pull-secret-syncer-g5x8g" (UID: "4b3df453-5011-4e82-8b55-e20ea1915796") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:57.552850 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.552815 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:57.553446 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.552927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:57.553446 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:57.552943 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5x8g" podUID="4b3df453-5011-4e82-8b55-e20ea1915796" Jul 08 17:19:57.553446 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.552962 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:57.553446 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:57.553055 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7d42f" podUID="46fce0f4-ee71-4245-88a4-80ead266f9ba" Jul 08 17:19:57.553446 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:57.553134 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6pnw" podUID="60291575-8ddc-4865-9843-7c1dce4ae577" Jul 08 17:19:57.902750 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.902728 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-225.ec2.internal" event="NodeReady" Jul 08 17:19:57.902890 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.902876 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 17:19:57.938337 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.938309 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d55599db6-86mcq"] Jul 08 17:19:57.940909 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.940890 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:57.943790 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.943769 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 17:19:57.943879 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.943769 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xbqpz\"" Jul 08 17:19:57.943879 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.943871 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 17:19:57.943979 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.943914 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 17:19:57.950773 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.950753 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 17:19:57.951134 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.951120 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-86rfq"] Jul 08 17:19:57.954081 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.954067 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-95krr"] Jul 08 17:19:57.954199 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.954185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-86rfq" Jul 08 17:19:57.956720 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.956699 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 17:19:57.956825 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.956757 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 17:19:57.956825 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.956805 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 17:19:57.957035 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.956883 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sbxhn\"" Jul 08 17:19:57.957243 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.957227 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:57.959007 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.958957 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d55599db6-86mcq"] Jul 08 17:19:57.960107 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.960091 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 17:19:57.960107 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.960102 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 17:19:57.960273 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.960115 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bqdcg\"" Jul 08 17:19:57.960273 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.960090 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 17:19:57.960472 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.960459 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 17:19:57.969248 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.969150 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-86rfq"] Jul 08 17:19:57.969915 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.969894 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-95krr"] Jul 08 17:19:57.971728 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.971710 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7gddm"] Jul 08 17:19:57.974792 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.974776 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:57.977554 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.977535 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 17:19:57.977894 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.977876 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rc7v6\"" Jul 08 17:19:57.978041 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.978024 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 17:19:57.990476 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:57.990453 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7gddm"] Jul 08 17:19:58.020199 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.020168 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mlbvh_1add5133-1160-4faa-9d29-bfbca1e93373/dns-node-resolver/0.log" Jul 08 17:19:58.103681 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.103681 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d141c553-dc3e-420f-a6c4-768e16b4a016-ca-trust-extracted\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.103881 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqpdq\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-kube-api-access-hqpdq\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.103881 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103725 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dfbc3244-80c2-4dac-928a-6813168e1075-crio-socket\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.103881 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a29ff15d-4d58-4aea-a88c-531bdce143ec-tmp-dir\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.103881 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.103881 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-installation-pull-secrets\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.103881 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kqld\" (UniqueName: \"kubernetes.io/projected/dfbc3244-80c2-4dac-928a-6813168e1075-kube-api-access-4kqld\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.103881 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-image-registry-private-configuration\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.103881 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdqtk\" (UniqueName: \"kubernetes.io/projected/a29ff15d-4d58-4aea-a88c-531bdce143ec-kube-api-access-fdqtk\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.104163 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-certificates\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.104163 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-bound-sa-token\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.104163 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0357f42-46e8-4913-bf62-fa0c2751c149-cert\") pod \"ingress-canary-86rfq\" (UID: \"d0357f42-46e8-4913-bf62-fa0c2751c149\") " pod="openshift-ingress-canary/ingress-canary-86rfq" Jul 08 17:19:58.104163 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103976 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjsgr\" (UniqueName: \"kubernetes.io/projected/d0357f42-46e8-4913-bf62-fa0c2751c149-kube-api-access-sjsgr\") pod \"ingress-canary-86rfq\" (UID: \"d0357f42-46e8-4913-bf62-fa0c2751c149\") " pod="openshift-ingress-canary/ingress-canary-86rfq" Jul 08 17:19:58.104163 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.103993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a29ff15d-4d58-4aea-a88c-531bdce143ec-config-volume\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.104163 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.104012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.104163 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.104029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.104163 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.104047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfbc3244-80c2-4dac-928a-6813168e1075-data-volume\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.104163 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.104084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-trusted-ca\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.204665 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.204576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.204665 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.204623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d141c553-dc3e-420f-a6c4-768e16b4a016-ca-trust-extracted\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.204665 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.204649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpdq\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-kube-api-access-hqpdq\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.204911 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.204674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dfbc3244-80c2-4dac-928a-6813168e1075-crio-socket\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.204911 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.204753 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:19:58.204911 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.204823 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls podName:a29ff15d-4d58-4aea-a88c-531bdce143ec nodeName:}" failed. No retries permitted until 2026-07-08 17:19:58.704801026 +0000 UTC m=+36.647560335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls") pod "dns-default-7gddm" (UID: "a29ff15d-4d58-4aea-a88c-531bdce143ec") : secret "dns-default-metrics-tls" not found Jul 08 17:19:58.204911 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.204855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a29ff15d-4d58-4aea-a88c-531bdce143ec-tmp-dir\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.204911 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.204880 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dfbc3244-80c2-4dac-928a-6813168e1075-crio-socket\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.204911 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.204889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.205190 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.204941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-installation-pull-secrets\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.205190 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.204970 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:19:58.205190 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.204971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kqld\" (UniqueName: \"kubernetes.io/projected/dfbc3244-80c2-4dac-928a-6813168e1075-kube-api-access-4kqld\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.205190 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.205012 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls podName:dfbc3244-80c2-4dac-928a-6813168e1075 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:58.704998543 +0000 UTC m=+36.647757835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95krr" (UID: "dfbc3244-80c2-4dac-928a-6813168e1075") : secret "insights-runtime-extractor-tls" not found Jul 08 17:19:58.205190 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-image-registry-private-configuration\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.205190 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdqtk\" (UniqueName: \"kubernetes.io/projected/a29ff15d-4d58-4aea-a88c-531bdce143ec-kube-api-access-fdqtk\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.205190 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-certificates\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.205190 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-bound-sa-token\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.205190 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205136 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d141c553-dc3e-420f-a6c4-768e16b4a016-ca-trust-extracted\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.205190 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0357f42-46e8-4913-bf62-fa0c2751c149-cert\") pod \"ingress-canary-86rfq\" (UID: \"d0357f42-46e8-4913-bf62-fa0c2751c149\") " pod="openshift-ingress-canary/ingress-canary-86rfq" Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjsgr\" (UniqueName: \"kubernetes.io/projected/d0357f42-46e8-4913-bf62-fa0c2751c149-kube-api-access-sjsgr\") pod \"ingress-canary-86rfq\" (UID: \"d0357f42-46e8-4913-bf62-fa0c2751c149\") " pod="openshift-ingress-canary/ingress-canary-86rfq" Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a29ff15d-4d58-4aea-a88c-531bdce143ec-config-volume\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfbc3244-80c2-4dac-928a-6813168e1075-data-volume\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-trusted-ca\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.205425 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.205469 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm podName:dfbc3244-80c2-4dac-928a-6813168e1075 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:58.70545293 +0000 UTC m=+36.648212236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-95krr" (UID: "dfbc3244-80c2-4dac-928a-6813168e1075") : configmap "kube-rbac-proxy" not found Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205520 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a29ff15d-4d58-4aea-a88c-531bdce143ec-tmp-dir\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.205551 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.205563 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d55599db6-86mcq: secret "image-registry-tls" not found Jul 08 17:19:58.205682 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.205585 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls podName:d141c553-dc3e-420f-a6c4-768e16b4a016 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:58.70557792 +0000 UTC m=+36.648337225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls") pod "image-registry-5d55599db6-86mcq" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016") : secret "image-registry-tls" not found Jul 08 17:19:58.206233 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205846 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfbc3244-80c2-4dac-928a-6813168e1075-data-volume\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.206233 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.205977 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a29ff15d-4d58-4aea-a88c-531bdce143ec-config-volume\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.206522 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.206499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-certificates\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.207115 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.207062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-trusted-ca\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.210399 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.210357 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-installation-pull-secrets\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.210506 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.210408 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-image-registry-private-configuration\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.211780 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.211759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0357f42-46e8-4913-bf62-fa0c2751c149-cert\") pod \"ingress-canary-86rfq\" (UID: \"d0357f42-46e8-4913-bf62-fa0c2751c149\") " pod="openshift-ingress-canary/ingress-canary-86rfq" Jul 08 17:19:58.222192 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.222171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdqtk\" (UniqueName: \"kubernetes.io/projected/a29ff15d-4d58-4aea-a88c-531bdce143ec-kube-api-access-fdqtk\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.222358 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.222303 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjsgr\" (UniqueName: \"kubernetes.io/projected/d0357f42-46e8-4913-bf62-fa0c2751c149-kube-api-access-sjsgr\") pod \"ingress-canary-86rfq\" (UID: \"d0357f42-46e8-4913-bf62-fa0c2751c149\") " pod="openshift-ingress-canary/ingress-canary-86rfq" Jul 08 17:19:58.223172 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.223148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-bound-sa-token\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.223292 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.223269 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqpdq\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-kube-api-access-hqpdq\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.223950 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.223918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kqld\" (UniqueName: \"kubernetes.io/projected/dfbc3244-80c2-4dac-928a-6813168e1075-kube-api-access-4kqld\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.264835 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.264812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-86rfq" Jul 08 17:19:58.709536 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.709497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.709546 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.709600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.709626 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.709633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.709700 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm podName:dfbc3244-80c2-4dac-928a-6813168e1075 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:59.709679549 +0000 UTC m=+37.652438842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-95krr" (UID: "dfbc3244-80c2-4dac-928a-6813168e1075") : configmap "kube-rbac-proxy" not found Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.709711 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.709723 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.709729 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d55599db6-86mcq: secret "image-registry-tls" not found Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.709739 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.709762 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls podName:a29ff15d-4d58-4aea-a88c-531bdce143ec nodeName:}" failed. No retries permitted until 2026-07-08 17:19:59.709750059 +0000 UTC m=+37.652509357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls") pod "dns-default-7gddm" (UID: "a29ff15d-4d58-4aea-a88c-531bdce143ec") : secret "dns-default-metrics-tls" not found Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.709785 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls podName:dfbc3244-80c2-4dac-928a-6813168e1075 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:59.709769447 +0000 UTC m=+37.652528747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95krr" (UID: "dfbc3244-80c2-4dac-928a-6813168e1075") : secret "insights-runtime-extractor-tls" not found Jul 08 17:19:58.710155 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:58.709804 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls podName:d141c553-dc3e-420f-a6c4-768e16b4a016 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:59.709792986 +0000 UTC m=+37.652552285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls") pod "image-registry-5d55599db6-86mcq" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016") : secret "image-registry-tls" not found Jul 08 17:19:58.797536 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:58.797505 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q6j5f_597b3e12-58cb-48f4-af62-539544a7652b/node-ca/0.log" Jul 08 17:19:59.183699 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.183624 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-f9gt6"] Jul 08 17:19:59.204812 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.204783 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-f9gt6"] Jul 08 17:19:59.204979 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.204827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-f9gt6" Jul 08 17:19:59.207796 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.207581 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 08 17:19:59.207796 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.207612 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qb4np\"" Jul 08 17:19:59.208790 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.208771 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 08 17:19:59.208913 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.208891 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 08 17:19:59.208969 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.208921 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 08 17:19:59.314798 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.314764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf-signing-key\") pod \"service-ca-758f599c5-f9gt6\" (UID: \"b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf\") " pod="openshift-service-ca/service-ca-758f599c5-f9gt6" Jul 08 17:19:59.314958 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.314867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf-signing-cabundle\") pod \"service-ca-758f599c5-f9gt6\" (UID: \"b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf\") " pod="openshift-service-ca/service-ca-758f599c5-f9gt6" Jul 08 17:19:59.315028 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.315001 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjv49\" (UniqueName: \"kubernetes.io/projected/b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf-kube-api-access-fjv49\") pod \"service-ca-758f599c5-f9gt6\" (UID: \"b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf\") " pod="openshift-service-ca/service-ca-758f599c5-f9gt6" Jul 08 17:19:59.415799 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.415764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjv49\" (UniqueName: \"kubernetes.io/projected/b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf-kube-api-access-fjv49\") pod \"service-ca-758f599c5-f9gt6\" (UID: \"b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf\") " pod="openshift-service-ca/service-ca-758f599c5-f9gt6" Jul 08 17:19:59.415975 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.415833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf-signing-key\") pod \"service-ca-758f599c5-f9gt6\" (UID: \"b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf\") " pod="openshift-service-ca/service-ca-758f599c5-f9gt6" Jul 08 17:19:59.415975 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.415918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf-signing-cabundle\") pod \"service-ca-758f599c5-f9gt6\" (UID: \"b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf\") " pod="openshift-service-ca/service-ca-758f599c5-f9gt6" Jul 08 17:19:59.416778 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.416747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf-signing-cabundle\") pod \"service-ca-758f599c5-f9gt6\" (UID: \"b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf\") " pod="openshift-service-ca/service-ca-758f599c5-f9gt6" Jul 08 17:19:59.418699 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.418674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf-signing-key\") pod \"service-ca-758f599c5-f9gt6\" (UID: \"b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf\") " pod="openshift-service-ca/service-ca-758f599c5-f9gt6" Jul 08 17:19:59.425652 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.425629 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjv49\" (UniqueName: \"kubernetes.io/projected/b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf-kube-api-access-fjv49\") pod \"service-ca-758f599c5-f9gt6\" (UID: \"b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf\") " pod="openshift-service-ca/service-ca-758f599c5-f9gt6" Jul 08 17:19:59.514639 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.514611 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-f9gt6" Jul 08 17:19:59.552578 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.552550 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:19:59.552578 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.552579 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:19:59.552765 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.552664 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:19:59.556249 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.556058 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7ksx\"" Jul 08 17:19:59.556249 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.556089 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 17:19:59.556249 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.556197 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 17:19:59.556510 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.556363 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:19:59.556510 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.556414 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rq8b\"" Jul 08 17:19:59.556645 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.556628 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:19:59.699219 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.699040 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-86rfq"] Jul 08 17:19:59.704786 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.704763 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-f9gt6"] Jul 08 17:19:59.719081 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.719061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.719101 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.719142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:19:59.719176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:59.719193 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:59.719255 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:59.719275 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d55599db6-86mcq: secret "image-registry-tls" not found Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:59.719306 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:59.719308 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:59.719260 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm podName:dfbc3244-80c2-4dac-928a-6813168e1075 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:01.719238053 +0000 UTC m=+39.661997368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-95krr" (UID: "dfbc3244-80c2-4dac-928a-6813168e1075") : configmap "kube-rbac-proxy" not found Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:59.719351 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls podName:d141c553-dc3e-420f-a6c4-768e16b4a016 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:01.71933413 +0000 UTC m=+39.662093428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls") pod "image-registry-5d55599db6-86mcq" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016") : secret "image-registry-tls" not found Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:59.719366 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls podName:a29ff15d-4d58-4aea-a88c-531bdce143ec nodeName:}" failed. No retries permitted until 2026-07-08 17:20:01.719359628 +0000 UTC m=+39.662118920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls") pod "dns-default-7gddm" (UID: "a29ff15d-4d58-4aea-a88c-531bdce143ec") : secret "dns-default-metrics-tls" not found Jul 08 17:19:59.719454 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:19:59.719398 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls podName:dfbc3244-80c2-4dac-928a-6813168e1075 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:01.719388802 +0000 UTC m=+39.662148102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95krr" (UID: "dfbc3244-80c2-4dac-928a-6813168e1075") : secret "insights-runtime-extractor-tls" not found Jul 08 17:19:59.728803 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:59.728782 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0357f42_46e8_4913_bf62_fa0c2751c149.slice/crio-f30e7c96efe3e37e5d06b4267b650d7a3b24e9bac104a8830008fab18561ad54 WatchSource:0}: Error finding container f30e7c96efe3e37e5d06b4267b650d7a3b24e9bac104a8830008fab18561ad54: Status 404 returned error can't find the container with id f30e7c96efe3e37e5d06b4267b650d7a3b24e9bac104a8830008fab18561ad54 Jul 08 17:19:59.729295 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:19:59.729271 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6cbbbd3_2f10_4ffe_b5cc_9f16c7e57fbf.slice/crio-ac8937d3abf78ed4fb57692c846c6146beaf21825d1d6c03f17f853936f98e8d WatchSource:0}: Error finding container ac8937d3abf78ed4fb57692c846c6146beaf21825d1d6c03f17f853936f98e8d: Status 404 returned error can't find the container with id ac8937d3abf78ed4fb57692c846c6146beaf21825d1d6c03f17f853936f98e8d Jul 08 17:20:00.732434 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:00.732389 2577 generic.go:356] "Generic (PLEG): container finished" podID="86e3f01d-8af0-45df-9b21-276e36b3ca00" containerID="c2893f2cffc38520f660137e5d2c008039bb9a184c4fd36886bc8861bd31418e" exitCode=0 Jul 08 17:20:00.732899 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:00.732522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55zf6" event={"ID":"86e3f01d-8af0-45df-9b21-276e36b3ca00","Type":"ContainerDied","Data":"c2893f2cffc38520f660137e5d2c008039bb9a184c4fd36886bc8861bd31418e"} Jul 08 17:20:00.734347 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:00.734161 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-86rfq" event={"ID":"d0357f42-46e8-4913-bf62-fa0c2751c149","Type":"ContainerStarted","Data":"f30e7c96efe3e37e5d06b4267b650d7a3b24e9bac104a8830008fab18561ad54"} Jul 08 17:20:00.735915 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:00.735886 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-f9gt6" event={"ID":"b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf","Type":"ContainerStarted","Data":"ac8937d3abf78ed4fb57692c846c6146beaf21825d1d6c03f17f853936f98e8d"} Jul 08 17:20:01.737070 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:01.737038 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:20:01.737515 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:01.737110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:20:01.737515 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:01.737146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:20:01.737515 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:01.737183 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:20:01.737515 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:01.737204 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d55599db6-86mcq: secret "image-registry-tls" not found Jul 08 17:20:01.737515 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:01.737268 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:20:01.737515 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:01.737272 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls podName:d141c553-dc3e-420f-a6c4-768e16b4a016 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:05.73725261 +0000 UTC m=+43.680011909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls") pod "image-registry-5d55599db6-86mcq" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016") : secret "image-registry-tls" not found Jul 08 17:20:01.737515 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:01.737348 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:20:01.737515 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:01.737351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:20:01.737515 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:01.737417 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls podName:dfbc3244-80c2-4dac-928a-6813168e1075 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:05.737402273 +0000 UTC m=+43.680161568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95krr" (UID: "dfbc3244-80c2-4dac-928a-6813168e1075") : secret "insights-runtime-extractor-tls" not found Jul 08 17:20:01.737515 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:01.737435 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls podName:a29ff15d-4d58-4aea-a88c-531bdce143ec nodeName:}" failed. No retries permitted until 2026-07-08 17:20:05.737425591 +0000 UTC m=+43.680184885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls") pod "dns-default-7gddm" (UID: "a29ff15d-4d58-4aea-a88c-531bdce143ec") : secret "dns-default-metrics-tls" not found Jul 08 17:20:01.737875 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:01.737853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfbc3244-80c2-4dac-928a-6813168e1075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:20:01.742593 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:01.742565 2577 generic.go:356] "Generic (PLEG): container finished" podID="86e3f01d-8af0-45df-9b21-276e36b3ca00" containerID="22c5d8b7a63b3f244a7133ca341584cb6cf02e4ad33476a7e7e5dddc2e92f38d" exitCode=0 Jul 08 17:20:01.742691 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:01.742614 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55zf6" event={"ID":"86e3f01d-8af0-45df-9b21-276e36b3ca00","Type":"ContainerDied","Data":"22c5d8b7a63b3f244a7133ca341584cb6cf02e4ad33476a7e7e5dddc2e92f38d"} Jul 08 17:20:03.748523 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:03.748491 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-86rfq" event={"ID":"d0357f42-46e8-4913-bf62-fa0c2751c149","Type":"ContainerStarted","Data":"4b641f05e69149fe1692856d07cfcdb2712f027e49000ca474895df60acf9840"} Jul 08 17:20:03.753756 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:03.753725 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-f9gt6" event={"ID":"b6cbbbd3-2f10-4ffe-b5cc-9f16c7e57fbf","Type":"ContainerStarted","Data":"829e7850d555cd4e675729f7f0973b6e9b9a87c7d2778f5924a979e78528483c"} Jul 08 17:20:03.756895 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:03.756867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55zf6" event={"ID":"86e3f01d-8af0-45df-9b21-276e36b3ca00","Type":"ContainerStarted","Data":"026d4cf938005e2c6666bb771de187e2563886ce2ae97f968d7e563012e59723"} Jul 08 17:20:03.812352 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:03.812306 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-86rfq" podStartSLOduration=3.182757586 podStartE2EDuration="6.812292393s" totalImagesPullingTime="3.629534807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:03.777248272 +0000 UTC m=+41.720007600" watchObservedRunningTime="2026-07-08 17:20:03.812292393 +0000 UTC m=+41.755051739" Jul 08 17:20:03.812766 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:03.812743 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-55zf6" podStartSLOduration=7.947481728 podStartE2EDuration="40.812737652s" totalImagesPullingTime="32.865255924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:03.812125421 +0000 UTC m=+41.754884736" watchObservedRunningTime="2026-07-08 17:20:03.812737652 +0000 UTC m=+41.755496944" Jul 08 17:20:03.838792 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:03.838751 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-f9gt6" podStartSLOduration=1.202148189 podStartE2EDuration="4.838737019s" totalImagesPullingTime="3.63658883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:03.837292423 +0000 UTC m=+41.780051736" watchObservedRunningTime="2026-07-08 17:20:03.838737019 +0000 UTC m=+41.781496332" Jul 08 17:20:05.772752 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:05.772720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:20:05.773143 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:05.772774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:20:05.773143 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:05.772806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:20:05.773143 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:05.772876 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:20:05.773143 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:05.772893 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d55599db6-86mcq: secret "image-registry-tls" not found Jul 08 17:20:05.773143 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:05.772903 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:20:05.773143 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:05.772911 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:20:05.773143 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:05.772957 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls podName:dfbc3244-80c2-4dac-928a-6813168e1075 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:13.772940566 +0000 UTC m=+51.715699862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95krr" (UID: "dfbc3244-80c2-4dac-928a-6813168e1075") : secret "insights-runtime-extractor-tls" not found Jul 08 17:20:05.773143 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:05.772973 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls podName:d141c553-dc3e-420f-a6c4-768e16b4a016 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:13.772965067 +0000 UTC m=+51.715724360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls") pod "image-registry-5d55599db6-86mcq" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016") : secret "image-registry-tls" not found Jul 08 17:20:05.773143 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:05.772985 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls podName:a29ff15d-4d58-4aea-a88c-531bdce143ec nodeName:}" failed. No retries permitted until 2026-07-08 17:20:13.772978154 +0000 UTC m=+51.715737463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls") pod "dns-default-7gddm" (UID: "a29ff15d-4d58-4aea-a88c-531bdce143ec") : secret "dns-default-metrics-tls" not found Jul 08 17:20:13.833679 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:13.833641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:20:13.833679 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:13.833687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:20:13.834172 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:13.833803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:20:13.837709 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:13.837679 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls\") pod \"image-registry-5d55599db6-86mcq\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:20:13.837823 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:13.837683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a29ff15d-4d58-4aea-a88c-531bdce143ec-metrics-tls\") pod \"dns-default-7gddm\" (UID: \"a29ff15d-4d58-4aea-a88c-531bdce143ec\") " pod="openshift-dns/dns-default-7gddm" Jul 08 17:20:13.837823 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:13.837684 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfbc3244-80c2-4dac-928a-6813168e1075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95krr\" (UID: \"dfbc3244-80c2-4dac-928a-6813168e1075\") " pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:20:13.852506 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:13.852487 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:20:13.872976 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:13.871006 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-95krr" Jul 08 17:20:13.884221 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:13.884204 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7gddm" Jul 08 17:20:14.045572 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:14.045538 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d55599db6-86mcq"] Jul 08 17:20:14.061109 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:14.061088 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-95krr"] Jul 08 17:20:14.064182 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:20:14.064155 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfbc3244_80c2_4dac_928a_6813168e1075.slice/crio-3958a7c15404f08025dc670ea8808e19f45347aa0353fa9b06a2ba745552780a WatchSource:0}: Error finding container 3958a7c15404f08025dc670ea8808e19f45347aa0353fa9b06a2ba745552780a: Status 404 returned error can't find the container with id 3958a7c15404f08025dc670ea8808e19f45347aa0353fa9b06a2ba745552780a Jul 08 17:20:14.081712 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:14.081689 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7gddm"] Jul 08 17:20:14.085094 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:20:14.085040 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29ff15d_4d58_4aea_a88c_531bdce143ec.slice/crio-dc4db6380485bad9c2a9b412c98be37e8330ecfebad5e4a69bf0a4bb6136b9da WatchSource:0}: Error finding container dc4db6380485bad9c2a9b412c98be37e8330ecfebad5e4a69bf0a4bb6136b9da: Status 404 returned error can't find the container with id dc4db6380485bad9c2a9b412c98be37e8330ecfebad5e4a69bf0a4bb6136b9da Jul 08 17:20:14.789281 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:14.788795 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" event={"ID":"d141c553-dc3e-420f-a6c4-768e16b4a016","Type":"ContainerStarted","Data":"b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66"} Jul 08 17:20:14.789281 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:14.788864 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" event={"ID":"d141c553-dc3e-420f-a6c4-768e16b4a016","Type":"ContainerStarted","Data":"f31ee498364b7fb4ad7fbe58293d7a1458ee2f1c9c8d65f3735497333baf69db"} Jul 08 17:20:14.789281 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:14.789036 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:20:14.791036 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:14.791008 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7gddm" event={"ID":"a29ff15d-4d58-4aea-a88c-531bdce143ec","Type":"ContainerStarted","Data":"dc4db6380485bad9c2a9b412c98be37e8330ecfebad5e4a69bf0a4bb6136b9da"} Jul 08 17:20:14.792861 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:14.792835 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95krr" event={"ID":"dfbc3244-80c2-4dac-928a-6813168e1075","Type":"ContainerStarted","Data":"3958a7c15404f08025dc670ea8808e19f45347aa0353fa9b06a2ba745552780a"} Jul 08 17:20:14.810322 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:14.809339 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" podStartSLOduration=53.809321892 podStartE2EDuration="53.809321892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:14.807997639 +0000 UTC m=+52.750756975" watchObservedRunningTime="2026-07-08 17:20:14.809321892 +0000 UTC m=+52.752081210" Jul 08 17:20:18.805885 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:18.805852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7gddm" event={"ID":"a29ff15d-4d58-4aea-a88c-531bdce143ec","Type":"ContainerStarted","Data":"32656c78e07b206b0121ebfc077215dd88e4da3d50c4fd58c8dd884a7a87014f"} Jul 08 17:20:18.807242 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:18.807219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95krr" event={"ID":"dfbc3244-80c2-4dac-928a-6813168e1075","Type":"ContainerStarted","Data":"8d69f59238d1ba227c78b46168f80ec0c34eaad38606821eeb993b2fb33fbe24"} Jul 08 17:20:19.471466 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.471441 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-fkvnw"] Jul 08 17:20:19.473583 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.473564 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-fkvnw" Jul 08 17:20:19.477105 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.477082 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 17:20:19.477230 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.477170 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-c55sx\"" Jul 08 17:20:19.477305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.477288 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 17:20:19.490472 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.490447 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-fkvnw"] Jul 08 17:20:19.499704 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.499681 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d55599db6-86mcq"] Jul 08 17:20:19.578155 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.578118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m6fr\" (UniqueName: \"kubernetes.io/projected/34962b6e-f3ad-45ac-b721-a5a2cfdd88ea-kube-api-access-5m6fr\") pod \"downloads-685bfb5f64-fkvnw\" (UID: \"34962b6e-f3ad-45ac-b721-a5a2cfdd88ea\") " pod="openshift-console/downloads-685bfb5f64-fkvnw" Jul 08 17:20:19.599484 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.599444 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f5d577cd6-lk7dm"] Jul 08 17:20:19.601344 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.601326 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.630148 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.630126 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f5d577cd6-lk7dm"] Jul 08 17:20:19.678996 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.678935 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdf9c\" (UniqueName: \"kubernetes.io/projected/679dd075-6526-4232-ac7d-59fade13ca34-kube-api-access-jdf9c\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.678996 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.678969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/679dd075-6526-4232-ac7d-59fade13ca34-ca-trust-extracted\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.678996 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.678988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/679dd075-6526-4232-ac7d-59fade13ca34-registry-tls\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.679164 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.679005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/679dd075-6526-4232-ac7d-59fade13ca34-installation-pull-secrets\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.679164 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.679072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/679dd075-6526-4232-ac7d-59fade13ca34-bound-sa-token\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.679164 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.679118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/679dd075-6526-4232-ac7d-59fade13ca34-image-registry-private-configuration\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.679164 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.679135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/679dd075-6526-4232-ac7d-59fade13ca34-registry-certificates\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.679280 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.679191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6fr\" (UniqueName: \"kubernetes.io/projected/34962b6e-f3ad-45ac-b721-a5a2cfdd88ea-kube-api-access-5m6fr\") pod \"downloads-685bfb5f64-fkvnw\" (UID: \"34962b6e-f3ad-45ac-b721-a5a2cfdd88ea\") " pod="openshift-console/downloads-685bfb5f64-fkvnw" Jul 08 17:20:19.679280 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.679209 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/679dd075-6526-4232-ac7d-59fade13ca34-trusted-ca\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.692063 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.692037 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m6fr\" (UniqueName: \"kubernetes.io/projected/34962b6e-f3ad-45ac-b721-a5a2cfdd88ea-kube-api-access-5m6fr\") pod \"downloads-685bfb5f64-fkvnw\" (UID: \"34962b6e-f3ad-45ac-b721-a5a2cfdd88ea\") " pod="openshift-console/downloads-685bfb5f64-fkvnw" Jul 08 17:20:19.779624 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.779598 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/679dd075-6526-4232-ac7d-59fade13ca34-registry-tls\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.779778 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.779631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/679dd075-6526-4232-ac7d-59fade13ca34-installation-pull-secrets\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.779778 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.779651 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/679dd075-6526-4232-ac7d-59fade13ca34-bound-sa-token\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.779778 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.779699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/679dd075-6526-4232-ac7d-59fade13ca34-image-registry-private-configuration\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.779778 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.779722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/679dd075-6526-4232-ac7d-59fade13ca34-registry-certificates\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.779778 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.779758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/679dd075-6526-4232-ac7d-59fade13ca34-trusted-ca\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.780030 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.779797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdf9c\" (UniqueName: \"kubernetes.io/projected/679dd075-6526-4232-ac7d-59fade13ca34-kube-api-access-jdf9c\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.780083 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.780060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/679dd075-6526-4232-ac7d-59fade13ca34-ca-trust-extracted\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.780546 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.780474 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/679dd075-6526-4232-ac7d-59fade13ca34-ca-trust-extracted\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.780746 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.780726 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/679dd075-6526-4232-ac7d-59fade13ca34-registry-certificates\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.781184 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.781163 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/679dd075-6526-4232-ac7d-59fade13ca34-trusted-ca\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.782182 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.782159 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/679dd075-6526-4232-ac7d-59fade13ca34-image-registry-private-configuration\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.782326 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.782310 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/679dd075-6526-4232-ac7d-59fade13ca34-installation-pull-secrets\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.782436 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.782425 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-fkvnw" Jul 08 17:20:19.782482 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.782440 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/679dd075-6526-4232-ac7d-59fade13ca34-registry-tls\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.791563 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.791530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/679dd075-6526-4232-ac7d-59fade13ca34-bound-sa-token\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.791679 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.791611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdf9c\" (UniqueName: \"kubernetes.io/projected/679dd075-6526-4232-ac7d-59fade13ca34-kube-api-access-jdf9c\") pod \"image-registry-7f5d577cd6-lk7dm\" (UID: \"679dd075-6526-4232-ac7d-59fade13ca34\") " pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.815203 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.815162 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7gddm" event={"ID":"a29ff15d-4d58-4aea-a88c-531bdce143ec","Type":"ContainerStarted","Data":"f1438eef26ae61bba4e315ba04f9e4acf6eb3fcbc4d33aa6687d81871eb10ffd"} Jul 08 17:20:19.815616 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.815269 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7gddm" Jul 08 17:20:19.817427 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.817405 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95krr" event={"ID":"dfbc3244-80c2-4dac-928a-6813168e1075","Type":"ContainerStarted","Data":"620384fad90129a28f7db1ef6a3b55753b3d42edd24bdc0fa500c7fd2650eb07"} Jul 08 17:20:19.835545 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.835165 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7gddm" podStartSLOduration=18.265013403 podStartE2EDuration="22.835145934s" totalImagesPullingTime="4.570132531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:19.833706844 +0000 UTC m=+57.776466161" watchObservedRunningTime="2026-07-08 17:20:19.835145934 +0000 UTC m=+57.777905249" Jul 08 17:20:19.909896 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.909867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:19.915640 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:19.915613 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-fkvnw"] Jul 08 17:20:19.920349 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:20:19.920321 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34962b6e_f3ad_45ac_b721_a5a2cfdd88ea.slice/crio-43cfad5983e35a70b34365f64e3e0fa49db67d8a14d1411f714afa767b1dddef WatchSource:0}: Error finding container 43cfad5983e35a70b34365f64e3e0fa49db67d8a14d1411f714afa767b1dddef: Status 404 returned error can't find the container with id 43cfad5983e35a70b34365f64e3e0fa49db67d8a14d1411f714afa767b1dddef Jul 08 17:20:20.035707 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:20.035674 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f5d577cd6-lk7dm"] Jul 08 17:20:20.038771 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:20:20.038740 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679dd075_6526_4232_ac7d_59fade13ca34.slice/crio-34aa3543c92e086b0bcc759d0751824604342c34b382b668a21fe67003b32476 WatchSource:0}: Error finding container 34aa3543c92e086b0bcc759d0751824604342c34b382b668a21fe67003b32476: Status 404 returned error can't find the container with id 34aa3543c92e086b0bcc759d0751824604342c34b382b668a21fe67003b32476 Jul 08 17:20:20.827893 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:20.827855 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" event={"ID":"679dd075-6526-4232-ac7d-59fade13ca34","Type":"ContainerStarted","Data":"2c884b8c54d66806b573000c1288dd6eef9c87cc254b2676d6a99b2de2f3eb48"} Jul 08 17:20:20.828332 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:20.827947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" event={"ID":"679dd075-6526-4232-ac7d-59fade13ca34","Type":"ContainerStarted","Data":"34aa3543c92e086b0bcc759d0751824604342c34b382b668a21fe67003b32476"} Jul 08 17:20:20.828332 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:20.827973 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:20.829850 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:20.829819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-fkvnw" event={"ID":"34962b6e-f3ad-45ac-b721-a5a2cfdd88ea","Type":"ContainerStarted","Data":"43cfad5983e35a70b34365f64e3e0fa49db67d8a14d1411f714afa767b1dddef"} Jul 08 17:20:20.850120 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:20.850072 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" podStartSLOduration=1.850052171 podStartE2EDuration="1.850052171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:20.849246696 +0000 UTC m=+58.792006022" watchObservedRunningTime="2026-07-08 17:20:20.850052171 +0000 UTC m=+58.792811485" Jul 08 17:20:22.840569 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:22.840522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95krr" event={"ID":"dfbc3244-80c2-4dac-928a-6813168e1075","Type":"ContainerStarted","Data":"42490f12f12f3ca3ac1662b8cba342a39fbd86b5787a36bac139aaeafbd6776f"} Jul 08 17:20:22.888670 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:22.888621 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-95krr" podStartSLOduration=17.772737887 podStartE2EDuration="25.888606063s" totalImagesPullingTime="8.115868176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:22.886288679 +0000 UTC m=+60.829047992" watchObservedRunningTime="2026-07-08 17:20:22.888606063 +0000 UTC m=+60.831365367" Jul 08 17:20:23.720728 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:23.720698 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcsh6" Jul 08 17:20:28.346177 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.346136 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxp7s\" (UniqueName: \"kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s\") pod \"network-check-target-t6pnw\" (UID: \"60291575-8ddc-4865-9843-7c1dce4ae577\") " pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:20:28.346692 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.346195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:20:28.348917 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.348872 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 17:20:28.349007 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.348939 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:20:28.359218 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.359190 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46fce0f4-ee71-4245-88a4-80ead266f9ba-metrics-certs\") pod \"network-metrics-daemon-7d42f\" (UID: \"46fce0f4-ee71-4245-88a4-80ead266f9ba\") " pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:20:28.359526 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.359512 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 17:20:28.365952 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.365935 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7ksx\"" Jul 08 17:20:28.369958 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.369937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxp7s\" (UniqueName: \"kubernetes.io/projected/60291575-8ddc-4865-9843-7c1dce4ae577-kube-api-access-mxp7s\") pod \"network-check-target-t6pnw\" (UID: \"60291575-8ddc-4865-9843-7c1dce4ae577\") " pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:20:28.373854 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.373827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7d42f" Jul 08 17:20:28.376147 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.376127 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rq8b\"" Jul 08 17:20:28.384285 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.384258 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:20:28.447182 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.446982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:20:28.450155 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.449984 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:20:28.462512 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.462167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b3df453-5011-4e82-8b55-e20ea1915796-original-pull-secret\") pod \"global-pull-secret-syncer-g5x8g\" (UID: \"4b3df453-5011-4e82-8b55-e20ea1915796\") " pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:20:28.518955 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.518845 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7d42f"] Jul 08 17:20:28.523171 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:20:28.523142 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fce0f4_ee71_4245_88a4_80ead266f9ba.slice/crio-688ffa2731a853645eb4e61fd2ecb596c6ff96a89ed2c986d19f50dbffbf8db1 WatchSource:0}: Error finding container 688ffa2731a853645eb4e61fd2ecb596c6ff96a89ed2c986d19f50dbffbf8db1: Status 404 returned error can't find the container with id 688ffa2731a853645eb4e61fd2ecb596c6ff96a89ed2c986d19f50dbffbf8db1 Jul 08 17:20:28.540903 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.540881 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t6pnw"] Jul 08 17:20:28.678033 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.677961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5x8g" Jul 08 17:20:28.806452 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.806353 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g5x8g"] Jul 08 17:20:28.808905 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:20:28.808881 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3df453_5011_4e82_8b55_e20ea1915796.slice/crio-4a4ab25af0d56603fdaed43d31c26ddfcba20e874b7436b9a13f133fe439a2f0 WatchSource:0}: Error finding container 4a4ab25af0d56603fdaed43d31c26ddfcba20e874b7436b9a13f133fe439a2f0: Status 404 returned error can't find the container with id 4a4ab25af0d56603fdaed43d31c26ddfcba20e874b7436b9a13f133fe439a2f0 Jul 08 17:20:28.865463 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.865422 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g5x8g" event={"ID":"4b3df453-5011-4e82-8b55-e20ea1915796","Type":"ContainerStarted","Data":"4a4ab25af0d56603fdaed43d31c26ddfcba20e874b7436b9a13f133fe439a2f0"} Jul 08 17:20:28.866933 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.866905 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7d42f" event={"ID":"46fce0f4-ee71-4245-88a4-80ead266f9ba","Type":"ContainerStarted","Data":"688ffa2731a853645eb4e61fd2ecb596c6ff96a89ed2c986d19f50dbffbf8db1"} Jul 08 17:20:28.868268 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:28.868247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t6pnw" event={"ID":"60291575-8ddc-4865-9843-7c1dce4ae577","Type":"ContainerStarted","Data":"a2b9dd7b35439b4c2a05b10dbeac140a201c22cb2b6f9c5e0c1d0a78f3cfdc6c"} Jul 08 17:20:29.508265 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:29.508223 2577 patch_prober.go:28] interesting pod/image-registry-5d55599db6-86mcq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 17:20:29.508748 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:29.508292 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" podUID="d141c553-dc3e-420f-a6c4-768e16b4a016" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:20:29.832268 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:29.832245 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7gddm" Jul 08 17:20:30.882957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:30.882905 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7d42f" event={"ID":"46fce0f4-ee71-4245-88a4-80ead266f9ba","Type":"ContainerStarted","Data":"ce09cdbcda8abb70b1f8a7ba8080ad162e1fff5aed13694254b4df6121e4715a"} Jul 08 17:20:30.883404 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:30.882983 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7d42f" event={"ID":"46fce0f4-ee71-4245-88a4-80ead266f9ba","Type":"ContainerStarted","Data":"3f8515e58430abc0ec274ffefd3b0a4684d830467b96b5f3a742703447070869"} Jul 08 17:20:30.900119 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:30.900064 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7d42f" podStartSLOduration=66.684923675 podStartE2EDuration="1m7.900041417s" totalImagesPullingTime="1.215117742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:30.89906295 +0000 UTC m=+68.841822282" watchObservedRunningTime="2026-07-08 17:20:30.900041417 +0000 UTC m=+68.842800732" Jul 08 17:20:34.750197 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.750165 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7gkj4"] Jul 08 17:20:34.753240 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.753215 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.756002 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.755978 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 17:20:34.757034 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.757016 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 17:20:34.757316 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.757299 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 17:20:34.758437 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.758418 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 17:20:34.758560 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.758483 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cvxn8\"" Jul 08 17:20:34.758689 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.758675 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 17:20:34.758860 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.758845 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 17:20:34.802604 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.802580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-wtmp\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.802711 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.802617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.802711 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.802651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb26c879-3d75-4ab5-8410-409a51c1e5aa-metrics-client-ca\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.802838 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.802738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-textfile\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.802838 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.802774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb26c879-3d75-4ab5-8410-409a51c1e5aa-sys\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.802838 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.802803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-tls\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.802838 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.802831 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r7xn\" (UniqueName: \"kubernetes.io/projected/bb26c879-3d75-4ab5-8410-409a51c1e5aa-kube-api-access-9r7xn\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.802985 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.802863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.802985 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.802901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb26c879-3d75-4ab5-8410-409a51c1e5aa-root\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.903252 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.903221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-wtmp\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.903442 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.903261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.903442 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.903293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb26c879-3d75-4ab5-8410-409a51c1e5aa-metrics-client-ca\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.903442 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.903321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-textfile\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.903442 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.903345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb26c879-3d75-4ab5-8410-409a51c1e5aa-sys\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.903442 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.903394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-tls\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.903442 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.903425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r7xn\" (UniqueName: \"kubernetes.io/projected/bb26c879-3d75-4ab5-8410-409a51c1e5aa-kube-api-access-9r7xn\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.903750 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.903456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.903750 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.903493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb26c879-3d75-4ab5-8410-409a51c1e5aa-root\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.903750 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.903608 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb26c879-3d75-4ab5-8410-409a51c1e5aa-root\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.903750 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.903741 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-wtmp\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.904322 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.904300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.904725 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.904698 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb26c879-3d75-4ab5-8410-409a51c1e5aa-metrics-client-ca\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.905948 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.904916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-textfile\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.905948 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.904984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb26c879-3d75-4ab5-8410-409a51c1e5aa-sys\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.905948 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:34.905057 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 17:20:34.905948 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:34.905102 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-tls podName:bb26c879-3d75-4ab5-8410-409a51c1e5aa nodeName:}" failed. No retries permitted until 2026-07-08 17:20:35.40508575 +0000 UTC m=+73.347845042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-tls") pod "node-exporter-7gkj4" (UID: "bb26c879-3d75-4ab5-8410-409a51c1e5aa") : secret "node-exporter-tls" not found Jul 08 17:20:34.906730 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.906392 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g5x8g" event={"ID":"4b3df453-5011-4e82-8b55-e20ea1915796","Type":"ContainerStarted","Data":"c1c5afe740120e5a028c5732c71eedd106ba638f49af7f01a6d2034a7d3fb493"} Jul 08 17:20:34.908677 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.908651 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t6pnw" event={"ID":"60291575-8ddc-4865-9843-7c1dce4ae577","Type":"ContainerStarted","Data":"84864128be6a0f033f1804b588da8010326f610c3dc1a230833f569d8c275d12"} Jul 08 17:20:34.909078 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.909060 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:20:34.916680 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.916638 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.919795 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.919775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r7xn\" (UniqueName: \"kubernetes.io/projected/bb26c879-3d75-4ab5-8410-409a51c1e5aa-kube-api-access-9r7xn\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:34.934678 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.934641 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g5x8g" podStartSLOduration=66.513905615 podStartE2EDuration="1m11.934621812s" totalImagesPullingTime="5.420716197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:34.933340354 +0000 UTC m=+72.876099691" watchObservedRunningTime="2026-07-08 17:20:34.934621812 +0000 UTC m=+72.877381127" Jul 08 17:20:34.952868 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:34.952777 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t6pnw" podStartSLOduration=66.272951932 podStartE2EDuration="1m11.95276308s" totalImagesPullingTime="5.679811148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:34.95206892 +0000 UTC m=+72.894828230" watchObservedRunningTime="2026-07-08 17:20:34.95276308 +0000 UTC m=+72.895522394" Jul 08 17:20:35.414593 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:35.414545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-tls\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:35.414790 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:35.414677 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 17:20:35.414790 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:35.414753 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-tls podName:bb26c879-3d75-4ab5-8410-409a51c1e5aa nodeName:}" failed. No retries permitted until 2026-07-08 17:20:36.414732215 +0000 UTC m=+74.357491508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-tls") pod "node-exporter-7gkj4" (UID: "bb26c879-3d75-4ab5-8410-409a51c1e5aa") : secret "node-exporter-tls" not found Jul 08 17:20:36.424463 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.424418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-tls\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:36.426953 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.426923 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb26c879-3d75-4ab5-8410-409a51c1e5aa-node-exporter-tls\") pod \"node-exporter-7gkj4\" (UID: \"bb26c879-3d75-4ab5-8410-409a51c1e5aa\") " pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:36.566054 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.566020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gkj4" Jul 08 17:20:36.827492 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.827458 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx"] Jul 08 17:20:36.830111 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.830089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:36.833611 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.832937 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 08 17:20:36.833611 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.832949 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f1p6pcqhk4ma8\"" Jul 08 17:20:36.833611 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.833131 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 08 17:20:36.833611 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.833221 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 08 17:20:36.833611 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.833335 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 08 17:20:36.833611 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.833432 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 08 17:20:36.833611 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.833462 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dhxjw\"" Jul 08 17:20:36.842567 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.842545 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx"] Jul 08 17:20:36.929782 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.929750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:36.929782 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.929783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:36.930016 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.929818 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-metrics-client-ca\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:36.930016 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.929879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-tls\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:36.930016 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.929911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc6tf\" (UniqueName: \"kubernetes.io/projected/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-kube-api-access-mc6tf\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:36.930016 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.929956 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:36.930016 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.930007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-grpc-tls\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:36.930271 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:36.930037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.030813 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.030776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.030979 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.030823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-grpc-tls\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.031082 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.031060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.031160 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.031139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.031217 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.031176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.031265 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.031229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-metrics-client-ca\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.031326 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.031259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-tls\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.031326 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.031288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc6tf\" (UniqueName: \"kubernetes.io/projected/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-kube-api-access-mc6tf\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.032659 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.032401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-metrics-client-ca\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.033939 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.033821 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.034410 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.034068 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.034592 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.034569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-grpc-tls\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.034712 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.034689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-tls\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.034769 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.034718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.034851 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.034834 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.041247 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.041226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc6tf\" (UniqueName: \"kubernetes.io/projected/36563e7c-f9b0-4a7a-9ed2-cc013b3484f8-kube-api-access-mc6tf\") pod \"thanos-querier-7b88fd8dc-4zlbx\" (UID: \"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8\") " pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:37.141432 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:37.141327 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:39.505012 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:39.504981 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:20:41.740009 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:20:41.739974 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb26c879_3d75_4ab5_8410_409a51c1e5aa.slice/crio-1a754619a54a76a96c412b22107fa1bb0040ff97d9e1d1116eda375012d348b1 WatchSource:0}: Error finding container 1a754619a54a76a96c412b22107fa1bb0040ff97d9e1d1116eda375012d348b1: Status 404 returned error can't find the container with id 1a754619a54a76a96c412b22107fa1bb0040ff97d9e1d1116eda375012d348b1 Jul 08 17:20:41.839110 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:41.839088 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f5d577cd6-lk7dm" Jul 08 17:20:41.878172 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:41.878020 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx"] Jul 08 17:20:41.880609 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:20:41.880580 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36563e7c_f9b0_4a7a_9ed2_cc013b3484f8.slice/crio-568f04c30c9f36aa618279da98e333a804e06d0619c3f05df043bc21059e1911 WatchSource:0}: Error finding container 568f04c30c9f36aa618279da98e333a804e06d0619c3f05df043bc21059e1911: Status 404 returned error can't find the container with id 568f04c30c9f36aa618279da98e333a804e06d0619c3f05df043bc21059e1911 Jul 08 17:20:41.935499 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:41.935467 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" event={"ID":"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8","Type":"ContainerStarted","Data":"568f04c30c9f36aa618279da98e333a804e06d0619c3f05df043bc21059e1911"} Jul 08 17:20:41.936578 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:41.936553 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gkj4" event={"ID":"bb26c879-3d75-4ab5-8410-409a51c1e5aa","Type":"ContainerStarted","Data":"1a754619a54a76a96c412b22107fa1bb0040ff97d9e1d1116eda375012d348b1"} Jul 08 17:20:42.943976 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:42.943935 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-fkvnw" event={"ID":"34962b6e-f3ad-45ac-b721-a5a2cfdd88ea","Type":"ContainerStarted","Data":"dc6d3c36e198cd9e0cfe341bcabb56616a089a7d59d1cd1f0ae4b058d8d7221f"} Jul 08 17:20:42.944801 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:42.944741 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-fkvnw" Jul 08 17:20:42.957566 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:42.957546 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-fkvnw" Jul 08 17:20:42.987224 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:42.986751 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-fkvnw" podStartSLOduration=1.508856353 podStartE2EDuration="23.986728688s" totalImagesPullingTime="22.477872335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:42.965548365 +0000 UTC m=+80.908307704" watchObservedRunningTime="2026-07-08 17:20:42.986728688 +0000 UTC m=+80.929488003" Jul 08 17:20:43.951250 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:43.951205 2577 generic.go:356] "Generic (PLEG): container finished" podID="bb26c879-3d75-4ab5-8410-409a51c1e5aa" containerID="6eaed4c8f8b08fa8cc639407abac32477f601401273a7e2c58e105f24e44bdfc" exitCode=0 Jul 08 17:20:43.951750 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:43.951297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gkj4" event={"ID":"bb26c879-3d75-4ab5-8410-409a51c1e5aa","Type":"ContainerDied","Data":"6eaed4c8f8b08fa8cc639407abac32477f601401273a7e2c58e105f24e44bdfc"} Jul 08 17:20:44.520156 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.520081 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" podUID="d141c553-dc3e-420f-a6c4-768e16b4a016" containerName="registry" containerID="cri-o://b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66" gracePeriod=30 Jul 08 17:20:44.835540 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.835107 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:20:44.957763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.957728 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gkj4" event={"ID":"bb26c879-3d75-4ab5-8410-409a51c1e5aa","Type":"ContainerStarted","Data":"ab4c8349b8542d57ac415d0414cc5ce6d23f6e5de937233d74749d0d1172972a"} Jul 08 17:20:44.958098 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.957802 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gkj4" event={"ID":"bb26c879-3d75-4ab5-8410-409a51c1e5aa","Type":"ContainerStarted","Data":"4715f0efdf29ea74223683e51303860222745956d28a38a431e6f8924903d799"} Jul 08 17:20:44.959859 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.959835 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" event={"ID":"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8","Type":"ContainerStarted","Data":"5bfa56f377f830bd82c47e7588c2ed61224fc635b201c39aa0f0223d0755b279"} Jul 08 17:20:44.960018 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.959997 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" event={"ID":"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8","Type":"ContainerStarted","Data":"96595d2c4b66a6d1ab22d8fe5e2613250a88ab0c96b2f278b904f5269684a8e0"} Jul 08 17:20:44.961823 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.961096 2577 generic.go:356] "Generic (PLEG): container finished" podID="d141c553-dc3e-420f-a6c4-768e16b4a016" containerID="b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66" exitCode=0 Jul 08 17:20:44.961823 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.961553 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" Jul 08 17:20:44.961823 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.961651 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" event={"ID":"d141c553-dc3e-420f-a6c4-768e16b4a016","Type":"ContainerDied","Data":"b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66"} Jul 08 17:20:44.961823 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.961687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d55599db6-86mcq" event={"ID":"d141c553-dc3e-420f-a6c4-768e16b4a016","Type":"ContainerDied","Data":"f31ee498364b7fb4ad7fbe58293d7a1458ee2f1c9c8d65f3735497333baf69db"} Jul 08 17:20:44.961823 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.961714 2577 scope.go:117] "RemoveContainer" containerID="b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66" Jul 08 17:20:44.970723 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.970703 2577 scope.go:117] "RemoveContainer" containerID="b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66" Jul 08 17:20:44.971010 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:20:44.970985 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66\": container with ID starting with b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66 not found: ID does not exist" containerID="b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66" Jul 08 17:20:44.971077 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.971022 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66"} err="failed to get container status \"b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66\": rpc error: code = NotFound desc = could not find container \"b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66\": container with ID starting with b4a00f154ebea224a205e34ad2799b59c0657886d018c26514438bd5bd18dd66 not found: ID does not exist" Jul 08 17:20:44.977982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.977944 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7gkj4" podStartSLOduration=9.666090718 podStartE2EDuration="10.977927994s" totalImagesPullingTime="1.225048853s" totalInitContainerRuntime="86.788423ms" isStatefulPod=true podCreationTimestamp="2026-07-08 17:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:44.977268848 +0000 UTC m=+82.920028177" watchObservedRunningTime="2026-07-08 17:20:44.977927994 +0000 UTC m=+82.920687307" Jul 08 17:20:44.996693 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.996668 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-certificates\") pod \"d141c553-dc3e-420f-a6c4-768e16b4a016\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " Jul 08 17:20:44.996781 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.996711 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls\") pod \"d141c553-dc3e-420f-a6c4-768e16b4a016\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " Jul 08 17:20:44.996781 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.996743 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-installation-pull-secrets\") pod \"d141c553-dc3e-420f-a6c4-768e16b4a016\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " Jul 08 17:20:44.996781 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.996769 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-trusted-ca\") pod \"d141c553-dc3e-420f-a6c4-768e16b4a016\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " Jul 08 17:20:44.996942 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.996799 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-image-registry-private-configuration\") pod \"d141c553-dc3e-420f-a6c4-768e16b4a016\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " Jul 08 17:20:44.996942 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.996829 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d141c553-dc3e-420f-a6c4-768e16b4a016-ca-trust-extracted\") pod \"d141c553-dc3e-420f-a6c4-768e16b4a016\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " Jul 08 17:20:44.996942 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.996862 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqpdq\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-kube-api-access-hqpdq\") pod \"d141c553-dc3e-420f-a6c4-768e16b4a016\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " Jul 08 17:20:44.996942 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.996911 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-bound-sa-token\") pod \"d141c553-dc3e-420f-a6c4-768e16b4a016\" (UID: \"d141c553-dc3e-420f-a6c4-768e16b4a016\") " Jul 08 17:20:44.997520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.997135 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d141c553-dc3e-420f-a6c4-768e16b4a016" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:20:44.997520 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.997235 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-certificates\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:20:44.998201 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:44.997851 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d141c553-dc3e-420f-a6c4-768e16b4a016" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:20:45.001485 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.001455 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d141c553-dc3e-420f-a6c4-768e16b4a016" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:20:45.002081 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.001980 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d141c553-dc3e-420f-a6c4-768e16b4a016" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:20:45.002173 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.002082 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d141c553-dc3e-420f-a6c4-768e16b4a016" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:20:45.002173 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.002136 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-kube-api-access-hqpdq" (OuterVolumeSpecName: "kube-api-access-hqpdq") pod "d141c553-dc3e-420f-a6c4-768e16b4a016" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016"). InnerVolumeSpecName "kube-api-access-hqpdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:20:45.002262 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.002230 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d141c553-dc3e-420f-a6c4-768e16b4a016" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:20:45.008906 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.008878 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d141c553-dc3e-420f-a6c4-768e16b4a016-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d141c553-dc3e-420f-a6c4-768e16b4a016" (UID: "d141c553-dc3e-420f-a6c4-768e16b4a016"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:20:45.098177 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.098091 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-image-registry-private-configuration\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:20:45.098177 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.098133 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d141c553-dc3e-420f-a6c4-768e16b4a016-ca-trust-extracted\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:20:45.098177 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.098148 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqpdq\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-kube-api-access-hqpdq\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:20:45.098177 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.098165 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-bound-sa-token\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:20:45.098177 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.098180 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d141c553-dc3e-420f-a6c4-768e16b4a016-registry-tls\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:20:45.098504 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.098193 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d141c553-dc3e-420f-a6c4-768e16b4a016-installation-pull-secrets\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:20:45.098504 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.098207 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d141c553-dc3e-420f-a6c4-768e16b4a016-trusted-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:20:45.289507 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.289476 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d55599db6-86mcq"] Jul 08 17:20:45.293260 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.293229 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d55599db6-86mcq"] Jul 08 17:20:45.518532 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.518499 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86b9b46fc8-v624s"] Jul 08 17:20:45.518828 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.518811 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d141c553-dc3e-420f-a6c4-768e16b4a016" containerName="registry" Jul 08 17:20:45.518901 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.518831 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d141c553-dc3e-420f-a6c4-768e16b4a016" containerName="registry" Jul 08 17:20:45.518901 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.518888 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d141c553-dc3e-420f-a6c4-768e16b4a016" containerName="registry" Jul 08 17:20:45.553677 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.553648 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b9b46fc8-v624s"] Jul 08 17:20:45.553827 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.553763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.556910 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.556885 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 17:20:45.556910 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.556898 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 17:20:45.557137 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.556949 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-528mx\"" Jul 08 17:20:45.557137 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.557088 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 17:20:45.557954 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.557933 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 17:20:45.558090 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.557984 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 17:20:45.562579 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.562560 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 17:20:45.703710 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.703672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-trusted-ca-bundle\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.703890 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.703721 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-oauth-serving-cert\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.703890 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.703739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scrz2\" (UniqueName: \"kubernetes.io/projected/ec8e22a8-cd21-42a6-abb8-22120db83ea7-kube-api-access-scrz2\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.703890 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.703805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-service-ca\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.703890 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.703885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-config\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.704057 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.703925 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-oauth-config\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.704057 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.703951 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-serving-cert\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.805154 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.805057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-config\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.805154 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.805125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-oauth-config\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.805154 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.805153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-serving-cert\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.805436 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.805185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-trusted-ca-bundle\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.805436 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.805235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-oauth-serving-cert\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.805436 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.805255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scrz2\" (UniqueName: \"kubernetes.io/projected/ec8e22a8-cd21-42a6-abb8-22120db83ea7-kube-api-access-scrz2\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.805436 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.805272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-service-ca\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.805872 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.805842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-config\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.806006 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.805906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-service-ca\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.806470 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.806439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-oauth-serving-cert\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.806576 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.806559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-trusted-ca-bundle\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.809595 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.809570 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-oauth-config\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.809731 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.809707 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-serving-cert\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.815827 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.815783 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scrz2\" (UniqueName: \"kubernetes.io/projected/ec8e22a8-cd21-42a6-abb8-22120db83ea7-kube-api-access-scrz2\") pod \"console-86b9b46fc8-v624s\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.864964 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.864939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:45.967990 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:45.967950 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" event={"ID":"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8","Type":"ContainerStarted","Data":"3ae7b523079eb28005cf5c43d34437f6b747de0f6eea5374e5d8a0d5507f488e"} Jul 08 17:20:46.037905 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:46.037872 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b9b46fc8-v624s"] Jul 08 17:20:46.182049 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:20:46.181982 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8e22a8_cd21_42a6_abb8_22120db83ea7.slice/crio-492a103650eb7806aee618b898b3ca4f7260f222a5b8947477a55a633f52814d WatchSource:0}: Error finding container 492a103650eb7806aee618b898b3ca4f7260f222a5b8947477a55a633f52814d: Status 404 returned error can't find the container with id 492a103650eb7806aee618b898b3ca4f7260f222a5b8947477a55a633f52814d Jul 08 17:20:46.562506 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:46.562479 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d141c553-dc3e-420f-a6c4-768e16b4a016" path="/var/lib/kubelet/pods/d141c553-dc3e-420f-a6c4-768e16b4a016/volumes" Jul 08 17:20:46.977728 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:46.977695 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" event={"ID":"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8","Type":"ContainerStarted","Data":"59310cfebc98354ba18cf76e56848140161165e471a3d70b7c19ea6c3fbee541"} Jul 08 17:20:46.978171 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:46.977762 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" event={"ID":"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8","Type":"ContainerStarted","Data":"904c32cfe251b9eb5b17ea42490d17c7bee98310d3c0a8e6f0ed72280495e2b4"} Jul 08 17:20:46.978171 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:46.977809 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" event={"ID":"36563e7c-f9b0-4a7a-9ed2-cc013b3484f8","Type":"ContainerStarted","Data":"4d8f8b5732b22d9e13d9319b8bd733ec542170e1b12d963bb427aca047592b73"} Jul 08 17:20:46.978171 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:46.977857 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:46.980062 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:46.980025 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b9b46fc8-v624s" event={"ID":"ec8e22a8-cd21-42a6-abb8-22120db83ea7","Type":"ContainerStarted","Data":"492a103650eb7806aee618b898b3ca4f7260f222a5b8947477a55a633f52814d"} Jul 08 17:20:50.399719 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.399653 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" podStartSLOduration=10.186520851 podStartE2EDuration="14.399628603s" totalImagesPullingTime="4.213107752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:47.002007677 +0000 UTC m=+84.944767018" watchObservedRunningTime="2026-07-08 17:20:50.399628603 +0000 UTC m=+88.342388285" Jul 08 17:20:50.400448 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.400419 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn"] Jul 08 17:20:50.473756 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.473722 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn"] Jul 08 17:20:50.473756 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.473827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn" Jul 08 17:20:50.476699 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.476677 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8"] Jul 08 17:20:50.476969 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.476940 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 17:20:50.477181 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.477165 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 17:20:50.477362 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.477345 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 17:20:50.478295 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.477543 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-slwsg\"" Jul 08 17:20:50.478295 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.478142 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 08 17:20:50.497802 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.497784 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8"] Jul 08 17:20:50.497920 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.497891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.501707 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.501684 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 08 17:20:50.502018 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.501954 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 08 17:20:50.502186 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.502168 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 08 17:20:50.502365 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.502348 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 08 17:20:50.654939 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.654864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-hub\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.654939 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.654916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-ca\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.655151 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.654998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1653dc-c08c-4d80-8463-519c4b5a6c16-additional-service-ca\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.655151 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.655031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/929f1500-589e-490a-8300-cd63b16cf297-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59b474d688-277mn\" (UID: \"929f1500-589e-490a-8300-cd63b16cf297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn" Jul 08 17:20:50.655151 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.655074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.655151 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.655102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.655343 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.655187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89ftw\" (UniqueName: \"kubernetes.io/projected/7e1653dc-c08c-4d80-8463-519c4b5a6c16-kube-api-access-89ftw\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.655343 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.655217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsqhr\" (UniqueName: \"kubernetes.io/projected/929f1500-589e-490a-8300-cd63b16cf297-kube-api-access-tsqhr\") pod \"managed-serviceaccount-addon-agent-59b474d688-277mn\" (UID: \"929f1500-589e-490a-8300-cd63b16cf297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn" Jul 08 17:20:50.756176 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.756143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89ftw\" (UniqueName: \"kubernetes.io/projected/7e1653dc-c08c-4d80-8463-519c4b5a6c16-kube-api-access-89ftw\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.756176 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.756182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsqhr\" (UniqueName: \"kubernetes.io/projected/929f1500-589e-490a-8300-cd63b16cf297-kube-api-access-tsqhr\") pod \"managed-serviceaccount-addon-agent-59b474d688-277mn\" (UID: \"929f1500-589e-490a-8300-cd63b16cf297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn" Jul 08 17:20:50.756421 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.756216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-hub\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.756421 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.756285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-ca\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.756421 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.756361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1653dc-c08c-4d80-8463-519c4b5a6c16-additional-service-ca\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.756575 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.756541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/929f1500-589e-490a-8300-cd63b16cf297-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59b474d688-277mn\" (UID: \"929f1500-589e-490a-8300-cd63b16cf297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn" Jul 08 17:20:50.756631 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.756593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.756687 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.756628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.757142 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.757116 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1653dc-c08c-4d80-8463-519c4b5a6c16-additional-service-ca\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.759869 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.759785 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-ca\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.759869 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.759788 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.760042 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.759922 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/929f1500-589e-490a-8300-cd63b16cf297-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59b474d688-277mn\" (UID: \"929f1500-589e-490a-8300-cd63b16cf297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn" Jul 08 17:20:50.760466 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.760443 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-hub\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.761889 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.761865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e1653dc-c08c-4d80-8463-519c4b5a6c16-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.767510 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.767459 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsqhr\" (UniqueName: \"kubernetes.io/projected/929f1500-589e-490a-8300-cd63b16cf297-kube-api-access-tsqhr\") pod \"managed-serviceaccount-addon-agent-59b474d688-277mn\" (UID: \"929f1500-589e-490a-8300-cd63b16cf297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn" Jul 08 17:20:50.768073 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.768048 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89ftw\" (UniqueName: \"kubernetes.io/projected/7e1653dc-c08c-4d80-8463-519c4b5a6c16-kube-api-access-89ftw\") pod \"cluster-proxy-proxy-agent-697f95f6f9-trjr8\" (UID: \"7e1653dc-c08c-4d80-8463-519c4b5a6c16\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.794775 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.794757 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn" Jul 08 17:20:50.813330 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.813303 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" Jul 08 17:20:50.981311 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:50.981277 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn"] Jul 08 17:20:51.004078 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:51.003936 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8"] Jul 08 17:20:51.091771 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:20:51.091734 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod929f1500_589e_490a_8300_cd63b16cf297.slice/crio-6268ec66f5d8a57c8ef63ba481a13fe1f524f134fb6b90e407cf04587776eb0f WatchSource:0}: Error finding container 6268ec66f5d8a57c8ef63ba481a13fe1f524f134fb6b90e407cf04587776eb0f: Status 404 returned error can't find the container with id 6268ec66f5d8a57c8ef63ba481a13fe1f524f134fb6b90e407cf04587776eb0f Jul 08 17:20:51.092769 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:20:51.092741 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e1653dc_c08c_4d80_8463_519c4b5a6c16.slice/crio-990070e0efa828b6d2c36ea05ecd789d8009473f2c3aa1b014daeb7ec247455f WatchSource:0}: Error finding container 990070e0efa828b6d2c36ea05ecd789d8009473f2c3aa1b014daeb7ec247455f: Status 404 returned error can't find the container with id 990070e0efa828b6d2c36ea05ecd789d8009473f2c3aa1b014daeb7ec247455f Jul 08 17:20:52.016411 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:52.012430 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b9b46fc8-v624s" event={"ID":"ec8e22a8-cd21-42a6-abb8-22120db83ea7","Type":"ContainerStarted","Data":"021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536"} Jul 08 17:20:52.016411 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:52.014672 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" event={"ID":"7e1653dc-c08c-4d80-8463-519c4b5a6c16","Type":"ContainerStarted","Data":"990070e0efa828b6d2c36ea05ecd789d8009473f2c3aa1b014daeb7ec247455f"} Jul 08 17:20:52.016411 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:52.016272 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn" event={"ID":"929f1500-589e-490a-8300-cd63b16cf297","Type":"ContainerStarted","Data":"6268ec66f5d8a57c8ef63ba481a13fe1f524f134fb6b90e407cf04587776eb0f"} Jul 08 17:20:52.046133 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:52.046079 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86b9b46fc8-v624s" podStartSLOduration=2.104635397 podStartE2EDuration="7.046062235s" totalImagesPullingTime="4.941426838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:52.043935433 +0000 UTC m=+89.986694770" watchObservedRunningTime="2026-07-08 17:20:52.046062235 +0000 UTC m=+89.988821550" Jul 08 17:20:52.991655 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:52.991624 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b88fd8dc-4zlbx" Jul 08 17:20:55.866080 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:55.866041 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:55.866558 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:55.866129 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:55.870700 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:55.870676 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:56.059278 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:56.059257 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:20:57.039123 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:57.039086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn" event={"ID":"929f1500-589e-490a-8300-cd63b16cf297","Type":"ContainerStarted","Data":"4b6a32bea5da6171fbaafbfd3ceedb0d58f5b6c472755829ce525c6252e1ecd9"} Jul 08 17:20:57.041067 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:57.041042 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" event={"ID":"7e1653dc-c08c-4d80-8463-519c4b5a6c16","Type":"ContainerStarted","Data":"edc62abb4dfe5d364d1e68201aa9c1208b1c221428b055e0057b486b9d13f890"} Jul 08 17:20:57.041177 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:57.041081 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" event={"ID":"7e1653dc-c08c-4d80-8463-519c4b5a6c16","Type":"ContainerStarted","Data":"a4f3261fdd23e3939bf9413c316c00b9bfffe952ee2f8fbefd1054f3384a59f3"} Jul 08 17:20:57.041177 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:57.041094 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" event={"ID":"7e1653dc-c08c-4d80-8463-519c4b5a6c16","Type":"ContainerStarted","Data":"f542434a24f2a082bb0662036e9902018ecf8f9c53dc83a1b743f61c858d26dd"} Jul 08 17:20:57.054818 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:57.054780 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b474d688-277mn" podStartSLOduration=2.170279695 podStartE2EDuration="7.054765746s" totalImagesPullingTime="4.884486051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:57.053943023 +0000 UTC m=+94.996702338" watchObservedRunningTime="2026-07-08 17:20:57.054765746 +0000 UTC m=+94.997525066" Jul 08 17:20:57.074200 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:20:57.074166 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697f95f6f9-trjr8" podStartSLOduration=2.1764460899999998 podStartE2EDuration="7.07415586s" totalImagesPullingTime="4.89770977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:57.073938794 +0000 UTC m=+95.016698110" watchObservedRunningTime="2026-07-08 17:20:57.07415586 +0000 UTC m=+95.016915173" Jul 08 17:21:06.918303 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:21:06.918269 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t6pnw" Jul 08 17:21:12.125183 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:21:12.125139 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-86rfq_d0357f42-46e8-4913-bf62-fa0c2751c149/serve-healthcheck-canary/0.log" Jul 08 17:22:14.664967 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:14.664893 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b9b46fc8-v624s"] Jul 08 17:22:39.685629 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:39.685559 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86b9b46fc8-v624s" podUID="ec8e22a8-cd21-42a6-abb8-22120db83ea7" containerName="console" containerID="cri-o://021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536" gracePeriod=15 Jul 08 17:22:39.944235 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:39.944171 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:22:40.035156 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.035117 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scrz2\" (UniqueName: \"kubernetes.io/projected/ec8e22a8-cd21-42a6-abb8-22120db83ea7-kube-api-access-scrz2\") pod \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " Jul 08 17:22:40.035156 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.035153 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-oauth-serving-cert\") pod \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " Jul 08 17:22:40.035440 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.035182 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-oauth-config\") pod \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " Jul 08 17:22:40.035440 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.035211 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-service-ca\") pod \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " Jul 08 17:22:40.035440 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.035252 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-serving-cert\") pod \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " Jul 08 17:22:40.035440 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.035277 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-trusted-ca-bundle\") pod \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " Jul 08 17:22:40.035440 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.035299 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-config\") pod \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\" (UID: \"ec8e22a8-cd21-42a6-abb8-22120db83ea7\") " Jul 08 17:22:40.035773 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.035740 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ec8e22a8-cd21-42a6-abb8-22120db83ea7" (UID: "ec8e22a8-cd21-42a6-abb8-22120db83ea7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:22:40.035902 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.035779 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ec8e22a8-cd21-42a6-abb8-22120db83ea7" (UID: "ec8e22a8-cd21-42a6-abb8-22120db83ea7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:22:40.036115 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.036074 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-service-ca" (OuterVolumeSpecName: "service-ca") pod "ec8e22a8-cd21-42a6-abb8-22120db83ea7" (UID: "ec8e22a8-cd21-42a6-abb8-22120db83ea7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:22:40.036297 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.036273 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-config" (OuterVolumeSpecName: "console-config") pod "ec8e22a8-cd21-42a6-abb8-22120db83ea7" (UID: "ec8e22a8-cd21-42a6-abb8-22120db83ea7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:22:40.037676 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.037654 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ec8e22a8-cd21-42a6-abb8-22120db83ea7" (UID: "ec8e22a8-cd21-42a6-abb8-22120db83ea7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:22:40.037762 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.037669 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ec8e22a8-cd21-42a6-abb8-22120db83ea7" (UID: "ec8e22a8-cd21-42a6-abb8-22120db83ea7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:22:40.037800 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.037759 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec8e22a8-cd21-42a6-abb8-22120db83ea7-kube-api-access-scrz2" (OuterVolumeSpecName: "kube-api-access-scrz2") pod "ec8e22a8-cd21-42a6-abb8-22120db83ea7" (UID: "ec8e22a8-cd21-42a6-abb8-22120db83ea7"). InnerVolumeSpecName "kube-api-access-scrz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:22:40.135947 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.135908 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scrz2\" (UniqueName: \"kubernetes.io/projected/ec8e22a8-cd21-42a6-abb8-22120db83ea7-kube-api-access-scrz2\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:22:40.135947 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.135940 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-oauth-serving-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:22:40.135947 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.135953 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-oauth-config\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:22:40.136186 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.135967 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:22:40.136186 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.135980 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-serving-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:22:40.136186 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.135991 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-trusted-ca-bundle\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:22:40.136186 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.136004 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec8e22a8-cd21-42a6-abb8-22120db83ea7-console-config\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:22:40.403814 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.403783 2577 generic.go:356] "Generic (PLEG): container finished" podID="ec8e22a8-cd21-42a6-abb8-22120db83ea7" containerID="021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536" exitCode=0 Jul 08 17:22:40.404007 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.403830 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b9b46fc8-v624s" Jul 08 17:22:40.404007 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.403832 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b9b46fc8-v624s" event={"ID":"ec8e22a8-cd21-42a6-abb8-22120db83ea7","Type":"ContainerDied","Data":"021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536"} Jul 08 17:22:40.404007 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.403932 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b9b46fc8-v624s" event={"ID":"ec8e22a8-cd21-42a6-abb8-22120db83ea7","Type":"ContainerDied","Data":"492a103650eb7806aee618b898b3ca4f7260f222a5b8947477a55a633f52814d"} Jul 08 17:22:40.404007 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.403951 2577 scope.go:117] "RemoveContainer" containerID="021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536" Jul 08 17:22:40.412305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.412286 2577 scope.go:117] "RemoveContainer" containerID="021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536" Jul 08 17:22:40.412608 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:22:40.412588 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536\": container with ID starting with 021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536 not found: ID does not exist" containerID="021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536" Jul 08 17:22:40.412655 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.412616 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536"} err="failed to get container status \"021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536\": rpc error: code = NotFound desc = could not find container \"021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536\": container with ID starting with 021f12285a1a404fb567fc5b835349498088a85fc67f2d5a16b163de2a995536 not found: ID does not exist" Jul 08 17:22:40.424052 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.424023 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b9b46fc8-v624s"] Jul 08 17:22:40.427877 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.427855 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86b9b46fc8-v624s"] Jul 08 17:22:40.557701 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:22:40.557666 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec8e22a8-cd21-42a6-abb8-22120db83ea7" path="/var/lib/kubelet/pods/ec8e22a8-cd21-42a6-abb8-22120db83ea7/volumes" Jul 08 17:23:19.171668 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.171635 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f8d5b954d-d9rqm"] Jul 08 17:23:19.172134 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.171906 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec8e22a8-cd21-42a6-abb8-22120db83ea7" containerName="console" Jul 08 17:23:19.172134 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.171937 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec8e22a8-cd21-42a6-abb8-22120db83ea7" containerName="console" Jul 08 17:23:19.172134 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.171982 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec8e22a8-cd21-42a6-abb8-22120db83ea7" containerName="console" Jul 08 17:23:19.173618 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.173602 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.176446 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.176424 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 17:23:19.176737 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.176717 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 17:23:19.178166 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.178146 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 17:23:19.178288 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.178180 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 17:23:19.178288 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.178154 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-528mx\"" Jul 08 17:23:19.179165 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.179148 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 17:23:19.182535 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.182517 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 17:23:19.189146 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.189128 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8d5b954d-d9rqm"] Jul 08 17:23:19.314850 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.314805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-oauth-serving-cert\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.314850 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.314851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cxkj\" (UniqueName: \"kubernetes.io/projected/f70e0fbd-7469-426b-bc02-fc4049cb2e93-kube-api-access-5cxkj\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.315025 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.314897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-serving-cert\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.315025 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.314930 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-oauth-config\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.315025 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.314968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-service-ca\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.315025 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.314993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-trusted-ca-bundle\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.315025 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.315008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-config\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.415471 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.415434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-serving-cert\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.415471 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.415476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-oauth-config\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.415632 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.415507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-service-ca\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.415632 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.415531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-trusted-ca-bundle\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.415632 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.415545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-config\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.415632 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.415562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-oauth-serving-cert\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.415632 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.415577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cxkj\" (UniqueName: \"kubernetes.io/projected/f70e0fbd-7469-426b-bc02-fc4049cb2e93-kube-api-access-5cxkj\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.416365 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.416343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-oauth-serving-cert\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.416478 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.416366 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-trusted-ca-bundle\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.416651 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.416631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-service-ca\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.416691 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.416666 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-config\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.418156 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.418140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-oauth-config\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.418217 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.418200 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-serving-cert\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.424575 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.424519 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cxkj\" (UniqueName: \"kubernetes.io/projected/f70e0fbd-7469-426b-bc02-fc4049cb2e93-kube-api-access-5cxkj\") pod \"console-5f8d5b954d-d9rqm\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.482161 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.482134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:19.608178 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:19.608070 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8d5b954d-d9rqm"] Jul 08 17:23:19.610942 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:23:19.610907 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70e0fbd_7469_426b_bc02_fc4049cb2e93.slice/crio-6e81d1e0b40689fd8e44e2cda88e29a0134a5582c287e053e8589082b05f8270 WatchSource:0}: Error finding container 6e81d1e0b40689fd8e44e2cda88e29a0134a5582c287e053e8589082b05f8270: Status 404 returned error can't find the container with id 6e81d1e0b40689fd8e44e2cda88e29a0134a5582c287e053e8589082b05f8270 Jul 08 17:23:20.544966 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:20.544926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8d5b954d-d9rqm" event={"ID":"f70e0fbd-7469-426b-bc02-fc4049cb2e93","Type":"ContainerStarted","Data":"49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619"} Jul 08 17:23:20.545446 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:20.544982 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8d5b954d-d9rqm" event={"ID":"f70e0fbd-7469-426b-bc02-fc4049cb2e93","Type":"ContainerStarted","Data":"6e81d1e0b40689fd8e44e2cda88e29a0134a5582c287e053e8589082b05f8270"} Jul 08 17:23:20.562154 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:20.562108 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f8d5b954d-d9rqm" podStartSLOduration=1.562093814 podStartE2EDuration="1.562093814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:23:20.561650835 +0000 UTC m=+238.504410166" watchObservedRunningTime="2026-07-08 17:23:20.562093814 +0000 UTC m=+238.504853138" Jul 08 17:23:29.483092 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:29.483041 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:29.483587 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:29.483116 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:29.487807 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:29.487782 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:23:29.576809 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:23:29.576784 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:24:22.438019 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:24:22.437991 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 17:25:36.111955 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.111854 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d"] Jul 08 17:25:36.114081 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.114065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.117148 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.117117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 17:25:36.117279 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.117159 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 17:25:36.117279 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.117245 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 17:25:36.117279 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.117256 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 17:25:36.117583 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.117567 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5mnw4\"" Jul 08 17:25:36.130925 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.130900 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d"] Jul 08 17:25:36.195603 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.195573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb5833f6-b976-46d0-987a-7d036d3766b5-manifests\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.195779 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.195608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb5833f6-b976-46d0-987a-7d036d3766b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.195779 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.195636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl725\" (UniqueName: \"kubernetes.io/projected/bb5833f6-b976-46d0-987a-7d036d3766b5-kube-api-access-cl725\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.195779 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.195746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb5833f6-b976-46d0-987a-7d036d3766b5-tmp\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.195926 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.195779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb5833f6-b976-46d0-987a-7d036d3766b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.296060 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.296028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl725\" (UniqueName: \"kubernetes.io/projected/bb5833f6-b976-46d0-987a-7d036d3766b5-kube-api-access-cl725\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.296217 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.296082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb5833f6-b976-46d0-987a-7d036d3766b5-tmp\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.296217 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.296100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb5833f6-b976-46d0-987a-7d036d3766b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.296217 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.296126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb5833f6-b976-46d0-987a-7d036d3766b5-manifests\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.296217 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.296155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb5833f6-b976-46d0-987a-7d036d3766b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.296621 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.296599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb5833f6-b976-46d0-987a-7d036d3766b5-manifests\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.298599 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.298574 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb5833f6-b976-46d0-987a-7d036d3766b5-tmp\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.298792 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.298774 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb5833f6-b976-46d0-987a-7d036d3766b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.298832 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.298783 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb5833f6-b976-46d0-987a-7d036d3766b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.308965 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.308935 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl725\" (UniqueName: \"kubernetes.io/projected/bb5833f6-b976-46d0-987a-7d036d3766b5-kube-api-access-cl725\") pod \"opendatahub-operator-controller-manager-574956cb5f-6zl8d\" (UID: \"bb5833f6-b976-46d0-987a-7d036d3766b5\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.424253 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.424181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:36.566684 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.566656 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d"] Jul 08 17:25:36.570117 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:25:36.570090 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5833f6_b976_46d0_987a_7d036d3766b5.slice/crio-3aebc2bb01da466c45b2ea066095e29a82f08062ba5ec4ca07afaf8a04aca337 WatchSource:0}: Error finding container 3aebc2bb01da466c45b2ea066095e29a82f08062ba5ec4ca07afaf8a04aca337: Status 404 returned error can't find the container with id 3aebc2bb01da466c45b2ea066095e29a82f08062ba5ec4ca07afaf8a04aca337 Jul 08 17:25:36.571836 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.571819 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:25:36.999974 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:36.999941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" event={"ID":"bb5833f6-b976-46d0-987a-7d036d3766b5","Type":"ContainerStarted","Data":"3aebc2bb01da466c45b2ea066095e29a82f08062ba5ec4ca07afaf8a04aca337"} Jul 08 17:25:41.022495 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:41.022462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" event={"ID":"bb5833f6-b976-46d0-987a-7d036d3766b5","Type":"ContainerStarted","Data":"1312d2cb8a141a7e437115d36d09eecce69037c4a58027a21e362a72946b2a93"} Jul 08 17:25:42.027964 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:42.027928 2577 generic.go:356] "Generic (PLEG): container finished" podID="bb5833f6-b976-46d0-987a-7d036d3766b5" containerID="1312d2cb8a141a7e437115d36d09eecce69037c4a58027a21e362a72946b2a93" exitCode=0 Jul 08 17:25:42.028391 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:42.028010 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" event={"ID":"bb5833f6-b976-46d0-987a-7d036d3766b5","Type":"ContainerDied","Data":"1312d2cb8a141a7e437115d36d09eecce69037c4a58027a21e362a72946b2a93"} Jul 08 17:25:43.033688 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:43.033654 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" event={"ID":"bb5833f6-b976-46d0-987a-7d036d3766b5","Type":"ContainerStarted","Data":"50f5eca3f7b5f6ac10ffd608e8159b3ac565a77d43afd328bc120a164b1a6239"} Jul 08 17:25:43.034074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:43.033770 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:43.055909 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:43.055862 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" podStartSLOduration=2.103451116 podStartE2EDuration="7.055848084s" totalImagesPullingTime="3.864394422s" totalInitContainerRuntime="1.088002546s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:25:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:25:43.053348579 +0000 UTC m=+380.996107903" watchObservedRunningTime="2026-07-08 17:25:43.055848084 +0000 UTC m=+380.998607398" Jul 08 17:25:54.039246 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:54.039212 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-6zl8d" Jul 08 17:25:56.948897 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:56.948863 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cqj4w"] Jul 08 17:25:56.957169 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:56.957145 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" Jul 08 17:25:56.959957 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:56.959932 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 08 17:25:56.973551 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:56.973530 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cqj4w"] Jul 08 17:25:57.041733 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:57.041699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60dbf7c-962c-4791-8c54-6a4a0855e895-tls-certs\") pod \"model-serving-api-54d89bd5fc-cqj4w\" (UID: \"b60dbf7c-962c-4791-8c54-6a4a0855e895\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" Jul 08 17:25:57.041894 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:57.041737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97h4k\" (UniqueName: \"kubernetes.io/projected/b60dbf7c-962c-4791-8c54-6a4a0855e895-kube-api-access-97h4k\") pod \"model-serving-api-54d89bd5fc-cqj4w\" (UID: \"b60dbf7c-962c-4791-8c54-6a4a0855e895\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" Jul 08 17:25:57.142767 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:57.142740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60dbf7c-962c-4791-8c54-6a4a0855e895-tls-certs\") pod \"model-serving-api-54d89bd5fc-cqj4w\" (UID: \"b60dbf7c-962c-4791-8c54-6a4a0855e895\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" Jul 08 17:25:57.142887 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:57.142773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97h4k\" (UniqueName: \"kubernetes.io/projected/b60dbf7c-962c-4791-8c54-6a4a0855e895-kube-api-access-97h4k\") pod \"model-serving-api-54d89bd5fc-cqj4w\" (UID: \"b60dbf7c-962c-4791-8c54-6a4a0855e895\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" Jul 08 17:25:57.145217 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:57.145192 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60dbf7c-962c-4791-8c54-6a4a0855e895-tls-certs\") pod \"model-serving-api-54d89bd5fc-cqj4w\" (UID: \"b60dbf7c-962c-4791-8c54-6a4a0855e895\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" Jul 08 17:25:57.151849 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:57.151826 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97h4k\" (UniqueName: \"kubernetes.io/projected/b60dbf7c-962c-4791-8c54-6a4a0855e895-kube-api-access-97h4k\") pod \"model-serving-api-54d89bd5fc-cqj4w\" (UID: \"b60dbf7c-962c-4791-8c54-6a4a0855e895\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" Jul 08 17:25:57.267450 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:57.267426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" Jul 08 17:25:57.391836 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:57.391803 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cqj4w"] Jul 08 17:25:57.394687 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:25:57.394661 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60dbf7c_962c_4791_8c54_6a4a0855e895.slice/crio-fd84739505b7598a582ea6e14f4900bd9d2c14053069787d0c1d422391746057 WatchSource:0}: Error finding container fd84739505b7598a582ea6e14f4900bd9d2c14053069787d0c1d422391746057: Status 404 returned error can't find the container with id fd84739505b7598a582ea6e14f4900bd9d2c14053069787d0c1d422391746057 Jul 08 17:25:58.088094 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:25:58.088055 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" event={"ID":"b60dbf7c-962c-4791-8c54-6a4a0855e895","Type":"ContainerStarted","Data":"fd84739505b7598a582ea6e14f4900bd9d2c14053069787d0c1d422391746057"} Jul 08 17:26:00.097189 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:00.097158 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" event={"ID":"b60dbf7c-962c-4791-8c54-6a4a0855e895","Type":"ContainerStarted","Data":"a3b364d03da047d23612a95063342e81bed230ce78c2890d1d614442e0124017"} Jul 08 17:26:00.097592 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:00.097326 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" Jul 08 17:26:00.113644 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:00.113600 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" podStartSLOduration=2.379767366 podStartE2EDuration="4.113586381s" totalImagesPullingTime="1.733819015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:00.112731024 +0000 UTC m=+398.055490350" watchObservedRunningTime="2026-07-08 17:26:00.113586381 +0000 UTC m=+398.056345695" Jul 08 17:26:06.224527 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.224492 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5"] Jul 08 17:26:06.227031 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.227012 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc"] Jul 08 17:26:06.227132 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.227114 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" Jul 08 17:26:06.229078 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.229059 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" Jul 08 17:26:06.230270 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.230249 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-268hp\"" Jul 08 17:26:06.230906 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.230888 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 08 17:26:06.231769 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.231751 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 08 17:26:06.231917 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.231901 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-29m6k\"" Jul 08 17:26:06.252207 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.252184 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5"] Jul 08 17:26:06.271408 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.271347 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc"] Jul 08 17:26:06.315383 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.315352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46b8620a-6387-445d-ae00-e75a039b89bd-cert\") pod \"kserve-controller-manager-d6f4b65b8-g8xx5\" (UID: \"46b8620a-6387-445d-ae00-e75a039b89bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" Jul 08 17:26:06.315494 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.315426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxkjq\" (UniqueName: \"kubernetes.io/projected/46b8620a-6387-445d-ae00-e75a039b89bd-kube-api-access-kxkjq\") pod \"kserve-controller-manager-d6f4b65b8-g8xx5\" (UID: \"46b8620a-6387-445d-ae00-e75a039b89bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" Jul 08 17:26:06.315494 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.315454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5hjv\" (UniqueName: \"kubernetes.io/projected/4b07d28d-e994-4ee4-a37b-8472c0336e9f-kube-api-access-b5hjv\") pod \"llmisvc-controller-manager-777c6bd7d5-jrpvc\" (UID: \"4b07d28d-e994-4ee4-a37b-8472c0336e9f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" Jul 08 17:26:06.315494 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.315482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b07d28d-e994-4ee4-a37b-8472c0336e9f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jrpvc\" (UID: \"4b07d28d-e994-4ee4-a37b-8472c0336e9f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" Jul 08 17:26:06.416611 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.416580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b07d28d-e994-4ee4-a37b-8472c0336e9f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jrpvc\" (UID: \"4b07d28d-e994-4ee4-a37b-8472c0336e9f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" Jul 08 17:26:06.416763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.416633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46b8620a-6387-445d-ae00-e75a039b89bd-cert\") pod \"kserve-controller-manager-d6f4b65b8-g8xx5\" (UID: \"46b8620a-6387-445d-ae00-e75a039b89bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" Jul 08 17:26:06.416763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.416692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxkjq\" (UniqueName: \"kubernetes.io/projected/46b8620a-6387-445d-ae00-e75a039b89bd-kube-api-access-kxkjq\") pod \"kserve-controller-manager-d6f4b65b8-g8xx5\" (UID: \"46b8620a-6387-445d-ae00-e75a039b89bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" Jul 08 17:26:06.416763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.416720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5hjv\" (UniqueName: \"kubernetes.io/projected/4b07d28d-e994-4ee4-a37b-8472c0336e9f-kube-api-access-b5hjv\") pod \"llmisvc-controller-manager-777c6bd7d5-jrpvc\" (UID: \"4b07d28d-e994-4ee4-a37b-8472c0336e9f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" Jul 08 17:26:06.419226 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.419199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b07d28d-e994-4ee4-a37b-8472c0336e9f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jrpvc\" (UID: \"4b07d28d-e994-4ee4-a37b-8472c0336e9f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" Jul 08 17:26:06.419327 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.419199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46b8620a-6387-445d-ae00-e75a039b89bd-cert\") pod \"kserve-controller-manager-d6f4b65b8-g8xx5\" (UID: \"46b8620a-6387-445d-ae00-e75a039b89bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" Jul 08 17:26:06.426540 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.426513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxkjq\" (UniqueName: \"kubernetes.io/projected/46b8620a-6387-445d-ae00-e75a039b89bd-kube-api-access-kxkjq\") pod \"kserve-controller-manager-d6f4b65b8-g8xx5\" (UID: \"46b8620a-6387-445d-ae00-e75a039b89bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" Jul 08 17:26:06.427303 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.427287 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5hjv\" (UniqueName: \"kubernetes.io/projected/4b07d28d-e994-4ee4-a37b-8472c0336e9f-kube-api-access-b5hjv\") pod \"llmisvc-controller-manager-777c6bd7d5-jrpvc\" (UID: \"4b07d28d-e994-4ee4-a37b-8472c0336e9f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" Jul 08 17:26:06.538490 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.538409 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" Jul 08 17:26:06.554289 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.554248 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" Jul 08 17:26:06.699268 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.699244 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5"] Jul 08 17:26:06.701444 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:26:06.701417 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b8620a_6387_445d_ae00_e75a039b89bd.slice/crio-5bbb530c43d4b0168bbcd42f0bb61e02b425908d68c80958484b1e2495f36b52 WatchSource:0}: Error finding container 5bbb530c43d4b0168bbcd42f0bb61e02b425908d68c80958484b1e2495f36b52: Status 404 returned error can't find the container with id 5bbb530c43d4b0168bbcd42f0bb61e02b425908d68c80958484b1e2495f36b52 Jul 08 17:26:06.701709 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.701692 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn"] Jul 08 17:26:06.704628 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.704610 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" Jul 08 17:26:06.707725 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.707704 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 17:26:06.707907 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.707867 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 17:26:06.708023 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.707926 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 17:26:06.708181 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.708164 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 17:26:06.717656 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.717631 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn"] Jul 08 17:26:06.725099 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.725068 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc"] Jul 08 17:26:06.728593 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:26:06.728556 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4b07d28d_e994_4ee4_a37b_8472c0336e9f.slice/crio-9ccb86e740d4491b7ff5416e988d1e829aa7a7b37fb858200d307ac4a607b84e WatchSource:0}: Error finding container 9ccb86e740d4491b7ff5416e988d1e829aa7a7b37fb858200d307ac4a607b84e: Status 404 returned error can't find the container with id 9ccb86e740d4491b7ff5416e988d1e829aa7a7b37fb858200d307ac4a607b84e Jul 08 17:26:06.819018 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.818931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8dvg\" (UniqueName: \"kubernetes.io/projected/32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c-kube-api-access-q8dvg\") pod \"kube-auth-proxy-7d76f9f859-7dxdn\" (UID: \"32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c\") " pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" Jul 08 17:26:06.819018 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.818984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c-tls-certs\") pod \"kube-auth-proxy-7d76f9f859-7dxdn\" (UID: \"32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c\") " pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" Jul 08 17:26:06.819018 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.819017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c-tmp\") pod \"kube-auth-proxy-7d76f9f859-7dxdn\" (UID: \"32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c\") " pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" Jul 08 17:26:06.919671 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.919636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c-tmp\") pod \"kube-auth-proxy-7d76f9f859-7dxdn\" (UID: \"32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c\") " pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" Jul 08 17:26:06.919947 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.919729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8dvg\" (UniqueName: \"kubernetes.io/projected/32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c-kube-api-access-q8dvg\") pod \"kube-auth-proxy-7d76f9f859-7dxdn\" (UID: \"32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c\") " pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" Jul 08 17:26:06.919947 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.919769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c-tls-certs\") pod \"kube-auth-proxy-7d76f9f859-7dxdn\" (UID: \"32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c\") " pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" Jul 08 17:26:06.921885 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.921862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c-tmp\") pod \"kube-auth-proxy-7d76f9f859-7dxdn\" (UID: \"32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c\") " pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" Jul 08 17:26:06.922163 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.922143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c-tls-certs\") pod \"kube-auth-proxy-7d76f9f859-7dxdn\" (UID: \"32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c\") " pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" Jul 08 17:26:06.935647 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:06.935625 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8dvg\" (UniqueName: \"kubernetes.io/projected/32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c-kube-api-access-q8dvg\") pod \"kube-auth-proxy-7d76f9f859-7dxdn\" (UID: \"32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c\") " pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" Jul 08 17:26:07.015707 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:07.015670 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" Jul 08 17:26:07.126237 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:07.126207 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" event={"ID":"46b8620a-6387-445d-ae00-e75a039b89bd","Type":"ContainerStarted","Data":"5bbb530c43d4b0168bbcd42f0bb61e02b425908d68c80958484b1e2495f36b52"} Jul 08 17:26:07.127496 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:07.127469 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" event={"ID":"4b07d28d-e994-4ee4-a37b-8472c0336e9f","Type":"ContainerStarted","Data":"9ccb86e740d4491b7ff5416e988d1e829aa7a7b37fb858200d307ac4a607b84e"} Jul 08 17:26:07.146359 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:07.146333 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn"] Jul 08 17:26:07.148961 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:26:07.148941 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ec0516_f2e9_4541_82ee_0e6ba6ec0b5c.slice/crio-a6b6643fbe43867b337f2cd297a095db0edbe53b2853941bf3a6d6cf65ffed8d WatchSource:0}: Error finding container a6b6643fbe43867b337f2cd297a095db0edbe53b2853941bf3a6d6cf65ffed8d: Status 404 returned error can't find the container with id a6b6643fbe43867b337f2cd297a095db0edbe53b2853941bf3a6d6cf65ffed8d Jul 08 17:26:08.133784 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.133740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" event={"ID":"32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c","Type":"ContainerStarted","Data":"a6b6643fbe43867b337f2cd297a095db0edbe53b2853941bf3a6d6cf65ffed8d"} Jul 08 17:26:08.778461 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.778100 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r"] Jul 08 17:26:08.780797 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.780772 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.787273 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.787250 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 17:26:08.787597 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.787576 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 17:26:08.787858 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.787839 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vjpmm\"" Jul 08 17:26:08.788101 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.788083 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 17:26:08.789551 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.789497 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 17:26:08.803135 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.801611 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r"] Jul 08 17:26:08.837850 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.837813 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.837993 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.837864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.837993 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.837948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.837993 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.837974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.838162 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.838003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c48982-568d-4e7e-8ec9-5a3a52263efc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.838162 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.838036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b8c48982-568d-4e7e-8ec9-5a3a52263efc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.838162 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.838089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn9x5\" (UniqueName: \"kubernetes.io/projected/b8c48982-568d-4e7e-8ec9-5a3a52263efc-kube-api-access-pn9x5\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.938822 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.938782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.939004 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.938876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.939004 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.938910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.939004 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.938945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c48982-568d-4e7e-8ec9-5a3a52263efc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.939004 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.938979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b8c48982-568d-4e7e-8ec9-5a3a52263efc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.939211 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.939013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn9x5\" (UniqueName: \"kubernetes.io/projected/b8c48982-568d-4e7e-8ec9-5a3a52263efc-kube-api-access-pn9x5\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.939211 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.939059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.940062 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.940017 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.941974 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.941953 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.942623 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.942403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b8c48982-568d-4e7e-8ec9-5a3a52263efc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.942623 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.942412 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.942623 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.942578 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c48982-568d-4e7e-8ec9-5a3a52263efc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.948804 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.948777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c48982-568d-4e7e-8ec9-5a3a52263efc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:08.949268 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:08.949250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn9x5\" (UniqueName: \"kubernetes.io/projected/b8c48982-568d-4e7e-8ec9-5a3a52263efc-kube-api-access-pn9x5\") pod \"istiod-openshift-gateway-94bb8fbfd-blz7r\" (UID: \"b8c48982-568d-4e7e-8ec9-5a3a52263efc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:09.094519 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:09.094427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:10.992725 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:10.992694 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r"] Jul 08 17:26:10.995638 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:26:10.995604 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c48982_568d_4e7e_8ec9_5a3a52263efc.slice/crio-3ca5921cdcdf9a10a4a6a7e1410ee37a37ef3475a95c4df3699332527e374115 WatchSource:0}: Error finding container 3ca5921cdcdf9a10a4a6a7e1410ee37a37ef3475a95c4df3699332527e374115: Status 404 returned error can't find the container with id 3ca5921cdcdf9a10a4a6a7e1410ee37a37ef3475a95c4df3699332527e374115 Jul 08 17:26:11.105965 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:11.105879 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cqj4w" Jul 08 17:26:11.152248 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:11.152215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" event={"ID":"46b8620a-6387-445d-ae00-e75a039b89bd","Type":"ContainerStarted","Data":"38df690b97de7af384c0e8471cd260b6cc2a17cf53ee5a98add731f00eecdbb9"} Jul 08 17:26:11.152460 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:11.152367 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" Jul 08 17:26:11.153997 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:11.153965 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" event={"ID":"32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c","Type":"ContainerStarted","Data":"de47ee66648e5d10a23e33a3271099863d8f3d9caac37ef020448635b16f12d9"} Jul 08 17:26:11.155820 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:11.155794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" event={"ID":"4b07d28d-e994-4ee4-a37b-8472c0336e9f","Type":"ContainerStarted","Data":"6f2c83234cac807ed9b168aa74b7d763823c2c8d58e78f65d590b3bb91388bfe"} Jul 08 17:26:11.155947 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:11.155846 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" Jul 08 17:26:11.157114 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:11.157092 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" event={"ID":"b8c48982-568d-4e7e-8ec9-5a3a52263efc","Type":"ContainerStarted","Data":"3ca5921cdcdf9a10a4a6a7e1410ee37a37ef3475a95c4df3699332527e374115"} Jul 08 17:26:11.169160 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:11.169117 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" podStartSLOduration=1.048193989 podStartE2EDuration="5.169105368s" totalImagesPullingTime="4.120911379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:11.16845 +0000 UTC m=+409.111209334" watchObservedRunningTime="2026-07-08 17:26:11.169105368 +0000 UTC m=+409.111864680" Jul 08 17:26:11.186242 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:11.186193 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" podStartSLOduration=1.092825749 podStartE2EDuration="5.186175932s" totalImagesPullingTime="4.093350183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:11.185707424 +0000 UTC m=+409.128466759" watchObservedRunningTime="2026-07-08 17:26:11.186175932 +0000 UTC m=+409.128935247" Jul 08 17:26:11.203400 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:11.203340 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d76f9f859-7dxdn" podStartSLOduration=1.520559892 podStartE2EDuration="5.20332806s" totalImagesPullingTime="3.682768168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:11.202086906 +0000 UTC m=+409.144846220" watchObservedRunningTime="2026-07-08 17:26:11.20332806 +0000 UTC m=+409.146087416" Jul 08 17:26:14.202836 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:14.202798 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 17:26:14.203112 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:14.202870 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 08 17:26:15.176072 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:15.176036 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" event={"ID":"b8c48982-568d-4e7e-8ec9-5a3a52263efc","Type":"ContainerStarted","Data":"4d9f9659be00f85b97d03d8059ade5e5a93d4d099e6b0d9648745adff7b8118e"} Jul 08 17:26:15.176268 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:15.176250 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:15.177918 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:15.177886 2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-blz7r container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 17:26:15.178039 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:15.177942 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" podUID="b8c48982-568d-4e7e-8ec9-5a3a52263efc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:26:15.200225 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:15.200173 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" podStartSLOduration=3.995248386 podStartE2EDuration="7.200159881s" totalImagesPullingTime="3.204911495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:15.198255549 +0000 UTC m=+413.141014863" watchObservedRunningTime="2026-07-08 17:26:15.200159881 +0000 UTC m=+413.142919194" Jul 08 17:26:16.181530 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:16.181504 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-blz7r" Jul 08 17:26:42.163206 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:42.163172 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jrpvc" Jul 08 17:26:42.166258 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:26:42.166239 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g8xx5" Jul 08 17:27:07.791279 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.791249 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b7fdd7f57-45w2m"] Jul 08 17:27:07.797710 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.797681 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.806415 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.806388 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7fdd7f57-45w2m"] Jul 08 17:27:07.893498 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.893463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-oauth-serving-cert\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.893498 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.893499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-trusted-ca-bundle\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.893698 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.893569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-console-config\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.893698 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.893648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-console-oauth-config\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.893698 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.893684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsv2p\" (UniqueName: \"kubernetes.io/projected/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-kube-api-access-nsv2p\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.893812 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.893705 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-console-serving-cert\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.893812 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.893724 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-service-ca\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.994753 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.994715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-oauth-serving-cert\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.994753 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.994757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-trusted-ca-bundle\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.994978 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.994803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-console-config\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.994978 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.994834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-console-oauth-config\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.994978 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.994850 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsv2p\" (UniqueName: \"kubernetes.io/projected/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-kube-api-access-nsv2p\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.994978 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.994867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-console-serving-cert\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.994978 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.994896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-service-ca\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.995675 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.995640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-oauth-serving-cert\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.995787 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.995764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-service-ca\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.995876 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.995853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-console-config\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.995912 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.995854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-trusted-ca-bundle\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.997306 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.997281 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-console-oauth-config\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:07.997531 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:07.997507 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-console-serving-cert\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:08.004969 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:08.004945 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsv2p\" (UniqueName: \"kubernetes.io/projected/b277c7b4-fa1a-4eba-8bac-fe19a2b26a48-kube-api-access-nsv2p\") pod \"console-7b7fdd7f57-45w2m\" (UID: \"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48\") " pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:08.107088 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:08.107015 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:08.240735 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:08.240713 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7fdd7f57-45w2m"] Jul 08 17:27:08.242835 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:27:08.242808 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb277c7b4_fa1a_4eba_8bac_fe19a2b26a48.slice/crio-99e777e09c615905608eceb4d913943c8c62d2261a64ffcfebbd183faa0d72b2 WatchSource:0}: Error finding container 99e777e09c615905608eceb4d913943c8c62d2261a64ffcfebbd183faa0d72b2: Status 404 returned error can't find the container with id 99e777e09c615905608eceb4d913943c8c62d2261a64ffcfebbd183faa0d72b2 Jul 08 17:27:08.392053 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:08.391957 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7fdd7f57-45w2m" event={"ID":"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48","Type":"ContainerStarted","Data":"328b0e866107cf6dc8f2079c604b1d2496b5ed4b5257842f017c9907298c4c25"} Jul 08 17:27:08.392053 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:08.392017 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7fdd7f57-45w2m" event={"ID":"b277c7b4-fa1a-4eba-8bac-fe19a2b26a48","Type":"ContainerStarted","Data":"99e777e09c615905608eceb4d913943c8c62d2261a64ffcfebbd183faa0d72b2"} Jul 08 17:27:08.411556 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:08.411508 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b7fdd7f57-45w2m" podStartSLOduration=1.411492039 podStartE2EDuration="1.411492039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:27:08.410082371 +0000 UTC m=+466.352841703" watchObservedRunningTime="2026-07-08 17:27:08.411492039 +0000 UTC m=+466.354251352" Jul 08 17:27:18.107128 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:18.107084 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:18.107682 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:18.107181 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:18.111750 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:18.111729 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:18.436560 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:18.436477 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b7fdd7f57-45w2m" Jul 08 17:27:18.483523 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:18.483490 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8d5b954d-d9rqm"] Jul 08 17:27:36.068013 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:36.067981 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm"] Jul 08 17:27:36.070224 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:36.070203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:27:36.073865 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:36.073842 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 17:27:36.074171 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:36.074156 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6prcr\"" Jul 08 17:27:36.075018 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:36.074999 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 17:27:36.088801 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:36.088779 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm"] Jul 08 17:27:36.230234 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:36.230193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47525\" (UniqueName: \"kubernetes.io/projected/3d3a92e1-8e5f-4731-8891-7425e74785eb-kube-api-access-47525\") pod \"limitador-operator-controller-manager-859d7b78bd-8bqjm\" (UID: \"3d3a92e1-8e5f-4731-8891-7425e74785eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:27:36.330953 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:36.330869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47525\" (UniqueName: \"kubernetes.io/projected/3d3a92e1-8e5f-4731-8891-7425e74785eb-kube-api-access-47525\") pod \"limitador-operator-controller-manager-859d7b78bd-8bqjm\" (UID: \"3d3a92e1-8e5f-4731-8891-7425e74785eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:27:36.340245 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:36.340213 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47525\" (UniqueName: \"kubernetes.io/projected/3d3a92e1-8e5f-4731-8891-7425e74785eb-kube-api-access-47525\") pod \"limitador-operator-controller-manager-859d7b78bd-8bqjm\" (UID: \"3d3a92e1-8e5f-4731-8891-7425e74785eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:27:36.380700 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:36.380669 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:27:36.510559 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:36.510406 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm"] Jul 08 17:27:36.513407 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:27:36.513357 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3a92e1_8e5f_4731_8891_7425e74785eb.slice/crio-a5a203fa1cc08802c7f5751df1a0f8c7ab7e996dea4b53a6cd6cd6cb7a359caf WatchSource:0}: Error finding container a5a203fa1cc08802c7f5751df1a0f8c7ab7e996dea4b53a6cd6cd6cb7a359caf: Status 404 returned error can't find the container with id a5a203fa1cc08802c7f5751df1a0f8c7ab7e996dea4b53a6cd6cd6cb7a359caf Jul 08 17:27:37.508502 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:37.508463 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" event={"ID":"3d3a92e1-8e5f-4731-8891-7425e74785eb","Type":"ContainerStarted","Data":"a5a203fa1cc08802c7f5751df1a0f8c7ab7e996dea4b53a6cd6cd6cb7a359caf"} Jul 08 17:27:39.517841 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:39.517795 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" event={"ID":"3d3a92e1-8e5f-4731-8891-7425e74785eb","Type":"ContainerStarted","Data":"03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b"} Jul 08 17:27:39.518226 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:39.517935 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:27:39.536474 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:39.536426 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" podStartSLOduration=1.090960874 podStartE2EDuration="3.536411385s" totalImagesPullingTime="2.445450511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:27:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:27:39.535579266 +0000 UTC m=+497.478338600" watchObservedRunningTime="2026-07-08 17:27:39.536411385 +0000 UTC m=+497.479170698" Jul 08 17:27:43.508840 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.508793 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f8d5b954d-d9rqm" podUID="f70e0fbd-7469-426b-bc02-fc4049cb2e93" containerName="console" containerID="cri-o://49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619" gracePeriod=15 Jul 08 17:27:43.754874 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.754851 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:27:43.896420 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.896313 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-config\") pod \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " Jul 08 17:27:43.896763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.896433 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-service-ca\") pod \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " Jul 08 17:27:43.896763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.896499 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cxkj\" (UniqueName: \"kubernetes.io/projected/f70e0fbd-7469-426b-bc02-fc4049cb2e93-kube-api-access-5cxkj\") pod \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " Jul 08 17:27:43.896763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.896526 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-oauth-config\") pod \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " Jul 08 17:27:43.896763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.896571 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-trusted-ca-bundle\") pod \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " Jul 08 17:27:43.896763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.896603 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-serving-cert\") pod \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " Jul 08 17:27:43.896763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.896639 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-oauth-serving-cert\") pod \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\" (UID: \"f70e0fbd-7469-426b-bc02-fc4049cb2e93\") " Jul 08 17:27:43.897098 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.896781 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-config" (OuterVolumeSpecName: "console-config") pod "f70e0fbd-7469-426b-bc02-fc4049cb2e93" (UID: "f70e0fbd-7469-426b-bc02-fc4049cb2e93"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:27:43.897098 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.896843 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-service-ca" (OuterVolumeSpecName: "service-ca") pod "f70e0fbd-7469-426b-bc02-fc4049cb2e93" (UID: "f70e0fbd-7469-426b-bc02-fc4049cb2e93"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:27:43.897098 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.896875 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-config\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:27:43.897276 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.897149 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f70e0fbd-7469-426b-bc02-fc4049cb2e93" (UID: "f70e0fbd-7469-426b-bc02-fc4049cb2e93"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:27:43.897331 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.897278 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f70e0fbd-7469-426b-bc02-fc4049cb2e93" (UID: "f70e0fbd-7469-426b-bc02-fc4049cb2e93"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:27:43.898835 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.898806 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f70e0fbd-7469-426b-bc02-fc4049cb2e93" (UID: "f70e0fbd-7469-426b-bc02-fc4049cb2e93"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:27:43.898953 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.898828 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f70e0fbd-7469-426b-bc02-fc4049cb2e93-kube-api-access-5cxkj" (OuterVolumeSpecName: "kube-api-access-5cxkj") pod "f70e0fbd-7469-426b-bc02-fc4049cb2e93" (UID: "f70e0fbd-7469-426b-bc02-fc4049cb2e93"). InnerVolumeSpecName "kube-api-access-5cxkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:27:43.899037 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.899015 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f70e0fbd-7469-426b-bc02-fc4049cb2e93" (UID: "f70e0fbd-7469-426b-bc02-fc4049cb2e93"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:27:43.997568 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.997534 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:27:43.997568 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.997566 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cxkj\" (UniqueName: \"kubernetes.io/projected/f70e0fbd-7469-426b-bc02-fc4049cb2e93-kube-api-access-5cxkj\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:27:43.997748 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.997581 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-oauth-config\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:27:43.997748 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.997592 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-trusted-ca-bundle\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:27:43.997748 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.997605 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f70e0fbd-7469-426b-bc02-fc4049cb2e93-console-serving-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:27:43.997748 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:43.997616 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f70e0fbd-7469-426b-bc02-fc4049cb2e93-oauth-serving-cert\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:27:44.539178 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:44.539145 2577 generic.go:356] "Generic (PLEG): container finished" podID="f70e0fbd-7469-426b-bc02-fc4049cb2e93" containerID="49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619" exitCode=0 Jul 08 17:27:44.539619 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:44.539186 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8d5b954d-d9rqm" Jul 08 17:27:44.539619 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:44.539195 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8d5b954d-d9rqm" event={"ID":"f70e0fbd-7469-426b-bc02-fc4049cb2e93","Type":"ContainerDied","Data":"49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619"} Jul 08 17:27:44.539619 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:44.539261 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8d5b954d-d9rqm" event={"ID":"f70e0fbd-7469-426b-bc02-fc4049cb2e93","Type":"ContainerDied","Data":"6e81d1e0b40689fd8e44e2cda88e29a0134a5582c287e053e8589082b05f8270"} Jul 08 17:27:44.539619 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:44.539281 2577 scope.go:117] "RemoveContainer" containerID="49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619" Jul 08 17:27:44.548422 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:44.548398 2577 scope.go:117] "RemoveContainer" containerID="49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619" Jul 08 17:27:44.548670 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:27:44.548653 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619\": container with ID starting with 49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619 not found: ID does not exist" containerID="49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619" Jul 08 17:27:44.548737 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:44.548683 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619"} err="failed to get container status \"49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619\": rpc error: code = NotFound desc = could not find container \"49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619\": container with ID starting with 49dabbd57b103b5c0daae87860ca6f120e90c9298c41a25cd865b4d2340a9619 not found: ID does not exist" Jul 08 17:27:44.573054 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:44.573029 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8d5b954d-d9rqm"] Jul 08 17:27:44.576510 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:44.576491 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f8d5b954d-d9rqm"] Jul 08 17:27:46.557420 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:46.557389 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f70e0fbd-7469-426b-bc02-fc4049cb2e93" path="/var/lib/kubelet/pods/f70e0fbd-7469-426b-bc02-fc4049cb2e93/volumes" Jul 08 17:27:50.523802 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:27:50.523773 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:28:02.088766 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.088732 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm"] Jul 08 17:28:02.089154 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.088965 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" podUID="3d3a92e1-8e5f-4731-8891-7425e74785eb" containerName="manager" containerID="cri-o://03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b" gracePeriod=2 Jul 08 17:28:02.103119 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.103093 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm"] Jul 08 17:28:02.113965 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:28:02.113926 2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3d3a92e1-8e5f-4731-8891-7425e74785eb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-8bqjm\": pods \"limitador-operator-controller-manager-859d7b78bd-8bqjm\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:28:02.116538 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.116514 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6"] Jul 08 17:28:02.116884 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.116869 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f70e0fbd-7469-426b-bc02-fc4049cb2e93" containerName="console" Jul 08 17:28:02.116931 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.116887 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f70e0fbd-7469-426b-bc02-fc4049cb2e93" containerName="console" Jul 08 17:28:02.116931 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.116898 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d3a92e1-8e5f-4731-8891-7425e74785eb" containerName="manager" Jul 08 17:28:02.116931 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.116904 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d3a92e1-8e5f-4731-8891-7425e74785eb" containerName="manager" Jul 08 17:28:02.117018 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.116951 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f70e0fbd-7469-426b-bc02-fc4049cb2e93" containerName="console" Jul 08 17:28:02.117018 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.116961 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d3a92e1-8e5f-4731-8891-7425e74785eb" containerName="manager" Jul 08 17:28:02.120095 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.120077 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6" Jul 08 17:28:02.135509 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.135484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9df6\" (UniqueName: \"kubernetes.io/projected/39506a10-c270-4675-b19c-a0201d677110-kube-api-access-k9df6\") pod \"limitador-operator-controller-manager-859d7b78bd-5ljv6\" (UID: \"39506a10-c270-4675-b19c-a0201d677110\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6" Jul 08 17:28:02.138438 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.138413 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6"] Jul 08 17:28:02.149055 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:28:02.149027 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8bqjm\" is forbidden: User \"system:node:ip-10-0-135-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-225.ec2.internal' and this object" podUID="3d3a92e1-8e5f-4731-8891-7425e74785eb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:28:02.236583 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.236546 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9df6\" (UniqueName: \"kubernetes.io/projected/39506a10-c270-4675-b19c-a0201d677110-kube-api-access-k9df6\") pod \"limitador-operator-controller-manager-859d7b78bd-5ljv6\" (UID: \"39506a10-c270-4675-b19c-a0201d677110\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6" Jul 08 17:28:02.249126 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.249103 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9df6\" (UniqueName: \"kubernetes.io/projected/39506a10-c270-4675-b19c-a0201d677110-kube-api-access-k9df6\") pod \"limitador-operator-controller-manager-859d7b78bd-5ljv6\" (UID: \"39506a10-c270-4675-b19c-a0201d677110\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6" Jul 08 17:28:02.323238 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.323216 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:28:02.325533 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:28:02.325508 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8bqjm\" is forbidden: User \"system:node:ip-10-0-135-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-225.ec2.internal' and this object" podUID="3d3a92e1-8e5f-4731-8891-7425e74785eb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:28:02.337914 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.337876 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47525\" (UniqueName: \"kubernetes.io/projected/3d3a92e1-8e5f-4731-8891-7425e74785eb-kube-api-access-47525\") pod \"3d3a92e1-8e5f-4731-8891-7425e74785eb\" (UID: \"3d3a92e1-8e5f-4731-8891-7425e74785eb\") " Jul 08 17:28:02.340028 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.339981 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d3a92e1-8e5f-4731-8891-7425e74785eb-kube-api-access-47525" (OuterVolumeSpecName: "kube-api-access-47525") pod "3d3a92e1-8e5f-4731-8891-7425e74785eb" (UID: "3d3a92e1-8e5f-4731-8891-7425e74785eb"). InnerVolumeSpecName "kube-api-access-47525". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:28:02.439428 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.439404 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47525\" (UniqueName: \"kubernetes.io/projected/3d3a92e1-8e5f-4731-8891-7425e74785eb-kube-api-access-47525\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:28:02.458353 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.458327 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6" Jul 08 17:28:02.557347 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:28:02.557240 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8bqjm\" is forbidden: User \"system:node:ip-10-0-135-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-225.ec2.internal' and this object" podUID="3d3a92e1-8e5f-4731-8891-7425e74785eb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:28:02.560271 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.560245 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d3a92e1-8e5f-4731-8891-7425e74785eb" path="/var/lib/kubelet/pods/3d3a92e1-8e5f-4731-8891-7425e74785eb/volumes" Jul 08 17:28:02.594972 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.594925 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6"] Jul 08 17:28:02.597444 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:28:02.597407 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39506a10_c270_4675_b19c_a0201d677110.slice/crio-1260033e4d599e5824de5e59567faa85fe175bb397883c9739ddc1da635872ec WatchSource:0}: Error finding container 1260033e4d599e5824de5e59567faa85fe175bb397883c9739ddc1da635872ec: Status 404 returned error can't find the container with id 1260033e4d599e5824de5e59567faa85fe175bb397883c9739ddc1da635872ec Jul 08 17:28:02.615553 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.615527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6" event={"ID":"39506a10-c270-4675-b19c-a0201d677110","Type":"ContainerStarted","Data":"1260033e4d599e5824de5e59567faa85fe175bb397883c9739ddc1da635872ec"} Jul 08 17:28:02.617105 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.617080 2577 generic.go:356] "Generic (PLEG): container finished" podID="3d3a92e1-8e5f-4731-8891-7425e74785eb" containerID="03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b" exitCode=0 Jul 08 17:28:02.617208 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.617136 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bqjm" Jul 08 17:28:02.617208 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.617165 2577 scope.go:117] "RemoveContainer" containerID="03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b" Jul 08 17:28:02.636552 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.636529 2577 scope.go:117] "RemoveContainer" containerID="03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b" Jul 08 17:28:02.636832 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:28:02.636814 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b\": container with ID starting with 03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b not found: ID does not exist" containerID="03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b" Jul 08 17:28:02.636889 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:02.636843 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b"} err="failed to get container status \"03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b\": rpc error: code = NotFound desc = could not find container \"03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b\": container with ID starting with 03719abfeac55a6f75e79ccc9ae1b7dea74fa98eaf85a08c9b16c2fa0daedf4b not found: ID does not exist" Jul 08 17:28:03.622623 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:03.622588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6" event={"ID":"39506a10-c270-4675-b19c-a0201d677110","Type":"ContainerStarted","Data":"d2429e95421c32ba535e821502b28817b4b0de8c405e12545e3b36c020c9d6fe"} Jul 08 17:28:03.623068 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:03.622655 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6" Jul 08 17:28:03.645623 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:03.645577 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6" podStartSLOduration=1.645562499 podStartE2EDuration="1.645562499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:03.644135948 +0000 UTC m=+521.586895273" watchObservedRunningTime="2026-07-08 17:28:03.645562499 +0000 UTC m=+521.588321812" Jul 08 17:28:14.630734 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:14.630653 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5ljv6" Jul 08 17:28:53.120639 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.120600 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:28:53.124009 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.123989 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" Jul 08 17:28:53.126554 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.126530 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 17:28:53.126674 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.126560 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lrmw5\"" Jul 08 17:28:53.132889 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.132870 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:28:53.153900 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.153874 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:28:53.252062 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.252029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2lcm\" (UniqueName: \"kubernetes.io/projected/e5719cc7-947f-4fe3-ab78-138e4cab7871-kube-api-access-v2lcm\") pod \"limitador-limitador-54d6d988d5-9t4c6\" (UID: \"e5719cc7-947f-4fe3-ab78-138e4cab7871\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" Jul 08 17:28:53.252224 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.252077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5719cc7-947f-4fe3-ab78-138e4cab7871-config-file\") pod \"limitador-limitador-54d6d988d5-9t4c6\" (UID: \"e5719cc7-947f-4fe3-ab78-138e4cab7871\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" Jul 08 17:28:53.353426 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.353363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2lcm\" (UniqueName: \"kubernetes.io/projected/e5719cc7-947f-4fe3-ab78-138e4cab7871-kube-api-access-v2lcm\") pod \"limitador-limitador-54d6d988d5-9t4c6\" (UID: \"e5719cc7-947f-4fe3-ab78-138e4cab7871\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" Jul 08 17:28:53.353585 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.353446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5719cc7-947f-4fe3-ab78-138e4cab7871-config-file\") pod \"limitador-limitador-54d6d988d5-9t4c6\" (UID: \"e5719cc7-947f-4fe3-ab78-138e4cab7871\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" Jul 08 17:28:53.357391 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.354590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5719cc7-947f-4fe3-ab78-138e4cab7871-config-file\") pod \"limitador-limitador-54d6d988d5-9t4c6\" (UID: \"e5719cc7-947f-4fe3-ab78-138e4cab7871\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" Jul 08 17:28:53.363055 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.363025 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2lcm\" (UniqueName: \"kubernetes.io/projected/e5719cc7-947f-4fe3-ab78-138e4cab7871-kube-api-access-v2lcm\") pod \"limitador-limitador-54d6d988d5-9t4c6\" (UID: \"e5719cc7-947f-4fe3-ab78-138e4cab7871\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" Jul 08 17:28:53.434865 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.434785 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" Jul 08 17:28:53.567036 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.566937 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:28:53.569775 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:28:53.569754 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5719cc7_947f_4fe3_ab78_138e4cab7871.slice/crio-4147300e29471fbf795554ea27118d58ddc092f7fefbf89d56a007cca7830275 WatchSource:0}: Error finding container 4147300e29471fbf795554ea27118d58ddc092f7fefbf89d56a007cca7830275: Status 404 returned error can't find the container with id 4147300e29471fbf795554ea27118d58ddc092f7fefbf89d56a007cca7830275 Jul 08 17:28:53.829338 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:53.829303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" event={"ID":"e5719cc7-947f-4fe3-ab78-138e4cab7871","Type":"ContainerStarted","Data":"4147300e29471fbf795554ea27118d58ddc092f7fefbf89d56a007cca7830275"} Jul 08 17:28:56.845128 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:56.845092 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" event={"ID":"e5719cc7-947f-4fe3-ab78-138e4cab7871","Type":"ContainerStarted","Data":"21f87896aac158fac18fe41ecb2f0487b9b32a90e7d4cf0d676a1b3e5f54bb58"} Jul 08 17:28:56.845537 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:56.845172 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" Jul 08 17:28:56.862137 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:28:56.862087 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" podStartSLOduration=1.274662365 podStartE2EDuration="3.862072551s" totalImagesPullingTime="2.587410186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:56.861401918 +0000 UTC m=+574.804161254" watchObservedRunningTime="2026-07-08 17:28:56.862072551 +0000 UTC m=+574.804831873" Jul 08 17:29:07.850918 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:29:07.850885 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9t4c6" Jul 08 17:30:09.959085 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:09.959052 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:30:33.287177 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:33.287137 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:30:40.487591 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:40.487554 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:30:55.098443 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:55.098406 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:30:58.275289 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.275256 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x"] Jul 08 17:30:58.278679 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.278659 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.281417 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.281400 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 17:30:58.283796 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.283766 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 17:30:58.283958 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.283936 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hkglw\"" Jul 08 17:30:58.284072 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.284023 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 08 17:30:58.288594 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.288572 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x"] Jul 08 17:30:58.370689 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.370659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b710d44c-b013-4d5c-a529-a6cffdaba4fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.370827 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.370702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ss9h\" (UniqueName: \"kubernetes.io/projected/b710d44c-b013-4d5c-a529-a6cffdaba4fd-kube-api-access-4ss9h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.370827 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.370726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.370827 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.370751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.370827 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.370769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.370827 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.370809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.471594 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.471564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.471746 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.471608 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b710d44c-b013-4d5c-a529-a6cffdaba4fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.471746 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.471722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ss9h\" (UniqueName: \"kubernetes.io/projected/b710d44c-b013-4d5c-a529-a6cffdaba4fd-kube-api-access-4ss9h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.471835 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.471761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.471835 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.471781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.471926 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.471907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.471982 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.471952 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.472051 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.472022 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.472254 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.472235 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.474215 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.474194 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b710d44c-b013-4d5c-a529-a6cffdaba4fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.474580 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.474552 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b710d44c-b013-4d5c-a529-a6cffdaba4fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.480016 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.479996 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ss9h\" (UniqueName: \"kubernetes.io/projected/b710d44c-b013-4d5c-a529-a6cffdaba4fd-kube-api-access-4ss9h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x\" (UID: \"b710d44c-b013-4d5c-a529-a6cffdaba4fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.589059 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.589000 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:30:58.718471 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.718448 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x"] Jul 08 17:30:58.720712 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:30:58.720688 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb710d44c_b013_4d5c_a529_a6cffdaba4fd.slice/crio-57f06514593527c427e10d7eb7899804d9bf2a0fa1d18f249a4b3b358eaeaee0 WatchSource:0}: Error finding container 57f06514593527c427e10d7eb7899804d9bf2a0fa1d18f249a4b3b358eaeaee0: Status 404 returned error can't find the container with id 57f06514593527c427e10d7eb7899804d9bf2a0fa1d18f249a4b3b358eaeaee0 Jul 08 17:30:58.722074 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:58.722053 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:30:59.345966 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:30:59.345924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" event={"ID":"b710d44c-b013-4d5c-a529-a6cffdaba4fd","Type":"ContainerStarted","Data":"57f06514593527c427e10d7eb7899804d9bf2a0fa1d18f249a4b3b358eaeaee0"} Jul 08 17:31:00.351804 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:31:00.351770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" event={"ID":"b710d44c-b013-4d5c-a529-a6cffdaba4fd","Type":"ContainerStarted","Data":"4f25e51c22b80a8fa6d8cd4b35d77c6118115e666d772a617b0229820495cc2e"} Jul 08 17:31:00.372095 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:31:00.372047 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" podStartSLOduration=1.323437172 podStartE2EDuration="2.372031159s" totalImagesPullingTime="1.048593987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:31:00.370249307 +0000 UTC m=+698.313008637" watchObservedRunningTime="2026-07-08 17:31:00.372031159 +0000 UTC m=+698.314790473" Jul 08 17:31:00.587007 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:31:00.586975 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:31:08.589926 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:31:08.589893 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:31:08.590538 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:31:08.589960 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:31:08.601986 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:31:08.601965 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:31:09.294297 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:31:09.294256 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:31:09.400271 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:31:09.400241 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x" Jul 08 17:31:28.792807 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:31:28.792720 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:33:18.360938 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:33:18.360901 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:33:29.534996 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:33:29.534964 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:33:41.122492 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:33:41.122456 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:33:49.439302 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:33:49.439261 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:34:00.239573 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:34:00.239542 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:34:27.396124 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:34:27.396093 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:34:40.100317 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:34:40.100285 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:35:14.691284 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:35:14.691250 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:35:24.191301 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:35:24.191263 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:35:32.509279 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:35:32.509245 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:35:44.291989 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:35:44.291953 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:35:54.299664 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:35:54.299622 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:36:05.625759 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:36:05.625725 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:36:16.298613 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:36:16.298577 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:36:26.501776 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:36:26.501742 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:36:48.495917 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:36:48.495882 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:36:58.995409 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:36:58.995361 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:37:23.186918 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:37:23.186839 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:37:34.600565 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:37:34.600530 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:37:51.395914 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:37:51.395877 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:38:01.390009 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:38:01.389977 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:38:11.394679 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:38:11.394637 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:38:20.789027 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:38:20.788993 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:38:30.114339 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:38:30.114304 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:40:16.605155 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:40:16.605109 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:40:27.609569 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:40:27.609532 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:40:36.424962 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:40:36.424928 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:40:47.220703 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:40:47.220667 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:40:56.790937 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:40:56.790901 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:41:09.391026 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:41:09.390992 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:41:17.596480 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:41:17.596444 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:41:28.392550 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:41:28.392514 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:41:39.802169 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:41:39.802135 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:41:48.688205 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:41:48.688165 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:41:59.486006 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:41:59.485973 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:42:23.796401 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:42:23.795293 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:42:30.994069 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:42:30.994031 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:42:41.196305 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:42:41.196269 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:42:50.393168 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:42:50.393132 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:43:00.494883 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:43:00.494845 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:43:12.893022 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:43:12.892937 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:43:23.700107 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:43:23.700075 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:43:33.491585 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:43:33.491553 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:43:44.089551 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:43:44.089512 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:43:53.695496 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:43:53.695460 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:44:04.302582 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:44:04.302546 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:44:16.188392 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:44:16.188334 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:44:30.888736 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:44:30.888705 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:44:40.583816 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:44:40.583778 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:44:47.784160 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:44:47.784131 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:44:58.700057 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:44:58.700024 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:45:00.145649 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.145615 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr"] Jul 08 17:45:00.148884 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.148867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" Jul 08 17:45:00.151745 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.151726 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4pmmr\"" Jul 08 17:45:00.151842 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.151755 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 17:45:00.152880 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.152862 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 17:45:00.166474 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.166454 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr"] Jul 08 17:45:00.179049 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.179027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbhrx\" (UniqueName: \"kubernetes.io/projected/2bcfdfcc-d460-4d08-9762-434a0f1d24dc-kube-api-access-hbhrx\") pod \"maas-api-key-cleanup-29725545-sllzr\" (UID: \"2bcfdfcc-d460-4d08-9762-434a0f1d24dc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" Jul 08 17:45:00.279628 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.279604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbhrx\" (UniqueName: \"kubernetes.io/projected/2bcfdfcc-d460-4d08-9762-434a0f1d24dc-kube-api-access-hbhrx\") pod \"maas-api-key-cleanup-29725545-sllzr\" (UID: \"2bcfdfcc-d460-4d08-9762-434a0f1d24dc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" Jul 08 17:45:00.289044 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.289024 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbhrx\" (UniqueName: \"kubernetes.io/projected/2bcfdfcc-d460-4d08-9762-434a0f1d24dc-kube-api-access-hbhrx\") pod \"maas-api-key-cleanup-29725545-sllzr\" (UID: \"2bcfdfcc-d460-4d08-9762-434a0f1d24dc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" Jul 08 17:45:00.459256 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.459235 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" Jul 08 17:45:00.592570 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.592546 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr"] Jul 08 17:45:00.594563 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:45:00.594525 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcfdfcc_d460_4d08_9762_434a0f1d24dc.slice/crio-edc18ae132c13562e5a03ac03c3e594efde8051952379725dba6c5f930a2af27 WatchSource:0}: Error finding container edc18ae132c13562e5a03ac03c3e594efde8051952379725dba6c5f930a2af27: Status 404 returned error can't find the container with id edc18ae132c13562e5a03ac03c3e594efde8051952379725dba6c5f930a2af27 Jul 08 17:45:00.596841 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.596827 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:45:00.834869 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:00.834787 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" event={"ID":"2bcfdfcc-d460-4d08-9762-434a0f1d24dc","Type":"ContainerStarted","Data":"edc18ae132c13562e5a03ac03c3e594efde8051952379725dba6c5f930a2af27"} Jul 08 17:45:04.854668 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:04.854634 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" event={"ID":"2bcfdfcc-d460-4d08-9762-434a0f1d24dc","Type":"ContainerStarted","Data":"73931b2407ae4e1b905786d396da0f2c3d15106a74ea7b6e385bed46f97971dc"} Jul 08 17:45:04.871139 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:04.871089 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" podStartSLOduration=1.434545577 podStartE2EDuration="4.871073578s" totalImagesPullingTime="3.436528001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:45:04.869627891 +0000 UTC m=+1542.812387226" watchObservedRunningTime="2026-07-08 17:45:04.871073578 +0000 UTC m=+1542.813832954" Jul 08 17:45:05.859852 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:05.859821 2577 generic.go:356] "Generic (PLEG): container finished" podID="2bcfdfcc-d460-4d08-9762-434a0f1d24dc" containerID="73931b2407ae4e1b905786d396da0f2c3d15106a74ea7b6e385bed46f97971dc" exitCode=0 Jul 08 17:45:05.859852 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:05.859855 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" event={"ID":"2bcfdfcc-d460-4d08-9762-434a0f1d24dc","Type":"ContainerDied","Data":"73931b2407ae4e1b905786d396da0f2c3d15106a74ea7b6e385bed46f97971dc"} Jul 08 17:45:06.987209 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:06.987186 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" Jul 08 17:45:07.029336 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:07.029311 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbhrx\" (UniqueName: \"kubernetes.io/projected/2bcfdfcc-d460-4d08-9762-434a0f1d24dc-kube-api-access-hbhrx\") pod \"2bcfdfcc-d460-4d08-9762-434a0f1d24dc\" (UID: \"2bcfdfcc-d460-4d08-9762-434a0f1d24dc\") " Jul 08 17:45:07.031509 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:07.031483 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bcfdfcc-d460-4d08-9762-434a0f1d24dc-kube-api-access-hbhrx" (OuterVolumeSpecName: "kube-api-access-hbhrx") pod "2bcfdfcc-d460-4d08-9762-434a0f1d24dc" (UID: "2bcfdfcc-d460-4d08-9762-434a0f1d24dc"). InnerVolumeSpecName "kube-api-access-hbhrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:45:07.130224 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:07.130167 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbhrx\" (UniqueName: \"kubernetes.io/projected/2bcfdfcc-d460-4d08-9762-434a0f1d24dc-kube-api-access-hbhrx\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:45:07.869303 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:07.869269 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" event={"ID":"2bcfdfcc-d460-4d08-9762-434a0f1d24dc","Type":"ContainerDied","Data":"edc18ae132c13562e5a03ac03c3e594efde8051952379725dba6c5f930a2af27"} Jul 08 17:45:07.869303 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:07.869288 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-sllzr" Jul 08 17:45:07.869519 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:07.869319 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edc18ae132c13562e5a03ac03c3e594efde8051952379725dba6c5f930a2af27" Jul 08 17:45:07.894234 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:07.894205 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:45:20.196327 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:20.196291 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:45:32.399422 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:32.399388 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:45:45.394321 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:45.394289 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:45:54.794217 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:45:54.794183 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:46:15.104247 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:15.104161 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:46:22.843294 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.843259 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn"] Jul 08 17:46:22.843768 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.843752 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcfdfcc-d460-4d08-9762-434a0f1d24dc" containerName="cleanup" Jul 08 17:46:22.843929 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.843771 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcfdfcc-d460-4d08-9762-434a0f1d24dc" containerName="cleanup" Jul 08 17:46:22.843929 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.843883 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bcfdfcc-d460-4d08-9762-434a0f1d24dc" containerName="cleanup" Jul 08 17:46:22.847249 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.847227 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:22.851598 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.851571 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-786970cd-serving-cert\"" Jul 08 17:46:22.851788 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.851763 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 17:46:22.852938 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.852920 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4pmmr\"" Jul 08 17:46:22.853026 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.852982 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 17:46:22.862685 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.862659 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn"] Jul 08 17:46:22.904763 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.904741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27287cff-8c6d-45b2-a77e-c3d7c326707d-openshift-service-ca\") pod \"maas-api-e2e-ait-786970cd-5595fb6675-qvrbn\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:22.904890 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.904775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27287cff-8c6d-45b2-a77e-c3d7c326707d-maas-api-tls\") pod \"maas-api-e2e-ait-786970cd-5595fb6675-qvrbn\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:22.904890 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:22.904805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqrcd\" (UniqueName: \"kubernetes.io/projected/27287cff-8c6d-45b2-a77e-c3d7c326707d-kube-api-access-dqrcd\") pod \"maas-api-e2e-ait-786970cd-5595fb6675-qvrbn\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:23.006005 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:23.005978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27287cff-8c6d-45b2-a77e-c3d7c326707d-openshift-service-ca\") pod \"maas-api-e2e-ait-786970cd-5595fb6675-qvrbn\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:23.006159 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:23.006015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27287cff-8c6d-45b2-a77e-c3d7c326707d-maas-api-tls\") pod \"maas-api-e2e-ait-786970cd-5595fb6675-qvrbn\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:23.006159 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:23.006047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqrcd\" (UniqueName: \"kubernetes.io/projected/27287cff-8c6d-45b2-a77e-c3d7c326707d-kube-api-access-dqrcd\") pod \"maas-api-e2e-ait-786970cd-5595fb6675-qvrbn\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:23.006733 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:23.006707 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27287cff-8c6d-45b2-a77e-c3d7c326707d-openshift-service-ca\") pod \"maas-api-e2e-ait-786970cd-5595fb6675-qvrbn\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:23.008529 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:23.008513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27287cff-8c6d-45b2-a77e-c3d7c326707d-maas-api-tls\") pod \"maas-api-e2e-ait-786970cd-5595fb6675-qvrbn\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:23.016608 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:23.016582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqrcd\" (UniqueName: \"kubernetes.io/projected/27287cff-8c6d-45b2-a77e-c3d7c326707d-kube-api-access-dqrcd\") pod \"maas-api-e2e-ait-786970cd-5595fb6675-qvrbn\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:23.158298 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:23.158238 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:23.301057 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:23.301033 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn"] Jul 08 17:46:23.302539 ip-10-0-135-225 kubenswrapper[2577]: W0708 17:46:23.302512 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27287cff_8c6d_45b2_a77e_c3d7c326707d.slice/crio-45effb25a8edb8f578f59862995f068fbd814d8a443664e65b212fa2545f9577 WatchSource:0}: Error finding container 45effb25a8edb8f578f59862995f068fbd814d8a443664e65b212fa2545f9577: Status 404 returned error can't find the container with id 45effb25a8edb8f578f59862995f068fbd814d8a443664e65b212fa2545f9577 Jul 08 17:46:24.212215 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:24.212180 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" event={"ID":"27287cff-8c6d-45b2-a77e-c3d7c326707d","Type":"ContainerStarted","Data":"45effb25a8edb8f578f59862995f068fbd814d8a443664e65b212fa2545f9577"} Jul 08 17:46:25.801537 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:25.801514 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:46:26.223449 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:26.223421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" event={"ID":"27287cff-8c6d-45b2-a77e-c3d7c326707d","Type":"ContainerStarted","Data":"c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0"} Jul 08 17:46:26.223617 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:26.223497 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:46:26.242816 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:26.242775 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" podStartSLOduration=1.8004786510000002 podStartE2EDuration="4.242761585s" totalImagesPullingTime="2.442282934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:26.240814003 +0000 UTC m=+1624.183573316" watchObservedRunningTime="2026-07-08 17:46:26.242761585 +0000 UTC m=+1624.185520898" Jul 08 17:46:32.233095 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:46:32.233060 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:47:30.491223 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:30.491184 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:47:33.557737 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.557704 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn"] Jul 08 17:47:33.558176 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.557912 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" podUID="27287cff-8c6d-45b2-a77e-c3d7c326707d" containerName="maas-api" containerID="cri-o://c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0" gracePeriod=30 Jul 08 17:47:33.801897 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.801874 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:47:33.895692 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.895609 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqrcd\" (UniqueName: \"kubernetes.io/projected/27287cff-8c6d-45b2-a77e-c3d7c326707d-kube-api-access-dqrcd\") pod \"27287cff-8c6d-45b2-a77e-c3d7c326707d\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " Jul 08 17:47:33.895692 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.895670 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27287cff-8c6d-45b2-a77e-c3d7c326707d-openshift-service-ca\") pod \"27287cff-8c6d-45b2-a77e-c3d7c326707d\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " Jul 08 17:47:33.895692 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.895688 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27287cff-8c6d-45b2-a77e-c3d7c326707d-maas-api-tls\") pod \"27287cff-8c6d-45b2-a77e-c3d7c326707d\" (UID: \"27287cff-8c6d-45b2-a77e-c3d7c326707d\") " Jul 08 17:47:33.896099 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.896070 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27287cff-8c6d-45b2-a77e-c3d7c326707d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "27287cff-8c6d-45b2-a77e-c3d7c326707d" (UID: "27287cff-8c6d-45b2-a77e-c3d7c326707d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:47:33.897932 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.897903 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27287cff-8c6d-45b2-a77e-c3d7c326707d-kube-api-access-dqrcd" (OuterVolumeSpecName: "kube-api-access-dqrcd") pod "27287cff-8c6d-45b2-a77e-c3d7c326707d" (UID: "27287cff-8c6d-45b2-a77e-c3d7c326707d"). InnerVolumeSpecName "kube-api-access-dqrcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:47:33.898043 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.898014 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27287cff-8c6d-45b2-a77e-c3d7c326707d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "27287cff-8c6d-45b2-a77e-c3d7c326707d" (UID: "27287cff-8c6d-45b2-a77e-c3d7c326707d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:47:33.996559 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.996524 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqrcd\" (UniqueName: \"kubernetes.io/projected/27287cff-8c6d-45b2-a77e-c3d7c326707d-kube-api-access-dqrcd\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:47:33.996559 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.996554 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27287cff-8c6d-45b2-a77e-c3d7c326707d-openshift-service-ca\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:47:33.996559 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:33.996564 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27287cff-8c6d-45b2-a77e-c3d7c326707d-maas-api-tls\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 17:47:34.516187 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:34.516145 2577 generic.go:356] "Generic (PLEG): container finished" podID="27287cff-8c6d-45b2-a77e-c3d7c326707d" containerID="c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0" exitCode=0 Jul 08 17:47:34.516332 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:34.516203 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" Jul 08 17:47:34.516332 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:34.516215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" event={"ID":"27287cff-8c6d-45b2-a77e-c3d7c326707d","Type":"ContainerDied","Data":"c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0"} Jul 08 17:47:34.516332 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:34.516272 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn" event={"ID":"27287cff-8c6d-45b2-a77e-c3d7c326707d","Type":"ContainerDied","Data":"45effb25a8edb8f578f59862995f068fbd814d8a443664e65b212fa2545f9577"} Jul 08 17:47:34.516332 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:34.516300 2577 scope.go:117] "RemoveContainer" containerID="c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0" Jul 08 17:47:34.526506 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:34.526487 2577 scope.go:117] "RemoveContainer" containerID="c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0" Jul 08 17:47:34.526776 ip-10-0-135-225 kubenswrapper[2577]: E0708 17:47:34.526754 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0\": container with ID starting with c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0 not found: ID does not exist" containerID="c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0" Jul 08 17:47:34.526861 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:34.526788 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0"} err="failed to get container status \"c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0\": rpc error: code = NotFound desc = could not find container \"c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0\": container with ID starting with c1cafcdd9b639b3212f608f5bd9f9de2e7070fd8d327de65c5b00b09d6616ed0 not found: ID does not exist" Jul 08 17:47:34.538027 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:34.538002 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn"] Jul 08 17:47:34.543571 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:34.543547 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-786970cd-5595fb6675-qvrbn"] Jul 08 17:47:34.558108 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:47:34.558083 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27287cff-8c6d-45b2-a77e-c3d7c326707d" path="/var/lib/kubelet/pods/27287cff-8c6d-45b2-a77e-c3d7c326707d/volumes" Jul 08 17:54:13.393530 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:54:13.393498 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 17:54:22.486750 ip-10-0-135-225 kubenswrapper[2577]: I0708 17:54:22.486714 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 18:00:00.176984 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.176949 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk"] Jul 08 18:00:00.177469 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.177259 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27287cff-8c6d-45b2-a77e-c3d7c326707d" containerName="maas-api" Jul 08 18:00:00.177469 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.177270 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27287cff-8c6d-45b2-a77e-c3d7c326707d" containerName="maas-api" Jul 08 18:00:00.177469 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.177326 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27287cff-8c6d-45b2-a77e-c3d7c326707d" containerName="maas-api" Jul 08 18:00:00.180094 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.180076 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk" Jul 08 18:00:00.185016 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.184992 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 18:00:00.185129 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.185044 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4pmmr\"" Jul 08 18:00:00.186036 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.186015 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 18:00:00.205388 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.205348 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk"] Jul 08 18:00:00.238620 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.238595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zhc9\" (UniqueName: \"kubernetes.io/projected/2064a2fc-a732-4591-9990-3f277f8aabdc-kube-api-access-7zhc9\") pod \"maas-api-key-cleanup-29725560-kxdkk\" (UID: \"2064a2fc-a732-4591-9990-3f277f8aabdc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk" Jul 08 18:00:00.339836 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.339806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zhc9\" (UniqueName: \"kubernetes.io/projected/2064a2fc-a732-4591-9990-3f277f8aabdc-kube-api-access-7zhc9\") pod \"maas-api-key-cleanup-29725560-kxdkk\" (UID: \"2064a2fc-a732-4591-9990-3f277f8aabdc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk" Jul 08 18:00:00.350633 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.350605 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zhc9\" (UniqueName: \"kubernetes.io/projected/2064a2fc-a732-4591-9990-3f277f8aabdc-kube-api-access-7zhc9\") pod \"maas-api-key-cleanup-29725560-kxdkk\" (UID: \"2064a2fc-a732-4591-9990-3f277f8aabdc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk" Jul 08 18:00:00.489746 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.489716 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk" Jul 08 18:00:00.621306 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.621280 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk"] Jul 08 18:00:00.623701 ip-10-0-135-225 kubenswrapper[2577]: W0708 18:00:00.623672 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2064a2fc_a732_4591_9990_3f277f8aabdc.slice/crio-1d840bd695aba48d92fe9ea2fcb24d4fbd301b176e13af0641facb053e597ff9 WatchSource:0}: Error finding container 1d840bd695aba48d92fe9ea2fcb24d4fbd301b176e13af0641facb053e597ff9: Status 404 returned error can't find the container with id 1d840bd695aba48d92fe9ea2fcb24d4fbd301b176e13af0641facb053e597ff9 Jul 08 18:00:00.683061 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:00.683028 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk" event={"ID":"2064a2fc-a732-4591-9990-3f277f8aabdc","Type":"ContainerStarted","Data":"1d840bd695aba48d92fe9ea2fcb24d4fbd301b176e13af0641facb053e597ff9"} Jul 08 18:00:01.689586 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:01.689554 2577 generic.go:356] "Generic (PLEG): container finished" podID="2064a2fc-a732-4591-9990-3f277f8aabdc" containerID="3b225fc29659c54915a594bff043ff8ede7d6a17624751e338ef0d9fbd8b4d45" exitCode=0 Jul 08 18:00:01.689940 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:01.689611 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk" event={"ID":"2064a2fc-a732-4591-9990-3f277f8aabdc","Type":"ContainerDied","Data":"3b225fc29659c54915a594bff043ff8ede7d6a17624751e338ef0d9fbd8b4d45"} Jul 08 18:00:02.824333 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:02.824307 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk" Jul 08 18:00:02.861742 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:02.861709 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zhc9\" (UniqueName: \"kubernetes.io/projected/2064a2fc-a732-4591-9990-3f277f8aabdc-kube-api-access-7zhc9\") pod \"2064a2fc-a732-4591-9990-3f277f8aabdc\" (UID: \"2064a2fc-a732-4591-9990-3f277f8aabdc\") " Jul 08 18:00:02.864090 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:02.864057 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2064a2fc-a732-4591-9990-3f277f8aabdc-kube-api-access-7zhc9" (OuterVolumeSpecName: "kube-api-access-7zhc9") pod "2064a2fc-a732-4591-9990-3f277f8aabdc" (UID: "2064a2fc-a732-4591-9990-3f277f8aabdc"). InnerVolumeSpecName "kube-api-access-7zhc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:00:02.963094 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:02.963072 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zhc9\" (UniqueName: \"kubernetes.io/projected/2064a2fc-a732-4591-9990-3f277f8aabdc-kube-api-access-7zhc9\") on node \"ip-10-0-135-225.ec2.internal\" DevicePath \"\"" Jul 08 18:00:03.698350 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:03.698320 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk" Jul 08 18:00:03.698544 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:03.698354 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-kxdkk" event={"ID":"2064a2fc-a732-4591-9990-3f277f8aabdc","Type":"ContainerDied","Data":"1d840bd695aba48d92fe9ea2fcb24d4fbd301b176e13af0641facb053e597ff9"} Jul 08 18:00:03.698544 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:00:03.698425 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d840bd695aba48d92fe9ea2fcb24d4fbd301b176e13af0641facb053e597ff9" Jul 08 18:01:03.428345 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:01:03.428305 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 18:01:18.138407 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:01:18.138303 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9t4c6"] Jul 08 18:05:08.901278 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:08.901246 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g8xx5_46b8620a-6387-445d-ae00-e75a039b89bd/manager/0.log" Jul 08 18:05:09.016214 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:09.016185 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jrpvc_4b07d28d-e994-4ee4-a37b-8472c0336e9f/manager/0.log" Jul 08 18:05:09.288137 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:09.288108 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cqj4w_b60dbf7c-962c-4791-8c54-6a4a0855e895/server/0.log" Jul 08 18:05:09.530320 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:09.530289 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-574956cb5f-6zl8d_bb5833f6-b976-46d0-987a-7d036d3766b5/copy-manifests/0.log" Jul 08 18:05:09.537562 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:09.537531 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-574956cb5f-6zl8d_bb5833f6-b976-46d0-987a-7d036d3766b5/manager/0.log" Jul 08 18:05:11.999130 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:11.999092 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9t4c6_e5719cc7-947f-4fe3-ab78-138e4cab7871/limitador/0.log" Jul 08 18:05:12.124882 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:12.124847 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5ljv6_39506a10-c270-4675-b19c-a0201d677110/manager/0.log" Jul 08 18:05:12.603718 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:12.603681 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-blz7r_b8c48982-568d-4e7e-8ec9-5a3a52263efc/discovery/0.log" Jul 08 18:05:12.745809 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:12.745778 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d76f9f859-7dxdn_32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c/kube-auth-proxy/0.log" Jul 08 18:05:14.116411 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:14.116355 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtps4x_b710d44c-b013-4d5c-a529-a6cffdaba4fd/main/0.log" Jul 08 18:05:21.937699 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:21.937670 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g5x8g_4b3df453-5011-4e82-8b55-e20ea1915796/global-pull-secret-syncer/0.log" Jul 08 18:05:22.103891 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:22.103861 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qggbz_3bb8c29e-576c-41f9-ab48-231b2f9b39b9/konnectivity-agent/0.log" Jul 08 18:05:22.162715 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:22.162676 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-225.ec2.internal_21c6eb4a75675630f6b8228d54bfaa3a/haproxy/0.log" Jul 08 18:05:26.978896 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:26.978870 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9t4c6_e5719cc7-947f-4fe3-ab78-138e4cab7871/limitador/0.log" Jul 08 18:05:27.041738 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:27.041701 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5ljv6_39506a10-c270-4675-b19c-a0201d677110/manager/0.log" Jul 08 18:05:29.661508 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:29.661478 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gkj4_bb26c879-3d75-4ab5-8410-409a51c1e5aa/node-exporter/0.log" Jul 08 18:05:29.725808 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:29.725772 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gkj4_bb26c879-3d75-4ab5-8410-409a51c1e5aa/kube-rbac-proxy/0.log" Jul 08 18:05:29.810528 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:29.810495 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gkj4_bb26c879-3d75-4ab5-8410-409a51c1e5aa/init-textfile/0.log" Jul 08 18:05:31.140284 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:31.140252 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b88fd8dc-4zlbx_36563e7c-f9b0-4a7a-9ed2-cc013b3484f8/thanos-query/0.log" Jul 08 18:05:31.208344 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:31.208308 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b88fd8dc-4zlbx_36563e7c-f9b0-4a7a-9ed2-cc013b3484f8/kube-rbac-proxy-web/0.log" Jul 08 18:05:31.287721 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:31.287696 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b88fd8dc-4zlbx_36563e7c-f9b0-4a7a-9ed2-cc013b3484f8/kube-rbac-proxy/0.log" Jul 08 18:05:31.358819 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:31.358792 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b88fd8dc-4zlbx_36563e7c-f9b0-4a7a-9ed2-cc013b3484f8/prom-label-proxy/0.log" Jul 08 18:05:31.404651 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:31.404571 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b88fd8dc-4zlbx_36563e7c-f9b0-4a7a-9ed2-cc013b3484f8/kube-rbac-proxy-rules/0.log" Jul 08 18:05:31.447358 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:31.447333 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b88fd8dc-4zlbx_36563e7c-f9b0-4a7a-9ed2-cc013b3484f8/kube-rbac-proxy-metrics/0.log" Jul 08 18:05:32.679241 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.679204 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd"] Jul 08 18:05:32.679656 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.679541 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2064a2fc-a732-4591-9990-3f277f8aabdc" containerName="cleanup" Jul 08 18:05:32.679656 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.679553 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2064a2fc-a732-4591-9990-3f277f8aabdc" containerName="cleanup" Jul 08 18:05:32.679656 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.679636 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2064a2fc-a732-4591-9990-3f277f8aabdc" containerName="cleanup" Jul 08 18:05:32.682599 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.682579 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.689107 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.689034 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7l84t\"/\"kube-root-ca.crt\"" Jul 08 18:05:32.689205 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.689035 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7l84t\"/\"openshift-service-ca.crt\"" Jul 08 18:05:32.689205 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.689034 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7l84t\"/\"default-dockercfg-7p7mm\"" Jul 08 18:05:32.702186 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.702151 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd"] Jul 08 18:05:32.715230 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.715193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-proc\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.715230 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.715236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbd9b\" (UniqueName: \"kubernetes.io/projected/0534d760-1363-412f-a5c6-412d18d98b16-kube-api-access-sbd9b\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.715510 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.715265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-lib-modules\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.715510 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.715349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-sys\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.715510 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.715391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-podres\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.815966 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.815932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-proc\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.816132 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.815976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbd9b\" (UniqueName: \"kubernetes.io/projected/0534d760-1363-412f-a5c6-412d18d98b16-kube-api-access-sbd9b\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.816132 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.816054 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-proc\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.816132 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.816099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-lib-modules\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.816250 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.816173 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-sys\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.816250 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.816206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-podres\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.816333 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.816259 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-lib-modules\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.816333 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.816275 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-sys\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.816423 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.816357 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0534d760-1363-412f-a5c6-412d18d98b16-podres\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.829825 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.829801 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbd9b\" (UniqueName: \"kubernetes.io/projected/0534d760-1363-412f-a5c6-412d18d98b16-kube-api-access-sbd9b\") pod \"perf-node-gather-daemonset-szdbd\" (UID: \"0534d760-1363-412f-a5c6-412d18d98b16\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:32.992417 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:32.992363 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:33.130229 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:33.130203 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd"] Jul 08 18:05:33.132502 ip-10-0-135-225 kubenswrapper[2577]: W0708 18:05:33.132472 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0534d760_1363_412f_a5c6_412d18d98b16.slice/crio-157f46d0a20e5cbdfd2cc8b1a45a053dc4adbd1be54f5885363a3ada6ccb9ef7 WatchSource:0}: Error finding container 157f46d0a20e5cbdfd2cc8b1a45a053dc4adbd1be54f5885363a3ada6ccb9ef7: Status 404 returned error can't find the container with id 157f46d0a20e5cbdfd2cc8b1a45a053dc4adbd1be54f5885363a3ada6ccb9ef7 Jul 08 18:05:34.005864 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:34.005834 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b7fdd7f57-45w2m_b277c7b4-fa1a-4eba-8bac-fe19a2b26a48/console/0.log" Jul 08 18:05:34.050650 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:34.050616 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-fkvnw_34962b6e-f3ad-45ac-b721-a5a2cfdd88ea/download-server/0.log" Jul 08 18:05:34.118898 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:34.118861 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" event={"ID":"0534d760-1363-412f-a5c6-412d18d98b16","Type":"ContainerStarted","Data":"73d9871a645cffcd8b05333208d3904b4c66ad04166d0f0c63e774957f794423"} Jul 08 18:05:34.119097 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:34.118913 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" event={"ID":"0534d760-1363-412f-a5c6-412d18d98b16","Type":"ContainerStarted","Data":"157f46d0a20e5cbdfd2cc8b1a45a053dc4adbd1be54f5885363a3ada6ccb9ef7"} Jul 08 18:05:34.119097 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:34.118986 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:34.143102 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:34.143045 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" podStartSLOduration=2.143029427 podStartE2EDuration="2.143029427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:34.141566596 +0000 UTC m=+2772.084325905" watchObservedRunningTime="2026-07-08 18:05:34.143029427 +0000 UTC m=+2772.085788741" Jul 08 18:05:35.946947 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:35.946908 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7gddm_a29ff15d-4d58-4aea-a88c-531bdce143ec/dns/0.log" Jul 08 18:05:35.984235 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:35.984208 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7gddm_a29ff15d-4d58-4aea-a88c-531bdce143ec/kube-rbac-proxy/0.log" Jul 08 18:05:36.137536 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:36.137508 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mlbvh_1add5133-1160-4faa-9d29-bfbca1e93373/dns-node-resolver/0.log" Jul 08 18:05:36.716240 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:36.716210 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f5d577cd6-lk7dm_679dd075-6526-4232-ac7d-59fade13ca34/registry/0.log" Jul 08 18:05:36.776337 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:36.776306 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q6j5f_597b3e12-58cb-48f4-af62-539544a7652b/node-ca/0.log" Jul 08 18:05:37.934899 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:37.934867 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-blz7r_b8c48982-568d-4e7e-8ec9-5a3a52263efc/discovery/0.log" Jul 08 18:05:37.962705 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:37.962675 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d76f9f859-7dxdn_32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c/kube-auth-proxy/0.log" Jul 08 18:05:39.004587 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:39.004557 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-86rfq_d0357f42-46e8-4913-bf62-fa0c2751c149/serve-healthcheck-canary/0.log" Jul 08 18:05:39.873860 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:39.873829 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-95krr_dfbc3244-80c2-4dac-928a-6813168e1075/kube-rbac-proxy/0.log" Jul 08 18:05:39.908319 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:39.908289 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-95krr_dfbc3244-80c2-4dac-928a-6813168e1075/exporter/0.log" Jul 08 18:05:40.017054 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:40.017023 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-95krr_dfbc3244-80c2-4dac-928a-6813168e1075/extractor/0.log" Jul 08 18:05:40.134267 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:40.134197 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-szdbd" Jul 08 18:05:42.356328 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:42.356245 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-blz7r_b8c48982-568d-4e7e-8ec9-5a3a52263efc/discovery/0.log" Jul 08 18:05:42.370559 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:42.370536 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d76f9f859-7dxdn_32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c/kube-auth-proxy/0.log" Jul 08 18:05:42.516872 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:42.516845 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g8xx5_46b8620a-6387-445d-ae00-e75a039b89bd/manager/0.log" Jul 08 18:05:42.621659 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:42.621580 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jrpvc_4b07d28d-e994-4ee4-a37b-8472c0336e9f/manager/0.log" Jul 08 18:05:42.783034 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:42.783002 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cqj4w_b60dbf7c-962c-4791-8c54-6a4a0855e895/server/0.log" Jul 08 18:05:42.953781 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:42.953704 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-574956cb5f-6zl8d_bb5833f6-b976-46d0-987a-7d036d3766b5/manager/0.log" Jul 08 18:05:42.990644 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:42.990617 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-574956cb5f-6zl8d_bb5833f6-b976-46d0-987a-7d036d3766b5/copy-manifests/0.log" Jul 08 18:05:44.126965 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:44.126933 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-blz7r_b8c48982-568d-4e7e-8ec9-5a3a52263efc/discovery/0.log" Jul 08 18:05:44.143611 ip-10-0-135-225 kubenswrapper[2577]: I0708 18:05:44.143587 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d76f9f859-7dxdn_32ec0516-f2e9-4541-82ee-0e6ba6ec0b5c/kube-auth-proxy/0.log"