Jul 09 11:09:32.018730 ip-10-0-131-226 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 11:09:32.018744 ip-10-0-131-226 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 11:09:32.018752 ip-10-0-131-226 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 11:09:32.019083 ip-10-0-131-226 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 11:09:42.035276 ip-10-0-131-226 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 11:09:42.035297 ip-10-0-131-226 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e8cb7e919cb440078470a38a5f201cd3 -- Jul 09 11:11:33.955706 ip-10-0-131-226 systemd[1]: Starting Kubernetes Kubelet... Jul 09 11:11:34.395745 ip-10-0-131-226 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 11:11:34.395745 ip-10-0-131-226 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 11:11:34.395745 ip-10-0-131-226 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 11:11:34.395745 ip-10-0-131-226 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 11:11:34.395745 ip-10-0-131-226 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 11:11:34.397732 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.397617 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 11:11:34.404324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404305 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 11:11:34.404324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404323 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 11:11:34.404324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404327 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404330 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404334 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404337 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404341 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404344 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404346 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404349 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404351 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404354 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404357 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404359 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404362 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404364 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404367 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404370 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404372 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404390 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404393 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404397 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 11:11:34.404421 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404401 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404404 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404408 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404410 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404413 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404416 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404419 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404421 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404424 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404428 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404431 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404434 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404437 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404440 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404442 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404445 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404447 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404450 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404452 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404455 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 11:11:34.404927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404457 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404460 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404464 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404467 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404470 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404474 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404477 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404480 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404483 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404485 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404488 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404490 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404493 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404495 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404499 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404502 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404504 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404507 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404509 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 11:11:34.405429 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404511 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404514 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404516 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404519 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404521 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404524 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404527 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404529 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404535 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404538 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404541 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404544 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404546 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404549 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404551 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404554 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404557 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404559 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404561 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404564 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 11:11:34.405886 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404567 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404569 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404572 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404574 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404576 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404579 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404581 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404585 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404588 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404591 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404593 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404596 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404599 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404602 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404604 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404607 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404610 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.404612 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405392 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405399 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 11:11:34.406378 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405403 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405406 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405410 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405414 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405416 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405419 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405422 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405424 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405427 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405430 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405433 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405435 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405438 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405441 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405444 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405446 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405449 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405451 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405454 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405458 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 11:11:34.406874 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405461 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405463 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405466 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405468 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405471 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405473 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405476 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405478 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405481 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405483 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405486 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405488 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405491 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405493 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405496 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405499 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405504 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405507 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405509 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405512 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 11:11:34.407418 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405515 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405517 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405521 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405524 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405527 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405530 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405534 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405537 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405540 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405542 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405545 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405548 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405551 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405554 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405556 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405559 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405562 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405565 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405567 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 11:11:34.407899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405570 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405573 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405576 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405579 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405583 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405594 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405599 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405602 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405605 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405608 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405612 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405615 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405618 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405621 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405623 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405626 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405629 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405631 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405634 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 11:11:34.408494 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405636 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405639 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405641 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405644 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405647 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405650 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405652 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405656 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405660 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405664 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405667 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405669 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405672 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405675 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405677 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405680 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405683 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405685 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.405687 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406094 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 11:11:34.408949 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406099 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406101 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406104 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406112 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406115 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406118 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406120 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406123 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406125 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406128 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406132 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406135 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406137 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406140 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406143 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406145 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406148 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406150 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406153 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406156 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 11:11:34.409447 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406158 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406161 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406163 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406166 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406174 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406177 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406184 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406186 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406189 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406191 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406194 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406196 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406199 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406201 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406204 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406206 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406214 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406217 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406219 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406223 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 11:11:34.409925 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406225 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406227 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406234 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406236 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406239 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406242 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406244 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406247 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406249 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406251 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406254 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406256 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406259 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406261 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406264 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406266 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406269 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406272 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406277 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 11:11:34.410419 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406297 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406300 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406303 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406305 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406308 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406311 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406313 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406315 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406336 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406340 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406348 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406351 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406354 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406357 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406360 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406364 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406366 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406369 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406407 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406425 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 11:11:34.410869 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406429 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406432 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406435 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406439 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406442 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406445 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406452 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406454 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406457 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406460 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406463 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406466 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406468 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406472 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406476 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406480 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406483 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406488 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.406491 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406589 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 11:11:34.411356 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406600 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406607 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406612 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406617 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406620 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406625 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406629 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406632 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406635 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406639 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406642 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406647 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406651 2562 flags.go:64] FLAG: --cgroup-root="" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406654 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406657 2562 flags.go:64] FLAG: --client-ca-file="" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406660 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406663 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406667 2562 flags.go:64] FLAG: --cluster-domain="" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406670 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406673 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406676 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406680 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406683 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 11:11:34.411835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406686 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406689 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406693 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406696 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406699 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406702 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406705 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406708 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406713 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406716 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406719 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406721 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406725 2562 flags.go:64] FLAG: --enable-server="true" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406728 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406733 2562 flags.go:64] FLAG: --event-burst="100" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406736 2562 flags.go:64] FLAG: --event-qps="50" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406739 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406742 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406745 2562 flags.go:64] FLAG: --eviction-hard="" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406749 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406752 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406756 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406759 2562 flags.go:64] FLAG: --eviction-soft="" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406763 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406766 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 11:11:34.412400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406769 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406771 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406774 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406777 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406780 2562 flags.go:64] FLAG: --feature-gates="" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406784 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406787 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406790 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406793 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406796 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406800 2562 flags.go:64] FLAG: --help="false" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406803 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406806 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406809 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406812 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406816 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406819 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406822 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406825 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406828 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406830 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406833 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406836 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406839 2562 flags.go:64] FLAG: --kube-reserved="" Jul 09 11:11:34.413066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406842 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406845 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406847 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406854 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406857 2562 flags.go:64] FLAG: --lock-file="" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406861 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406864 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406867 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406873 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406876 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406879 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406882 2562 flags.go:64] FLAG: --logging-format="text" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406886 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406889 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406892 2562 flags.go:64] FLAG: --manifest-url="" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406895 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406899 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406902 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406907 2562 flags.go:64] FLAG: --max-pods="110" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406910 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406913 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406916 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406919 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406922 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406925 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 11:11:34.414002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406928 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406936 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406939 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406942 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406945 2562 flags.go:64] FLAG: --pod-cidr="" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406948 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406954 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406958 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406961 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406964 2562 flags.go:64] FLAG: --port="10250" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406967 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406971 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0358d2311a3cce1f7" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406974 2562 flags.go:64] FLAG: --qos-reserved="" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406978 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406981 2562 flags.go:64] FLAG: --register-node="true" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406984 2562 flags.go:64] FLAG: --register-with-taints="" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406988 2562 flags.go:64] FLAG: --registry-burst="10" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406990 2562 flags.go:64] FLAG: --registry-qps="5" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406993 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406996 2562 flags.go:64] FLAG: --reserved-memory="" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.406999 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407002 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407005 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407008 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407011 2562 flags.go:64] FLAG: --runonce="false" Jul 09 11:11:34.415124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407014 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407017 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407020 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407023 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407026 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407029 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407032 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407035 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407038 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407041 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407044 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407046 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407049 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407052 2562 flags.go:64] FLAG: --system-cgroups="" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407055 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407063 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407066 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407069 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407073 2562 flags.go:64] FLAG: --tls-min-version="" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407076 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407079 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407083 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407086 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407089 2562 flags.go:64] FLAG: --v="2" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407093 2562 flags.go:64] FLAG: --version="false" Jul 09 11:11:34.416025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407098 2562 flags.go:64] FLAG: --vmodule="" Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407102 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407105 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407234 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407238 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407242 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407245 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407247 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407250 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407253 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407255 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407258 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407260 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407263 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407265 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407268 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407270 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407273 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407276 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407292 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 11:11:34.416678 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407295 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407297 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407301 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407303 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407306 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407309 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407312 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407315 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407317 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407321 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407323 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407326 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407329 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407332 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407334 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407336 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407339 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407341 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407344 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407346 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 11:11:34.417155 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407349 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407351 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407354 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407356 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407359 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407361 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407364 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407367 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407371 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407374 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407377 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407380 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407383 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407385 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407388 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407390 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407393 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407396 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407399 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 11:11:34.417853 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407401 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407404 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407406 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407409 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407412 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407415 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407417 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407420 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407422 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407425 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407427 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407430 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407433 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407435 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407438 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407440 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407443 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407445 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407448 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407450 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 11:11:34.418818 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407453 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407455 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407458 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407460 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407463 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407466 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407472 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407475 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407478 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407483 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407487 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407490 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407492 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407495 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407498 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407500 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407503 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407506 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407508 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 11:11:34.419457 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407511 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407513 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407516 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.407518 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.407524 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.415708 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.415731 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.417508 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.417523 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417647 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417658 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417663 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417668 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417673 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 11:11:34.419915 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417678 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417682 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417688 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417693 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417697 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417702 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417706 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417712 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417717 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417722 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417726 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417731 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417735 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417740 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417745 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417750 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417756 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417760 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417765 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417769 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 11:11:34.420506 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417773 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417777 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417784 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417790 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417795 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417800 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417804 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417810 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417815 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417819 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417824 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417828 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417833 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417837 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417841 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417868 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417874 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417878 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417882 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 11:11:34.421324 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417887 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417892 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417896 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417900 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417907 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417914 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417919 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417923 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417927 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417932 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417938 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417942 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417946 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417951 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417955 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417959 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417964 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417969 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417973 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 11:11:34.421881 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417978 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417982 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417986 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417991 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417995 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.417999 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418004 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418008 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418012 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418016 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418020 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418025 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418029 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418033 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418038 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418042 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418046 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418051 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418056 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418061 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 09 11:11:34.422508 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418066 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418070 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418075 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418079 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418085 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418089 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418093 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418097 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418102 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418108 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418113 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418118 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418123 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418127 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418132 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 11:11:34.423016 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418135 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.418143 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418339 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418348 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418352 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418356 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418362 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418367 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418372 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418376 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418381 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418385 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418389 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418393 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418397 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 11:11:34.423400 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418400 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418405 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418408 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418412 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418417 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418421 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418425 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418431 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418435 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418439 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418443 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418447 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418451 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418455 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418460 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418464 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418468 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418472 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418476 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418481 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 11:11:34.423827 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418485 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418490 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418494 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418498 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418502 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418506 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418511 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418515 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418519 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418524 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418531 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418535 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418539 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418543 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418548 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418553 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418557 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418561 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418565 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418570 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 11:11:34.424331 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418574 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418578 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418582 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418586 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418591 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418595 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418599 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418603 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418608 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418612 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418618 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418623 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418628 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418633 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418638 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418643 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418649 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418653 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418657 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 11:11:34.424927 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418661 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418666 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418670 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418674 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418678 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418683 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418687 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418692 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418695 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418700 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418704 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418708 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418712 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418716 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418721 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418725 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418730 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418734 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418738 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418742 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 11:11:34.425488 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418746 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418750 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418754 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418759 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418764 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418768 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:34.418771 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.418779 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.418976 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.422060 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.423712 2562 server.go:1019] "Starting client certificate rotation" Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.423818 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.423856 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 11:11:34.426383 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.426055 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 11:11:34.434004 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.433973 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 11:11:34.443875 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.443852 2562 log.go:25] "Validated CRI v1 runtime API" Jul 09 11:11:34.446358 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.446341 2562 log.go:25] "Validated CRI v1 image API" Jul 09 11:11:34.448672 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.448653 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 11:11:34.452145 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.452120 2562 fs.go:135] Filesystem UUIDs: map[5a24d637-5ce8-40e8-83f2-8fb32f9d0740:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bd6d67e1-a601-47a4-beaf-ae1d8defe0c3:/dev/nvme0n1p3] Jul 09 11:11:34.452231 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.452141 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 11:11:34.456213 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.456188 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 11:11:34.457683 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.457548 2562 manager.go:216] Machine: {Timestamp:2026-07-09 11:11:34.455961628 +0000 UTC m=+0.366806145 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099246 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e1c79d5ddde95a2c2013eaf68034b SystemUUID:ec2e1c79-d5dd-de95-a2c2-013eaf68034b BootID:e8cb7e91-9cb4-4007-8470-a38a5f201cd3 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a5:2d:06:c1:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a5:2d:06:c1:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:8d:8b:54:65:50 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 11:11:34.457683 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.457679 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 11:11:34.457843 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.457802 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 11:11:34.461487 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.461456 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 11:11:34.461642 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.461492 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-226.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 11:11:34.462326 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.462313 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 11:11:34.462326 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.462328 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 11:11:34.462422 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.462335 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 11:11:34.462868 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.462857 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 11:11:34.464660 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.464648 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 11:11:34.469623 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.469599 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 09 11:11:34.469757 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.469747 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 11:11:34.469797 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.469780 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 09 11:11:34.469797 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.469794 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 11:11:34.469852 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.469809 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 11:11:34.469852 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.469820 2562 kubelet.go:398] "Adding apiserver pod source" Jul 09 11:11:34.469852 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.469834 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 11:11:34.470207 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.470195 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 11:11:34.470253 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.470214 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 11:11:34.472332 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.472316 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 11:11:34.474716 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.474697 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 11:11:34.474830 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.474736 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 11:11:34.476495 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476479 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 11:11:34.476581 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476498 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 11:11:34.476581 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476507 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 11:11:34.476581 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476551 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 11:11:34.476581 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476564 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 11:11:34.476581 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476572 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 11:11:34.476581 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476583 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 11:11:34.476778 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476591 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 11:11:34.476778 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476602 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 11:11:34.476778 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476610 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 11:11:34.476778 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476623 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 11:11:34.476778 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.476632 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 11:11:34.478181 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.478169 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 11:11:34.478241 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.478183 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 11:11:34.479539 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.479508 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 11:11:34.479539 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.479508 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 11:11:34.481491 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.481476 2562 server.go:1268] "Started kubelet" Jul 09 11:11:34.481609 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.481535 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 11:11:34.481661 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.481575 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 11:11:34.485246 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.481656 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 11:11:34.486017 ip-10-0-131-226 systemd[1]: Started Kubernetes Kubelet. Jul 09 11:11:34.487394 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.487366 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 09 11:11:34.487815 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.487795 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 11:11:34.491362 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.491337 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 11:11:34.491973 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.491959 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-226.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 11:11:34.493050 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.491971 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-226.ec2.internal.18c09aa6ff8db76d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-226.ec2.internal,UID:ip-10-0-131-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-226.ec2.internal,},FirstTimestamp:2026-07-09 11:11:34.481442669 +0000 UTC m=+0.392287186,LastTimestamp:2026-07-09 11:11:34.481442669 +0000 UTC m=+0.392287186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-226.ec2.internal,}" Jul 09 11:11:34.500005 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.499985 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 11:11:34.500108 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.500070 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 11:11:34.500686 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.500307 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:34.501011 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.500990 2562 factory.go:55] Registering systemd factory Jul 09 11:11:34.501011 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.501013 2562 factory.go:223] Registration of the systemd container factory successfully Jul 09 11:11:34.501217 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.501200 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 11:11:34.501270 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.501225 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 11:11:34.501270 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.501255 2562 factory.go:153] Registering CRI-O factory Jul 09 11:11:34.501270 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.501270 2562 factory.go:223] Registration of the crio container factory successfully Jul 09 11:11:34.501425 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.501203 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 11:11:34.501425 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.501345 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 11:11:34.501425 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.501363 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 09 11:11:34.501425 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.501372 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 09 11:11:34.501425 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.501374 2562 factory.go:103] Registering Raw factory Jul 09 11:11:34.501425 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.501390 2562 manager.go:1196] Started watching for new ooms in manager Jul 09 11:11:34.502130 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.502115 2562 manager.go:349] Starting recovery of all containers Jul 09 11:11:34.502589 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.502556 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 11:11:34.508617 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.508588 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mb4pf" Jul 09 11:11:34.510837 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.510720 2562 manager.go:354] Recovery completed Jul 09 11:11:34.514741 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.514718 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mb4pf" Jul 09 11:11:34.515152 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.515116 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 11:11:34.516430 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.516395 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 11:11:34.518216 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.518198 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 09 11:11:34.518329 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.518235 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 11:11:34.518329 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.518246 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 09 11:11:34.518853 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.518839 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 11:11:34.518853 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.518851 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 11:11:34.518942 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.518867 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 09 11:11:34.518942 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.518878 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 11:11:34.519873 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.519860 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 09 11:11:34.519922 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.519887 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 11:11:34.519922 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.519900 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 09 11:11:34.520799 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.520788 2562 policy_none.go:49] "None policy: Start" Jul 09 11:11:34.520839 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.520805 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 11:11:34.520839 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.520816 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 11:11:34.522795 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.522783 2562 policy_none.go:47] "Start" Jul 09 11:11:34.562985 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.562961 2562 manager.go:337] "Starting Device Plugin manager" Jul 09 11:11:34.563140 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.563007 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 11:11:34.563140 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.563019 2562 server.go:87] "Starting device plugin registration server" Jul 09 11:11:34.563344 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.563330 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 11:11:34.563410 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.563346 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 11:11:34.563491 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.563472 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 11:11:34.563588 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.563567 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 11:11:34.563588 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.563579 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 11:11:34.564166 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.564142 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 11:11:34.564254 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.564193 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:34.603572 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.603527 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 11:11:34.608657 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.604765 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 11:11:34.608657 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.604798 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 11:11:34.608657 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.604847 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 11:11:34.608657 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.604888 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 11:11:34.608657 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.607615 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 11:11:34.664063 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.663983 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 11:11:34.664917 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.664889 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 09 11:11:34.665044 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.664929 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 11:11:34.665044 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.664945 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 09 11:11:34.665044 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.664971 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.675023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.675001 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.675183 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.675030 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-226.ec2.internal\": node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:34.698518 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.698484 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:34.705786 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.705752 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal"] Jul 09 11:11:34.705894 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.705844 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 11:11:34.707541 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.707522 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 09 11:11:34.707644 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.707561 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 11:11:34.707644 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.707575 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 09 11:11:34.709726 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.709713 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 11:11:34.709847 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.709832 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.709881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.709869 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 11:11:34.710542 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.710525 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 09 11:11:34.710542 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.710540 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 09 11:11:34.710703 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.710553 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 11:11:34.710703 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.710562 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 11:11:34.710703 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.710568 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 09 11:11:34.710703 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.710572 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 09 11:11:34.712582 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.712564 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.712670 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.712591 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 11:11:34.713294 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.713270 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 09 11:11:34.713363 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.713309 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 11:11:34.713363 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.713319 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 09 11:11:34.726827 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.726807 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-226.ec2.internal\" not found" node="ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.730816 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.730799 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-226.ec2.internal\" not found" node="ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.798818 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.798783 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:34.802798 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.802780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.802876 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.802827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.802876 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.802855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f2626d80cf6adaad426dfc2322e4da8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.ec2.internal\" (UID: \"5f2626d80cf6adaad426dfc2322e4da8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.899590 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:34.899547 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:34.903886 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.903867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.903955 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.903895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.903955 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.903911 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f2626d80cf6adaad426dfc2322e4da8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.ec2.internal\" (UID: \"5f2626d80cf6adaad426dfc2322e4da8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.904033 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.903962 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f2626d80cf6adaad426dfc2322e4da8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.ec2.internal\" (UID: \"5f2626d80cf6adaad426dfc2322e4da8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.904033 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.903967 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 09 11:11:34.904033 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:34.903977 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 09 11:11:35.000397 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:35.000319 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:35.031727 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.031700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 09 11:11:35.035314 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.035273 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 09 11:11:35.101415 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:35.101335 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:35.201844 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:35.201803 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:35.302300 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:35.302223 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:35.351370 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.351341 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 11:11:35.403120 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:35.403090 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:35.414736 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.414715 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 11:11:35.423148 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.423122 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 11:11:35.423313 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.423269 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 11:11:35.423456 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.423308 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 11:11:35.423456 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.423325 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 11:11:35.503793 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:35.503761 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:35.518043 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.518004 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 11:06:34 +0000 UTC" deadline="2028-02-14 12:11:28.348220409 +0000 UTC" Jul 09 11:11:35.518043 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.518039 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14040h59m52.830184857s" Jul 09 11:11:35.604190 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:35.604107 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:35.704494 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:35.704455 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:35.799093 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:35.799063 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2626d80cf6adaad426dfc2322e4da8.slice/crio-9612aa14d0df92850b40cad04b97d77c36e5a23fc2595e4b720276c2eacfdcd8 WatchSource:0}: Error finding container 9612aa14d0df92850b40cad04b97d77c36e5a23fc2595e4b720276c2eacfdcd8: Status 404 returned error can't find the container with id 9612aa14d0df92850b40cad04b97d77c36e5a23fc2595e4b720276c2eacfdcd8 Jul 09 11:11:35.803033 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.803017 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 11:11:35.804608 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:35.804592 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 09 11:11:35.871240 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:35.871204 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa7ee406116a1f7fce36ddc8789b8d7.slice/crio-761e009c45c9c7c2ddfa7433b2ae853f811d06a8eb509a369ef86d952e6ae30d WatchSource:0}: Error finding container 761e009c45c9c7c2ddfa7433b2ae853f811d06a8eb509a369ef86d952e6ae30d: Status 404 returned error can't find the container with id 761e009c45c9c7c2ddfa7433b2ae853f811d06a8eb509a369ef86d952e6ae30d Jul 09 11:11:35.901047 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:35.901025 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 11:11:36.001211 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.001181 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 09 11:11:36.014873 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.014854 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 11:11:36.016045 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.016028 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 09 11:11:36.024432 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.024413 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 11:11:36.353181 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.353096 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 11:11:36.470927 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.470895 2562 apiserver.go:52] "Watching apiserver" Jul 09 11:11:36.482763 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.482735 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 11:11:36.484743 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.484715 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-hfdzs","openshift-ovn-kubernetes/ovnkube-node-f672m","kube-system/global-pull-secret-syncer-4tp6c","kube-system/konnectivity-agent-cfllx","kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm","openshift-cluster-node-tuning-operator/tuned-hq5vh","openshift-dns/node-resolver-btfhm","openshift-image-registry/node-ca-t5l5s","openshift-multus/multus-additional-cni-plugins-px86s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal","openshift-multus/multus-nhrc4","openshift-multus/network-metrics-daemon-h5dgn","openshift-network-diagnostics/network-check-target-55rts"] Jul 09 11:11:36.488349 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.487780 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.490217 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.490196 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btfhm" Jul 09 11:11:36.491115 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.491046 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 11:11:36.491251 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.491235 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 11:11:36.491506 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.491489 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cvfzt\"" Jul 09 11:11:36.492449 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.492319 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:36.493006 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.492986 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zd7lq\"" Jul 09 11:11:36.493191 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.493176 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 11:11:36.493697 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.493679 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 11:11:36.494854 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.494835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hfdzs" Jul 09 11:11:36.495032 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.495015 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 11:11:36.495175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.495159 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qqhzv\"" Jul 09 11:11:36.495530 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.495511 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 11:11:36.496943 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.496926 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.497759 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.497520 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r86ns\"" Jul 09 11:11:36.497759 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.497599 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 11:11:36.498551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.498532 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 11:11:36.498657 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.498640 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 11:11:36.501395 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.499088 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t5l5s" Jul 09 11:11:36.501395 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.499699 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 11:11:36.501395 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.499759 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 11:11:36.501395 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.499805 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m8g8j\"" Jul 09 11:11:36.501395 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.499879 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 11:11:36.501395 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.500957 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 11:11:36.501701 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.501417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:36.501701 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:36.501521 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:36.502397 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.501804 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 11:11:36.502397 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.501887 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 11:11:36.502397 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.502000 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 11:11:36.502397 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.502035 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nrtnk\"" Jul 09 11:11:36.503886 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.503856 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.506591 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.506456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.510835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.510723 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 11:11:36.511356 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511142 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:36.511356 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:36.511217 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:36.511356 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511273 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511420 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-systemd\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff73ec5c-d885-43c8-a2d9-c67962c82745-tmp\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9af17ff-b25e-4c3b-b943-b44ad500bf65-ovn-node-metrics-cert\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-etc-selinux\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-sysctl-conf\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-sys\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511572 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31ce5b35-3f21-4bf1-85c8-c7dec62a8da0-iptables-alerter-script\") pod \"iptables-alerter-hfdzs\" (UID: \"31ce5b35-3f21-4bf1-85c8-c7dec62a8da0\") " pod="openshift-network-operator/iptables-alerter-hfdzs" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-device-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-kubernetes\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511668 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-run\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpfz7\" (UniqueName: \"kubernetes.io/projected/ff73ec5c-d885-43c8-a2d9-c67962c82745-kube-api-access-qpfz7\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-var-lib-openvswitch\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-sysctl-d\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.511812 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b0a1137-bae7-4ffe-867c-51ad32e22c15-hosts-file\") pod \"node-resolver-btfhm\" (UID: \"0b0a1137-bae7-4ffe-867c-51ad32e22c15\") " pod="openshift-dns/node-resolver-btfhm" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511819 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b99c44de-f215-4688-b81e-9e4cdee6a0b0-agent-certs\") pod \"konnectivity-agent-cfllx\" (UID: \"b99c44de-f215-4688-b81e-9e4cdee6a0b0\") " pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2de16fdd-03a8-47ac-a739-71a61b51bf59-serviceca\") pod \"node-ca-t5l5s\" (UID: \"2de16fdd-03a8-47ac-a739-71a61b51bf59\") " pod="openshift-image-registry/node-ca-t5l5s" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511885 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-run-ovn-kubernetes\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ce5b35-3f21-4bf1-85c8-c7dec62a8da0-host-slash\") pod \"iptables-alerter-hfdzs\" (UID: \"31ce5b35-3f21-4bf1-85c8-c7dec62a8da0\") " pod="openshift-network-operator/iptables-alerter-hfdzs" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-tuned\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b99c44de-f215-4688-b81e-9e4cdee6a0b0-konnectivity-ca\") pod \"konnectivity-agent-cfllx\" (UID: \"b99c44de-f215-4688-b81e-9e4cdee6a0b0\") " pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.511983 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-kubelet\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-cni-bin\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512045 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-sysconfig\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512075 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx64d\" (UniqueName: \"kubernetes.io/projected/0b0a1137-bae7-4ffe-867c-51ad32e22c15-kube-api-access-cx64d\") pod \"node-resolver-btfhm\" (UID: \"0b0a1137-bae7-4ffe-867c-51ad32e22c15\") " pod="openshift-dns/node-resolver-btfhm" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-run-netns\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-modprobe-d\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2de16fdd-03a8-47ac-a739-71a61b51bf59-host\") pod \"node-ca-t5l5s\" (UID: \"2de16fdd-03a8-47ac-a739-71a61b51bf59\") " pod="openshift-image-registry/node-ca-t5l5s" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512205 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-slash\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512234 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-run-ovn\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzsvt\" (UniqueName: \"kubernetes.io/projected/e9af17ff-b25e-4c3b-b943-b44ad500bf65-kube-api-access-pzsvt\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs6rc\" (UniqueName: \"kubernetes.io/projected/308d51ce-b9e4-4750-8fb5-b481e2997518-kube-api-access-gs6rc\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512382 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-var-lib-kubelet\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b0a1137-bae7-4ffe-867c-51ad32e22c15-tmp-dir\") pod \"node-resolver-btfhm\" (UID: \"0b0a1137-bae7-4ffe-867c-51ad32e22c15\") " pod="openshift-dns/node-resolver-btfhm" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-systemd-units\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512489 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-registration-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512516 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9swwg\" (UniqueName: \"kubernetes.io/projected/9a462c5b-8391-4aaa-a694-a1ef4effd722-kube-api-access-9swwg\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512541 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-lib-modules\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-host\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-run-systemd\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-etc-openvswitch\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-node-log\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-log-socket\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9af17ff-b25e-4c3b-b943-b44ad500bf65-env-overrides\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vlg4\" (UniqueName: \"kubernetes.io/projected/2de16fdd-03a8-47ac-a739-71a61b51bf59-kube-api-access-7vlg4\") pod \"node-ca-t5l5s\" (UID: \"2de16fdd-03a8-47ac-a739-71a61b51bf59\") " pod="openshift-image-registry/node-ca-t5l5s" Jul 09 11:11:36.513966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-run-openvswitch\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.514757 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-socket-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.514757 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-cni-netd\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.514757 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9af17ff-b25e-4c3b-b943-b44ad500bf65-ovnkube-config\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.514757 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-sys-fs\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.514757 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9af17ff-b25e-4c3b-b943-b44ad500bf65-ovnkube-script-lib\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.514757 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.512945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzmhf\" (UniqueName: \"kubernetes.io/projected/31ce5b35-3f21-4bf1-85c8-c7dec62a8da0-kube-api-access-kzmhf\") pod \"iptables-alerter-hfdzs\" (UID: \"31ce5b35-3f21-4bf1-85c8-c7dec62a8da0\") " pod="openshift-network-operator/iptables-alerter-hfdzs" Jul 09 11:11:36.514757 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.514656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.515717 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.515696 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 11:11:36.515863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.515843 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 11:11:36.515930 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.515900 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 11:11:36.517214 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.517193 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:36.517324 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:36.517299 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:36.517549 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.517530 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 11:11:36.517719 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.517696 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 11:11:36.518012 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.517994 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tvwpd\"" Jul 09 11:11:36.518094 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.518075 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 11:11:36.518148 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.518130 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 11:11:36.518648 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.518626 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r8zpx\"" Jul 09 11:11:36.518772 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.518751 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 11:11:36.519019 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.518999 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 11:11:36.520197 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.519090 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ncqts\"" Jul 09 11:11:36.520197 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.519117 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 11:11:36.530581 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.530558 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 11:11:36.571903 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.571881 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4sx8j" Jul 09 11:11:36.583319 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.583273 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4sx8j" Jul 09 11:11:36.603607 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.603521 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 11:11:36.612758 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.612700 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" event={"ID":"8aa7ee406116a1f7fce36ddc8789b8d7","Type":"ContainerStarted","Data":"761e009c45c9c7c2ddfa7433b2ae853f811d06a8eb509a369ef86d952e6ae30d"} Jul 09 11:11:36.613143 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613120 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-systemd\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.613251 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff73ec5c-d885-43c8-a2d9-c67962c82745-tmp\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.613251 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9af17ff-b25e-4c3b-b943-b44ad500bf65-ovn-node-metrics-cert\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.613251 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-etc-selinux\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.613251 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9bm8\" (UniqueName: \"kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8\") pod \"network-check-target-55rts\" (UID: \"672a99ff-7087-4603-a419-f4594bc9cbfd\") " pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:36.613251 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613244 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-systemd\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.613585 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613263 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-kubelet-config\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:36.613585 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-sysctl-conf\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.613585 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-sys\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.613585 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31ce5b35-3f21-4bf1-85c8-c7dec62a8da0-iptables-alerter-script\") pod \"iptables-alerter-hfdzs\" (UID: \"31ce5b35-3f21-4bf1-85c8-c7dec62a8da0\") " pod="openshift-network-operator/iptables-alerter-hfdzs" Jul 09 11:11:36.613790 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.613790 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-device-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.613790 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613662 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 11:11:36.613790 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613743 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.613978 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613794 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-device-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.613978 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-run-k8s-cni-cncf-io\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.613978 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-run-netns\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.613978 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-dbus\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:36.613978 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbmwp\" (UniqueName: \"kubernetes.io/projected/ebe189cd-446c-428a-87ff-d53bfe615da5-kube-api-access-mbmwp\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.613978 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-kubernetes\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.613978 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31ce5b35-3f21-4bf1-85c8-c7dec62a8da0-iptables-alerter-script\") pod \"iptables-alerter-hfdzs\" (UID: \"31ce5b35-3f21-4bf1-85c8-c7dec62a8da0\") " pod="openshift-network-operator/iptables-alerter-hfdzs" Jul 09 11:11:36.613978 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-run\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.613978 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613964 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:36.614404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.613989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-var-lib-kubelet\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.614404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebe189cd-446c-428a-87ff-d53bfe615da5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.614404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614046 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-etc-selinux\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.614404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpfz7\" (UniqueName: \"kubernetes.io/projected/ff73ec5c-d885-43c8-a2d9-c67962c82745-kube-api-access-qpfz7\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.614404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-kubernetes\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.614404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614187 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-run\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.614404 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:36.614191 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:36.614404 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:36.614296 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs podName:9a462c5b-8391-4aaa-a694-a1ef4effd722 nodeName:}" failed. No retries permitted until 2026-07-09 11:11:37.114249563 +0000 UTC m=+3.025094082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs") pod "network-metrics-daemon-h5dgn" (UID: "9a462c5b-8391-4aaa-a694-a1ef4effd722") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:36.614404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-sys\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.614404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-var-lib-openvswitch\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-conf-dir\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614437 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-var-lib-openvswitch\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-sysctl-conf\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-daemon-config\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-sysctl-d\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b0a1137-bae7-4ffe-867c-51ad32e22c15-hosts-file\") pod \"node-resolver-btfhm\" (UID: \"0b0a1137-bae7-4ffe-867c-51ad32e22c15\") " pod="openshift-dns/node-resolver-btfhm" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b99c44de-f215-4688-b81e-9e4cdee6a0b0-agent-certs\") pod \"konnectivity-agent-cfllx\" (UID: \"b99c44de-f215-4688-b81e-9e4cdee6a0b0\") " pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2de16fdd-03a8-47ac-a739-71a61b51bf59-serviceca\") pod \"node-ca-t5l5s\" (UID: \"2de16fdd-03a8-47ac-a739-71a61b51bf59\") " pod="openshift-image-registry/node-ca-t5l5s" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-run-multus-certs\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b0a1137-bae7-4ffe-867c-51ad32e22c15-hosts-file\") pod \"node-resolver-btfhm\" (UID: \"0b0a1137-bae7-4ffe-867c-51ad32e22c15\") " pod="openshift-dns/node-resolver-btfhm" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-run-ovn-kubernetes\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614697 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-run-ovn-kubernetes\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ce5b35-3f21-4bf1-85c8-c7dec62a8da0-host-slash\") pod \"iptables-alerter-hfdzs\" (UID: \"31ce5b35-3f21-4bf1-85c8-c7dec62a8da0\") " pod="openshift-network-operator/iptables-alerter-hfdzs" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-sysctl-d\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614727 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ce5b35-3f21-4bf1-85c8-c7dec62a8da0-host-slash\") pod \"iptables-alerter-hfdzs\" (UID: \"31ce5b35-3f21-4bf1-85c8-c7dec62a8da0\") " pod="openshift-network-operator/iptables-alerter-hfdzs" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-system-cni-dir\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.614863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30206edd-f1af-448c-a5c4-9a0aada264d4-cni-binary-copy\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-var-lib-cni-multus\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614849 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebe189cd-446c-428a-87ff-d53bfe615da5-cni-binary-copy\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-tuned\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b99c44de-f215-4688-b81e-9e4cdee6a0b0-konnectivity-ca\") pod \"konnectivity-agent-cfllx\" (UID: \"b99c44de-f215-4688-b81e-9e4cdee6a0b0\") " pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614924 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-kubelet\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-cni-bin\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-os-release\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.614994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-sysconfig\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx64d\" (UniqueName: \"kubernetes.io/projected/0b0a1137-bae7-4ffe-867c-51ad32e22c15-kube-api-access-cx64d\") pod \"node-resolver-btfhm\" (UID: \"0b0a1137-bae7-4ffe-867c-51ad32e22c15\") " pod="openshift-dns/node-resolver-btfhm" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-run-netns\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-modprobe-d\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2de16fdd-03a8-47ac-a739-71a61b51bf59-host\") pod \"node-ca-t5l5s\" (UID: \"2de16fdd-03a8-47ac-a739-71a61b51bf59\") " pod="openshift-image-registry/node-ca-t5l5s" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-slash\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-run-ovn\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615163 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2de16fdd-03a8-47ac-a739-71a61b51bf59-serviceca\") pod \"node-ca-t5l5s\" (UID: \"2de16fdd-03a8-47ac-a739-71a61b51bf59\") " pod="openshift-image-registry/node-ca-t5l5s" Jul 09 11:11:36.615718 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzsvt\" (UniqueName: \"kubernetes.io/projected/e9af17ff-b25e-4c3b-b943-b44ad500bf65-kube-api-access-pzsvt\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615202 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-sysconfig\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2de16fdd-03a8-47ac-a739-71a61b51bf59-host\") pod \"node-ca-t5l5s\" (UID: \"2de16fdd-03a8-47ac-a739-71a61b51bf59\") " pod="openshift-image-registry/node-ca-t5l5s" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615252 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-slash\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6rc\" (UniqueName: \"kubernetes.io/projected/308d51ce-b9e4-4750-8fb5-b481e2997518-kube-api-access-gs6rc\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-run-ovn\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615331 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615361 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-var-lib-kubelet\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-cnibin\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-kubelet\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615429 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-var-lib-cni-bin\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b0a1137-bae7-4ffe-867c-51ad32e22c15-tmp-dir\") pod \"node-resolver-btfhm\" (UID: \"0b0a1137-bae7-4ffe-867c-51ad32e22c15\") " pod="openshift-dns/node-resolver-btfhm" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615469 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-cni-bin\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-systemd-units\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-registration-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615529 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-var-lib-kubelet\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.616540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9swwg\" (UniqueName: \"kubernetes.io/projected/9a462c5b-8391-4aaa-a694-a1ef4effd722-kube-api-access-9swwg\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615576 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-system-cni-dir\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-lib-modules\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615627 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-modprobe-d\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615634 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-host\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-run-systemd\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615670 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-run-netns\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-etc-openvswitch\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-node-log\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-log-socket\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9af17ff-b25e-4c3b-b943-b44ad500bf65-env-overrides\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-cni-dir\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vlg4\" (UniqueName: \"kubernetes.io/projected/2de16fdd-03a8-47ac-a739-71a61b51bf59-kube-api-access-7vlg4\") pod \"node-ca-t5l5s\" (UID: \"2de16fdd-03a8-47ac-a739-71a61b51bf59\") " pod="openshift-image-registry/node-ca-t5l5s" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-run-openvswitch\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-etc-openvswitch\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-socket-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-os-release\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.617386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-socket-dir-parent\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-hostroot\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615957 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-run-systemd\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615972 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-etc-kubernetes\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrxzp\" (UniqueName: \"kubernetes.io/projected/30206edd-f1af-448c-a5c4-9a0aada264d4-kube-api-access-qrxzp\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-cni-netd\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9af17ff-b25e-4c3b-b943-b44ad500bf65-ovnkube-config\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-sys-fs\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-cnibin\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebe189cd-446c-428a-87ff-d53bfe615da5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9af17ff-b25e-4c3b-b943-b44ad500bf65-ovnkube-script-lib\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzmhf\" (UniqueName: \"kubernetes.io/projected/31ce5b35-3f21-4bf1-85c8-c7dec62a8da0-kube-api-access-kzmhf\") pod \"iptables-alerter-hfdzs\" (UID: \"31ce5b35-3f21-4bf1-85c8-c7dec62a8da0\") " pod="openshift-network-operator/iptables-alerter-hfdzs" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616204 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b99c44de-f215-4688-b81e-9e4cdee6a0b0-konnectivity-ca\") pod \"konnectivity-agent-cfllx\" (UID: \"b99c44de-f215-4688-b81e-9e4cdee6a0b0\") " pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616319 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-run-openvswitch\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-socket-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616448 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-registration-dir\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.618166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616519 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-lib-modules\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.618881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.615924 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff73ec5c-d885-43c8-a2d9-c67962c82745-host\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.618881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616642 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/308d51ce-b9e4-4750-8fb5-b481e2997518-sys-fs\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.618881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616771 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-systemd-units\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b0a1137-bae7-4ffe-867c-51ad32e22c15-tmp-dir\") pod \"node-resolver-btfhm\" (UID: \"0b0a1137-bae7-4ffe-867c-51ad32e22c15\") " pod="openshift-dns/node-resolver-btfhm" Jul 09 11:11:36.618881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616904 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-log-socket\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.616951 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-host-cni-netd\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.617006 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9af17ff-b25e-4c3b-b943-b44ad500bf65-node-log\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.617118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9af17ff-b25e-4c3b-b943-b44ad500bf65-ovnkube-config\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.617520 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9af17ff-b25e-4c3b-b943-b44ad500bf65-env-overrides\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.617932 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9af17ff-b25e-4c3b-b943-b44ad500bf65-ovnkube-script-lib\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.618881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.618126 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" event={"ID":"5f2626d80cf6adaad426dfc2322e4da8","Type":"ContainerStarted","Data":"9612aa14d0df92850b40cad04b97d77c36e5a23fc2595e4b720276c2eacfdcd8"} Jul 09 11:11:36.619731 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.619691 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9af17ff-b25e-4c3b-b943-b44ad500bf65-ovn-node-metrics-cert\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.619950 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.619929 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff73ec5c-d885-43c8-a2d9-c67962c82745-etc-tuned\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.620140 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.620121 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff73ec5c-d885-43c8-a2d9-c67962c82745-tmp\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.620496 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.620475 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b99c44de-f215-4688-b81e-9e4cdee6a0b0-agent-certs\") pod \"konnectivity-agent-cfllx\" (UID: \"b99c44de-f215-4688-b81e-9e4cdee6a0b0\") " pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:36.624630 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.624605 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpfz7\" (UniqueName: \"kubernetes.io/projected/ff73ec5c-d885-43c8-a2d9-c67962c82745-kube-api-access-qpfz7\") pod \"tuned-hq5vh\" (UID: \"ff73ec5c-d885-43c8-a2d9-c67962c82745\") " pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.624854 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.624830 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzmhf\" (UniqueName: \"kubernetes.io/projected/31ce5b35-3f21-4bf1-85c8-c7dec62a8da0-kube-api-access-kzmhf\") pod \"iptables-alerter-hfdzs\" (UID: \"31ce5b35-3f21-4bf1-85c8-c7dec62a8da0\") " pod="openshift-network-operator/iptables-alerter-hfdzs" Jul 09 11:11:36.625853 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.625828 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx64d\" (UniqueName: \"kubernetes.io/projected/0b0a1137-bae7-4ffe-867c-51ad32e22c15-kube-api-access-cx64d\") pod \"node-resolver-btfhm\" (UID: \"0b0a1137-bae7-4ffe-867c-51ad32e22c15\") " pod="openshift-dns/node-resolver-btfhm" Jul 09 11:11:36.625947 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.625885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzsvt\" (UniqueName: \"kubernetes.io/projected/e9af17ff-b25e-4c3b-b943-b44ad500bf65-kube-api-access-pzsvt\") pod \"ovnkube-node-f672m\" (UID: \"e9af17ff-b25e-4c3b-b943-b44ad500bf65\") " pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.626329 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.626308 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vlg4\" (UniqueName: \"kubernetes.io/projected/2de16fdd-03a8-47ac-a739-71a61b51bf59-kube-api-access-7vlg4\") pod \"node-ca-t5l5s\" (UID: \"2de16fdd-03a8-47ac-a739-71a61b51bf59\") " pod="openshift-image-registry/node-ca-t5l5s" Jul 09 11:11:36.626523 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.626474 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs6rc\" (UniqueName: \"kubernetes.io/projected/308d51ce-b9e4-4750-8fb5-b481e2997518-kube-api-access-gs6rc\") pod \"aws-ebs-csi-driver-node-5zbjm\" (UID: \"308d51ce-b9e4-4750-8fb5-b481e2997518\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.626808 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.626792 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9swwg\" (UniqueName: \"kubernetes.io/projected/9a462c5b-8391-4aaa-a694-a1ef4effd722-kube-api-access-9swwg\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:36.716805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-system-cni-dir\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.716805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30206edd-f1af-448c-a5c4-9a0aada264d4-cni-binary-copy\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.716805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-var-lib-cni-multus\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.716805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716634 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebe189cd-446c-428a-87ff-d53bfe615da5-cni-binary-copy\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.716805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-os-release\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.716805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.716805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716695 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-system-cni-dir\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.716805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-cnibin\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.716805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-var-lib-cni-bin\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.716805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716789 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-cnibin\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.716805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-system-cni-dir\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716850 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-system-cni-dir\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.716890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-var-lib-cni-bin\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-var-lib-cni-multus\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717269 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-os-release\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-cni-dir\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-os-release\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-socket-dir-parent\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717411 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30206edd-f1af-448c-a5c4-9a0aada264d4-cni-binary-copy\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717414 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-hostroot\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717464 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-hostroot\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717471 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-os-release\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-etc-kubernetes\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717498 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-etc-kubernetes\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrxzp\" (UniqueName: \"kubernetes.io/projected/30206edd-f1af-448c-a5c4-9a0aada264d4-kube-api-access-qrxzp\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.717507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717520 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-socket-dir-parent\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717523 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebe189cd-446c-428a-87ff-d53bfe615da5-cni-binary-copy\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-cnibin\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717566 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-cni-dir\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebe189cd-446c-428a-87ff-d53bfe615da5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717644 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bm8\" (UniqueName: \"kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8\") pod \"network-check-target-55rts\" (UID: \"672a99ff-7087-4603-a419-f4594bc9cbfd\") " pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebe189cd-446c-428a-87ff-d53bfe615da5-cnibin\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-kubelet-config\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717693 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-run-k8s-cni-cncf-io\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-run-netns\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:36.717734 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-dbus\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:36.717807 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret podName:3e079363-7a35-4ffd-a0e0-9763e5e6e0a6 nodeName:}" failed. No retries permitted until 2026-07-09 11:11:37.217787598 +0000 UTC m=+3.128632120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret") pod "global-pull-secret-syncer-4tp6c" (UID: "3e079363-7a35-4ffd-a0e0-9763e5e6e0a6") : object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbmwp\" (UniqueName: \"kubernetes.io/projected/ebe189cd-446c-428a-87ff-d53bfe615da5-kube-api-access-mbmwp\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-dbus\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-kubelet-config\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:36.718266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.717879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-var-lib-kubelet\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718002 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-run-netns\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718003 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebe189cd-446c-428a-87ff-d53bfe615da5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718038 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-run-k8s-cni-cncf-io\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebe189cd-446c-428a-87ff-d53bfe615da5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718077 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-var-lib-kubelet\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-conf-dir\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-daemon-config\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718231 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-conf-dir\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-run-multus-certs\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30206edd-f1af-448c-a5c4-9a0aada264d4-host-run-multus-certs\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718505 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebe189cd-446c-428a-87ff-d53bfe615da5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.719127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.718736 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30206edd-f1af-448c-a5c4-9a0aada264d4-multus-daemon-config\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.724842 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:36.724816 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 11:11:36.724999 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:36.724849 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 11:11:36.724999 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:36.724863 2562 projected.go:196] Error preparing data for projected volume kube-api-access-j9bm8 for pod openshift-network-diagnostics/network-check-target-55rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:36.724999 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:36.724937 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8 podName:672a99ff-7087-4603-a419-f4594bc9cbfd nodeName:}" failed. No retries permitted until 2026-07-09 11:11:37.224917692 +0000 UTC m=+3.135762221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j9bm8" (UniqueName: "kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8") pod "network-check-target-55rts" (UID: "672a99ff-7087-4603-a419-f4594bc9cbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:36.729081 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.729055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrxzp\" (UniqueName: \"kubernetes.io/projected/30206edd-f1af-448c-a5c4-9a0aada264d4-kube-api-access-qrxzp\") pod \"multus-nhrc4\" (UID: \"30206edd-f1af-448c-a5c4-9a0aada264d4\") " pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.729735 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.729709 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbmwp\" (UniqueName: \"kubernetes.io/projected/ebe189cd-446c-428a-87ff-d53bfe615da5-kube-api-access-mbmwp\") pod \"multus-additional-cni-plugins-px86s\" (UID: \"ebe189cd-446c-428a-87ff-d53bfe615da5\") " pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.806299 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.806249 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" Jul 09 11:11:36.815903 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.815814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btfhm" Jul 09 11:11:36.816227 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:36.816196 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff73ec5c_d885_43c8_a2d9_c67962c82745.slice/crio-d9093a1f5d566dd2231d20254646a3473f6310e57ce85a86d5602f898c3d037e WatchSource:0}: Error finding container d9093a1f5d566dd2231d20254646a3473f6310e57ce85a86d5602f898c3d037e: Status 404 returned error can't find the container with id d9093a1f5d566dd2231d20254646a3473f6310e57ce85a86d5602f898c3d037e Jul 09 11:11:36.826342 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:36.826271 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b0a1137_bae7_4ffe_867c_51ad32e22c15.slice/crio-5886624dce3bfa7e42f95bbe04a45287c70ec85bc373409e93ca6c1b388db854 WatchSource:0}: Error finding container 5886624dce3bfa7e42f95bbe04a45287c70ec85bc373409e93ca6c1b388db854: Status 404 returned error can't find the container with id 5886624dce3bfa7e42f95bbe04a45287c70ec85bc373409e93ca6c1b388db854 Jul 09 11:11:36.827694 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.827657 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:36.833897 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.833828 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hfdzs" Jul 09 11:11:36.838626 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:36.838594 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99c44de_f215_4688_b81e_9e4cdee6a0b0.slice/crio-b4ddb7d6094b15cf7f48f1ee60bf073f6145d2fd0022cf97da92fa8b0df71747 WatchSource:0}: Error finding container b4ddb7d6094b15cf7f48f1ee60bf073f6145d2fd0022cf97da92fa8b0df71747: Status 404 returned error can't find the container with id b4ddb7d6094b15cf7f48f1ee60bf073f6145d2fd0022cf97da92fa8b0df71747 Jul 09 11:11:36.841910 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.841852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" Jul 09 11:11:36.844456 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:36.844432 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ce5b35_3f21_4bf1_85c8_c7dec62a8da0.slice/crio-a3a16c7b1f7603277a0d749f24893aa2bdf1fa6846c9d444e9dbf177b531ff72 WatchSource:0}: Error finding container a3a16c7b1f7603277a0d749f24893aa2bdf1fa6846c9d444e9dbf177b531ff72: Status 404 returned error can't find the container with id a3a16c7b1f7603277a0d749f24893aa2bdf1fa6846c9d444e9dbf177b531ff72 Jul 09 11:11:36.852147 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.851971 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t5l5s" Jul 09 11:11:36.852316 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:36.852268 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308d51ce_b9e4_4750_8fb5_b481e2997518.slice/crio-21782ac7c9c9171c0ec901d3b942b7ed596f09b3d5c53bb13e26ca1a8ebc14ac WatchSource:0}: Error finding container 21782ac7c9c9171c0ec901d3b942b7ed596f09b3d5c53bb13e26ca1a8ebc14ac: Status 404 returned error can't find the container with id 21782ac7c9c9171c0ec901d3b942b7ed596f09b3d5c53bb13e26ca1a8ebc14ac Jul 09 11:11:36.858983 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.858963 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:11:36.864614 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:36.864582 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de16fdd_03a8_47ac_a739_71a61b51bf59.slice/crio-b3b65f946888a4dea098a1f2f09905ce550fb84c491150e66bb0aa0064c2b267 WatchSource:0}: Error finding container b3b65f946888a4dea098a1f2f09905ce550fb84c491150e66bb0aa0064c2b267: Status 404 returned error can't find the container with id b3b65f946888a4dea098a1f2f09905ce550fb84c491150e66bb0aa0064c2b267 Jul 09 11:11:36.866667 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.866641 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-px86s" Jul 09 11:11:36.870765 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:36.870684 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9af17ff_b25e_4c3b_b943_b44ad500bf65.slice/crio-e7cf2fb9ff204fa1f154e905b3a8969dd039219039408e4d5968fd6791c4b35a WatchSource:0}: Error finding container e7cf2fb9ff204fa1f154e905b3a8969dd039219039408e4d5968fd6791c4b35a: Status 404 returned error can't find the container with id e7cf2fb9ff204fa1f154e905b3a8969dd039219039408e4d5968fd6791c4b35a Jul 09 11:11:36.873774 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:36.873752 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nhrc4" Jul 09 11:11:36.877163 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:11:36.877135 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe189cd_446c_428a_87ff_d53bfe615da5.slice/crio-f4e7b6db5d65dea763840771dd6cc2004c5eff1933d9ca4ea50a02dc97972677 WatchSource:0}: Error finding container f4e7b6db5d65dea763840771dd6cc2004c5eff1933d9ca4ea50a02dc97972677: Status 404 returned error can't find the container with id f4e7b6db5d65dea763840771dd6cc2004c5eff1933d9ca4ea50a02dc97972677 Jul 09 11:11:37.062558 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.062519 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 11:11:37.121269 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.121181 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:37.121447 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:37.121376 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:37.121498 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:37.121462 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs podName:9a462c5b-8391-4aaa-a694-a1ef4effd722 nodeName:}" failed. No retries permitted until 2026-07-09 11:11:38.121420675 +0000 UTC m=+4.032265178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs") pod "network-metrics-daemon-h5dgn" (UID: "9a462c5b-8391-4aaa-a694-a1ef4effd722") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:37.222349 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.222276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:37.222497 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:37.222383 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:37.222497 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:37.222451 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret podName:3e079363-7a35-4ffd-a0e0-9763e5e6e0a6 nodeName:}" failed. No retries permitted until 2026-07-09 11:11:38.222436941 +0000 UTC m=+4.133281459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret") pod "global-pull-secret-syncer-4tp6c" (UID: "3e079363-7a35-4ffd-a0e0-9763e5e6e0a6") : object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:37.322738 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.322703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bm8\" (UniqueName: \"kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8\") pod \"network-check-target-55rts\" (UID: \"672a99ff-7087-4603-a419-f4594bc9cbfd\") " pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:37.322899 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:37.322871 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 11:11:37.322899 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:37.322894 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 11:11:37.323000 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:37.322908 2562 projected.go:196] Error preparing data for projected volume kube-api-access-j9bm8 for pod openshift-network-diagnostics/network-check-target-55rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:37.323000 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:37.322975 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8 podName:672a99ff-7087-4603-a419-f4594bc9cbfd nodeName:}" failed. No retries permitted until 2026-07-09 11:11:38.32296127 +0000 UTC m=+4.233805790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9bm8" (UniqueName: "kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8") pod "network-check-target-55rts" (UID: "672a99ff-7087-4603-a419-f4594bc9cbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:37.586770 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.586721 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 11:06:36 +0000 UTC" deadline="2027-12-24 14:37:19.451153665 +0000 UTC" Jul 09 11:11:37.586770 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.586767 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12795h25m41.864391756s" Jul 09 11:11:37.606411 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.606046 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:37.606411 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:37.606207 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:37.622416 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.622304 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" event={"ID":"e9af17ff-b25e-4c3b-b943-b44ad500bf65","Type":"ContainerStarted","Data":"e7cf2fb9ff204fa1f154e905b3a8969dd039219039408e4d5968fd6791c4b35a"} Jul 09 11:11:37.624388 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.624273 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t5l5s" event={"ID":"2de16fdd-03a8-47ac-a739-71a61b51bf59","Type":"ContainerStarted","Data":"b3b65f946888a4dea098a1f2f09905ce550fb84c491150e66bb0aa0064c2b267"} Jul 09 11:11:37.627937 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.627906 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" event={"ID":"308d51ce-b9e4-4750-8fb5-b481e2997518","Type":"ContainerStarted","Data":"21782ac7c9c9171c0ec901d3b942b7ed596f09b3d5c53bb13e26ca1a8ebc14ac"} Jul 09 11:11:37.629404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.629361 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hfdzs" event={"ID":"31ce5b35-3f21-4bf1-85c8-c7dec62a8da0","Type":"ContainerStarted","Data":"a3a16c7b1f7603277a0d749f24893aa2bdf1fa6846c9d444e9dbf177b531ff72"} Jul 09 11:11:37.632187 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.631707 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cfllx" event={"ID":"b99c44de-f215-4688-b81e-9e4cdee6a0b0","Type":"ContainerStarted","Data":"b4ddb7d6094b15cf7f48f1ee60bf073f6145d2fd0022cf97da92fa8b0df71747"} Jul 09 11:11:37.633346 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.633321 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btfhm" event={"ID":"0b0a1137-bae7-4ffe-867c-51ad32e22c15","Type":"ContainerStarted","Data":"5886624dce3bfa7e42f95bbe04a45287c70ec85bc373409e93ca6c1b388db854"} Jul 09 11:11:37.635216 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.635180 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" event={"ID":"ff73ec5c-d885-43c8-a2d9-c67962c82745","Type":"ContainerStarted","Data":"d9093a1f5d566dd2231d20254646a3473f6310e57ce85a86d5602f898c3d037e"} Jul 09 11:11:37.637635 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:37.637610 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px86s" event={"ID":"ebe189cd-446c-428a-87ff-d53bfe615da5","Type":"ContainerStarted","Data":"f4e7b6db5d65dea763840771dd6cc2004c5eff1933d9ca4ea50a02dc97972677"} Jul 09 11:11:38.128458 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:38.128401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:38.128636 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:38.128565 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:38.128636 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:38.128637 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs podName:9a462c5b-8391-4aaa-a694-a1ef4effd722 nodeName:}" failed. No retries permitted until 2026-07-09 11:11:40.128616488 +0000 UTC m=+6.039461013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs") pod "network-metrics-daemon-h5dgn" (UID: "9a462c5b-8391-4aaa-a694-a1ef4effd722") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:38.229133 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:38.229043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:38.229329 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:38.229300 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:38.229410 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:38.229369 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret podName:3e079363-7a35-4ffd-a0e0-9763e5e6e0a6 nodeName:}" failed. No retries permitted until 2026-07-09 11:11:40.229348242 +0000 UTC m=+6.140192762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret") pod "global-pull-secret-syncer-4tp6c" (UID: "3e079363-7a35-4ffd-a0e0-9763e5e6e0a6") : object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:38.322874 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:38.322814 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 11:11:38.329646 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:38.329606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bm8\" (UniqueName: \"kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8\") pod \"network-check-target-55rts\" (UID: \"672a99ff-7087-4603-a419-f4594bc9cbfd\") " pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:38.329893 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:38.329754 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 11:11:38.329893 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:38.329779 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 11:11:38.329893 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:38.329793 2562 projected.go:196] Error preparing data for projected volume kube-api-access-j9bm8 for pod openshift-network-diagnostics/network-check-target-55rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:38.329893 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:38.329852 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8 podName:672a99ff-7087-4603-a419-f4594bc9cbfd nodeName:}" failed. No retries permitted until 2026-07-09 11:11:40.329834262 +0000 UTC m=+6.240678773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9bm8" (UniqueName: "kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8") pod "network-check-target-55rts" (UID: "672a99ff-7087-4603-a419-f4594bc9cbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:38.587532 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:38.587420 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 11:06:36 +0000 UTC" deadline="2028-01-10 00:34:06.17566502 +0000 UTC" Jul 09 11:11:38.587532 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:38.587482 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13189h22m27.588188007s" Jul 09 11:11:38.609340 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:38.607915 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:38.609340 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:38.608045 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:38.609340 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:38.608125 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:38.609340 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:38.608193 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:38.648485 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:38.648182 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nhrc4" event={"ID":"30206edd-f1af-448c-a5c4-9a0aada264d4","Type":"ContainerStarted","Data":"d36fc771ccd931e24a6153b0edf6e16b75165b9f19f19098d0b78c289e0ba0b0"} Jul 09 11:11:39.606070 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:39.605440 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:39.606070 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:39.605625 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:39.665804 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:39.665028 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" event={"ID":"5f2626d80cf6adaad426dfc2322e4da8","Type":"ContainerStarted","Data":"4d5bc61e033cb503e8b816d00e6e7e31465dedd47e6797663c347a5d886ae303"} Jul 09 11:11:39.684213 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:39.684175 2562 generic.go:356] "Generic (PLEG): container finished" podID="8aa7ee406116a1f7fce36ddc8789b8d7" containerID="b96822e6d2fe951453877ced16015e16130e96ecf36a26dc5c2355cf93adbb28" exitCode=0 Jul 09 11:11:39.684934 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:39.684908 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" event={"ID":"8aa7ee406116a1f7fce36ddc8789b8d7","Type":"ContainerDied","Data":"b96822e6d2fe951453877ced16015e16130e96ecf36a26dc5c2355cf93adbb28"} Jul 09 11:11:39.701730 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:39.701228 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" podStartSLOduration=3.701205562 podStartE2EDuration="3.701205562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:11:39.681606584 +0000 UTC m=+5.592451091" watchObservedRunningTime="2026-07-09 11:11:39.701205562 +0000 UTC m=+5.612050089" Jul 09 11:11:40.149015 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:40.148979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:40.149195 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:40.149139 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:40.149262 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:40.149208 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs podName:9a462c5b-8391-4aaa-a694-a1ef4effd722 nodeName:}" failed. No retries permitted until 2026-07-09 11:11:44.149189513 +0000 UTC m=+10.060034032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs") pod "network-metrics-daemon-h5dgn" (UID: "9a462c5b-8391-4aaa-a694-a1ef4effd722") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:40.250292 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:40.250224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:40.250483 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:40.250438 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:40.250552 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:40.250505 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret podName:3e079363-7a35-4ffd-a0e0-9763e5e6e0a6 nodeName:}" failed. No retries permitted until 2026-07-09 11:11:44.250487032 +0000 UTC m=+10.161331544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret") pod "global-pull-secret-syncer-4tp6c" (UID: "3e079363-7a35-4ffd-a0e0-9763e5e6e0a6") : object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:40.351299 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:40.351250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bm8\" (UniqueName: \"kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8\") pod \"network-check-target-55rts\" (UID: \"672a99ff-7087-4603-a419-f4594bc9cbfd\") " pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:40.351493 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:40.351434 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 11:11:40.351493 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:40.351463 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 11:11:40.351493 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:40.351477 2562 projected.go:196] Error preparing data for projected volume kube-api-access-j9bm8 for pod openshift-network-diagnostics/network-check-target-55rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:40.351644 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:40.351548 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8 podName:672a99ff-7087-4603-a419-f4594bc9cbfd nodeName:}" failed. No retries permitted until 2026-07-09 11:11:44.351528911 +0000 UTC m=+10.262373420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9bm8" (UniqueName: "kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8") pod "network-check-target-55rts" (UID: "672a99ff-7087-4603-a419-f4594bc9cbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:40.605749 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:40.605659 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:40.605905 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:40.605800 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:40.606263 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:40.606122 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:40.606263 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:40.606235 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:41.606321 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:41.605771 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:41.606321 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:41.605903 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:42.605407 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:42.605345 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:42.605651 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:42.605471 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:42.605651 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:42.605513 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:42.605774 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:42.605654 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:43.605300 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:43.605250 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:43.605782 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:43.605416 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:44.185121 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:44.185084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:44.185316 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:44.185250 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:44.185407 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:44.185338 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs podName:9a462c5b-8391-4aaa-a694-a1ef4effd722 nodeName:}" failed. No retries permitted until 2026-07-09 11:11:52.185317779 +0000 UTC m=+18.096162292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs") pod "network-metrics-daemon-h5dgn" (UID: "9a462c5b-8391-4aaa-a694-a1ef4effd722") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:44.286700 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:44.286110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:44.286700 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:44.286330 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:44.286700 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:44.286401 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret podName:3e079363-7a35-4ffd-a0e0-9763e5e6e0a6 nodeName:}" failed. No retries permitted until 2026-07-09 11:11:52.286380935 +0000 UTC m=+18.197225497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret") pod "global-pull-secret-syncer-4tp6c" (UID: "3e079363-7a35-4ffd-a0e0-9763e5e6e0a6") : object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:44.387469 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:44.387402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bm8\" (UniqueName: \"kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8\") pod \"network-check-target-55rts\" (UID: \"672a99ff-7087-4603-a419-f4594bc9cbfd\") " pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:44.387655 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:44.387613 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 11:11:44.387655 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:44.387639 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 11:11:44.387655 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:44.387655 2562 projected.go:196] Error preparing data for projected volume kube-api-access-j9bm8 for pod openshift-network-diagnostics/network-check-target-55rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:44.387849 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:44.387717 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8 podName:672a99ff-7087-4603-a419-f4594bc9cbfd nodeName:}" failed. No retries permitted until 2026-07-09 11:11:52.38769646 +0000 UTC m=+18.298540967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9bm8" (UniqueName: "kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8") pod "network-check-target-55rts" (UID: "672a99ff-7087-4603-a419-f4594bc9cbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:44.606635 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:44.606142 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:44.606635 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:44.606249 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:44.607201 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:44.607178 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:44.607331 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:44.607308 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:45.605219 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:45.605132 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:45.605479 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:45.605450 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:46.605416 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:46.605384 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:46.605416 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:46.605405 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:46.605923 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:46.605510 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:46.605999 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:46.605919 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:47.605835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:47.605802 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:47.606271 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:47.605922 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:48.606108 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:48.606069 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:48.606614 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:48.606200 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:48.606614 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:48.606255 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:48.606614 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:48.606393 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:49.605690 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:49.605656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:49.605864 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:49.605785 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:50.605489 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:50.605452 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:50.605975 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:50.605451 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:50.605975 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:50.605594 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:50.605975 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:50.605668 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:51.605909 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:51.605873 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:51.606402 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:51.605992 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:52.245079 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:52.245032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:52.245242 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:52.245185 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:52.245298 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:52.245251 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs podName:9a462c5b-8391-4aaa-a694-a1ef4effd722 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:08.245235256 +0000 UTC m=+34.156079759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs") pod "network-metrics-daemon-h5dgn" (UID: "9a462c5b-8391-4aaa-a694-a1ef4effd722") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:11:52.345734 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:52.345692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:52.345891 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:52.345862 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:52.345954 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:52.345924 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret podName:3e079363-7a35-4ffd-a0e0-9763e5e6e0a6 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:08.345905798 +0000 UTC m=+34.256750311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret") pod "global-pull-secret-syncer-4tp6c" (UID: "3e079363-7a35-4ffd-a0e0-9763e5e6e0a6") : object "kube-system"/"original-pull-secret" not registered Jul 09 11:11:52.446727 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:52.446682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bm8\" (UniqueName: \"kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8\") pod \"network-check-target-55rts\" (UID: \"672a99ff-7087-4603-a419-f4594bc9cbfd\") " pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:52.446909 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:52.446862 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 11:11:52.446909 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:52.446885 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 11:11:52.446909 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:52.446896 2562 projected.go:196] Error preparing data for projected volume kube-api-access-j9bm8 for pod openshift-network-diagnostics/network-check-target-55rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:52.447034 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:52.446968 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8 podName:672a99ff-7087-4603-a419-f4594bc9cbfd nodeName:}" failed. No retries permitted until 2026-07-09 11:12:08.446953962 +0000 UTC m=+34.357798466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9bm8" (UniqueName: "kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8") pod "network-check-target-55rts" (UID: "672a99ff-7087-4603-a419-f4594bc9cbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:11:52.606070 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:52.606037 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:52.606558 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:52.606037 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:52.606558 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:52.606169 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:52.606558 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:52.606244 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:53.605852 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:53.605813 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:53.606026 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:53.605978 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:54.606381 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:54.606338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:54.606775 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:54.606344 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:54.606775 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:54.606459 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:54.606775 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:54.606554 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:55.605551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:55.605512 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:55.605777 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:55.605650 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:56.605814 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.605650 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:56.606525 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.605710 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:56.606525 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:56.605920 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:56.606525 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:56.605972 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:56.723863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.723150 2562 generic.go:356] "Generic (PLEG): container finished" podID="ebe189cd-446c-428a-87ff-d53bfe615da5" containerID="2650ec07bdd177b09782ad6acf457526b88f9abb16ab308a65f9cd0897bfe979" exitCode=0 Jul 09 11:11:56.725913 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.723277 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px86s" event={"ID":"ebe189cd-446c-428a-87ff-d53bfe615da5","Type":"ContainerDied","Data":"2650ec07bdd177b09782ad6acf457526b88f9abb16ab308a65f9cd0897bfe979"} Jul 09 11:11:56.727915 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.727879 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" event={"ID":"e9af17ff-b25e-4c3b-b943-b44ad500bf65","Type":"ContainerStarted","Data":"4485df77e2b40e24478fb526dedcf0ee209769ee809279032e97c93e6ff3b06b"} Jul 09 11:11:56.729595 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.729555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t5l5s" event={"ID":"2de16fdd-03a8-47ac-a739-71a61b51bf59","Type":"ContainerStarted","Data":"9f6525e9e0990aafd0530666b34c18a09b64f59057443b8c059780c5f0fd311c"} Jul 09 11:11:56.731013 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.730990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" event={"ID":"308d51ce-b9e4-4750-8fb5-b481e2997518","Type":"ContainerStarted","Data":"2be488d71c1aa13c1d379fbcf896f791cb8dc7884eda37454989b361f9ad484a"} Jul 09 11:11:56.732449 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.732423 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cfllx" event={"ID":"b99c44de-f215-4688-b81e-9e4cdee6a0b0","Type":"ContainerStarted","Data":"19ecdea19239f1706bf060ed8feff56a7127157a17edb900faf7c7f352d47cca"} Jul 09 11:11:56.733957 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.733931 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btfhm" event={"ID":"0b0a1137-bae7-4ffe-867c-51ad32e22c15","Type":"ContainerStarted","Data":"4a643082fccd3bdf74540b17cf0ae7055a36cf910d654c778b7dbfa2d9e3f7e5"} Jul 09 11:11:56.735327 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.735307 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" event={"ID":"ff73ec5c-d885-43c8-a2d9-c67962c82745","Type":"ContainerStarted","Data":"3b54cbd2d18593f4d36a044b31717c43a245e9d4680dd7478b9f73ec3ef2e90f"} Jul 09 11:11:56.736667 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.736646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nhrc4" event={"ID":"30206edd-f1af-448c-a5c4-9a0aada264d4","Type":"ContainerStarted","Data":"e772cf7f4bf931be2a9f5da37f6ece984ec9917d0c8c26488cbb605e1fd1c7fd"} Jul 09 11:11:56.738865 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.738665 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" event={"ID":"8aa7ee406116a1f7fce36ddc8789b8d7","Type":"ContainerStarted","Data":"da4755ad4bd36f992a3df26b8cf98770412cff88cee19d898d5a00eb4b46d53c"} Jul 09 11:11:56.829129 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.829084 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nhrc4" podStartSLOduration=5.088368851 podStartE2EDuration="22.82906828s" totalImagesPullingTime="17.740699429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:11:56.828841855 +0000 UTC m=+22.739686384" watchObservedRunningTime="2026-07-09 11:11:56.82906828 +0000 UTC m=+22.739912806" Jul 09 11:11:56.873854 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.873723 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cfllx" podStartSLOduration=11.889127429 podStartE2EDuration="22.873707591s" totalImagesPullingTime="10.984580162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:11:56.873490386 +0000 UTC m=+22.784334913" watchObservedRunningTime="2026-07-09 11:11:56.873707591 +0000 UTC m=+22.784552116" Jul 09 11:11:56.895848 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.895808 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t5l5s" podStartSLOduration=3.555710534 podStartE2EDuration="22.895789377s" totalImagesPullingTime="19.340078843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:11:56.895372379 +0000 UTC m=+22.806216906" watchObservedRunningTime="2026-07-09 11:11:56.895789377 +0000 UTC m=+22.806633902" Jul 09 11:11:56.914900 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.914860 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" podStartSLOduration=20.914844415 podStartE2EDuration="20.914844415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:11:56.91466743 +0000 UTC m=+22.825511958" watchObservedRunningTime="2026-07-09 11:11:56.914844415 +0000 UTC m=+22.825688941" Jul 09 11:11:56.941918 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.941870 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hq5vh" podStartSLOduration=3.526263425 podStartE2EDuration="22.941854101s" totalImagesPullingTime="19.415590676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:11:56.94146233 +0000 UTC m=+22.852306855" watchObservedRunningTime="2026-07-09 11:11:56.941854101 +0000 UTC m=+22.852698628" Jul 09 11:11:56.980691 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:56.980552 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-btfhm" podStartSLOduration=3.582870926 podStartE2EDuration="22.980528583s" totalImagesPullingTime="19.397657657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:11:56.980187588 +0000 UTC m=+22.891032114" watchObservedRunningTime="2026-07-09 11:11:56.980528583 +0000 UTC m=+22.891373111" Jul 09 11:11:57.578824 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.578787 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:57.579611 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.579586 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:57.605339 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.605310 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:57.605483 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:57.605417 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:57.719267 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.719244 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 11:11:57.743329 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.743306 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:11:57.743665 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.743642 2562 generic.go:356] "Generic (PLEG): container finished" podID="e9af17ff-b25e-4c3b-b943-b44ad500bf65" containerID="bb3b2c8af81449ef155de3a967429e35dfb0ed73eda7794e448e6e42c8ea0a9e" exitCode=1 Jul 09 11:11:57.743735 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.743713 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" event={"ID":"e9af17ff-b25e-4c3b-b943-b44ad500bf65","Type":"ContainerStarted","Data":"0dff84a86e1171ae44a8761d4165183ab2af694e4ee9c8f65fae5af03a4d704d"} Jul 09 11:11:57.743795 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.743784 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" event={"ID":"e9af17ff-b25e-4c3b-b943-b44ad500bf65","Type":"ContainerStarted","Data":"5f44dab5a9badf5341739845dd34685a0ee4a9cc36a0064db4b6682f9dd77f4c"} Jul 09 11:11:57.743849 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.743820 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" event={"ID":"e9af17ff-b25e-4c3b-b943-b44ad500bf65","Type":"ContainerStarted","Data":"ee4cdb31b66e9b41b5d40e8ff4c44e1190ca6c9792b4b84ce3c74a4f143008cd"} Jul 09 11:11:57.743900 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.743857 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" event={"ID":"e9af17ff-b25e-4c3b-b943-b44ad500bf65","Type":"ContainerStarted","Data":"d3bf4ab8212aae6d4a0d8254e4f21a7d38e34f52099a341bc8227e8f4ef6058b"} Jul 09 11:11:57.743900 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.743885 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" event={"ID":"e9af17ff-b25e-4c3b-b943-b44ad500bf65","Type":"ContainerDied","Data":"bb3b2c8af81449ef155de3a967429e35dfb0ed73eda7794e448e6e42c8ea0a9e"} Jul 09 11:11:57.745382 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.745357 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" event={"ID":"308d51ce-b9e4-4750-8fb5-b481e2997518","Type":"ContainerStarted","Data":"e003130bf79196da46b8ae429ee69f56d381ee83273dce7870134834c61ee37c"} Jul 09 11:11:57.746665 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.746637 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hfdzs" event={"ID":"31ce5b35-3f21-4bf1-85c8-c7dec62a8da0","Type":"ContainerStarted","Data":"07bde68b8840dfa751b9442c9a0f0a7ca02f4d6c1ef3fd0a53585a305236724a"} Jul 09 11:11:57.747525 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.747511 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:57.747905 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.747889 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cfllx" Jul 09 11:11:57.767045 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:57.766997 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hfdzs" podStartSLOduration=4.387001911 podStartE2EDuration="23.766982683s" totalImagesPullingTime="19.379980772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:11:57.766587807 +0000 UTC m=+23.677432330" watchObservedRunningTime="2026-07-09 11:11:57.766982683 +0000 UTC m=+23.677827208" Jul 09 11:11:58.581135 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:58.581008 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T11:11:57.719261975Z","UUID":"66a62d77-a0aa-4119-b355-c5b9f95ccae5","Handler":null,"Name":"","Endpoint":""} Jul 09 11:11:58.582813 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:58.582791 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 11:11:58.582944 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:58.582835 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 11:11:58.609458 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:58.609427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:11:58.609458 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:58.609459 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:11:58.609682 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:58.609564 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:11:58.609726 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:58.609675 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:11:59.605540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:59.605352 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:11:59.606053 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:11:59.605691 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:11:59.754029 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:59.754002 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:11:59.754457 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:59.754432 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" event={"ID":"e9af17ff-b25e-4c3b-b943-b44ad500bf65","Type":"ContainerStarted","Data":"198bc002787834da8458ddc29128d8bf0a72fe61be7f6766dfb76a7e5a5a06af"} Jul 09 11:11:59.756411 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:59.756389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" event={"ID":"308d51ce-b9e4-4750-8fb5-b481e2997518","Type":"ContainerStarted","Data":"178bf040e30d3989e3f95d643fb31d9bec40abbc0397dbe6417978caebae4d63"} Jul 09 11:11:59.787912 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:11:59.786509 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zbjm" podStartSLOduration=4.092141127 podStartE2EDuration="25.786487404s" totalImagesPullingTime="21.694346277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:11:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:11:59.785466186 +0000 UTC m=+25.696310717" watchObservedRunningTime="2026-07-09 11:11:59.786487404 +0000 UTC m=+25.697331931" Jul 09 11:12:00.605315 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:00.605267 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:12:00.605634 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:00.605415 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:12:00.605634 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:00.605455 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:12:00.605634 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:00.605533 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:12:01.605911 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:01.605872 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:12:01.606427 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:01.606005 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:12:02.605622 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:02.605433 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:12:02.605622 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:02.605433 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:12:02.605861 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:02.605712 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:12:02.605861 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:02.605747 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:12:02.765482 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:02.765394 2562 generic.go:356] "Generic (PLEG): container finished" podID="ebe189cd-446c-428a-87ff-d53bfe615da5" containerID="276f7ecbc74db8927b7d45aeacf7070add8eb74de817778398f6892fefb2dc60" exitCode=0 Jul 09 11:12:02.766118 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:02.765485 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px86s" event={"ID":"ebe189cd-446c-428a-87ff-d53bfe615da5","Type":"ContainerDied","Data":"276f7ecbc74db8927b7d45aeacf7070add8eb74de817778398f6892fefb2dc60"} Jul 09 11:12:02.769216 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:02.769196 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:12:02.769587 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:02.769548 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" event={"ID":"e9af17ff-b25e-4c3b-b943-b44ad500bf65","Type":"ContainerStarted","Data":"ce4738dd3ccfdfd83cbc3e07345a8d28ae38960b113fa77c58f76df0472bd1fb"} Jul 09 11:12:02.769836 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:02.769809 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:12:02.770004 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:02.769987 2562 scope.go:117] "RemoveContainer" containerID="bb3b2c8af81449ef155de3a967429e35dfb0ed73eda7794e448e6e42c8ea0a9e" Jul 09 11:12:02.786724 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:02.786692 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:12:03.605886 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:03.605854 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:12:03.606034 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:03.605966 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:12:03.775919 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:03.775887 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:12:03.776363 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:03.776224 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" event={"ID":"e9af17ff-b25e-4c3b-b943-b44ad500bf65","Type":"ContainerStarted","Data":"e8cc821fb366b15d33e5fa38369d8206f4c696f48d34c809f3b4fd8c48055846"} Jul 09 11:12:03.776435 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:03.776415 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:12:03.776542 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:03.776490 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:12:03.791929 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:03.791903 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:12:03.809032 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:03.808980 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" podStartSLOduration=10.107798901 podStartE2EDuration="29.808964326s" totalImagesPullingTime="19.701165425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:12:03.807077657 +0000 UTC m=+29.717922183" watchObservedRunningTime="2026-07-09 11:12:03.808964326 +0000 UTC m=+29.719808854" Jul 09 11:12:04.264924 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:04.264827 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h5dgn"] Jul 09 11:12:04.265065 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:04.264966 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:12:04.265109 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:04.265082 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:12:04.265550 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:04.265529 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4tp6c"] Jul 09 11:12:04.265629 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:04.265623 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:12:04.265708 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:04.265691 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:12:04.267245 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:04.267223 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-55rts"] Jul 09 11:12:04.267349 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:04.267333 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:12:04.267446 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:04.267424 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:12:04.780834 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:04.780634 2562 generic.go:356] "Generic (PLEG): container finished" podID="ebe189cd-446c-428a-87ff-d53bfe615da5" containerID="c898d44612e9d67387cffbb37e43a6eea8d233e143b6ad5e9329baae3034a4ea" exitCode=0 Jul 09 11:12:04.781272 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:04.780691 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px86s" event={"ID":"ebe189cd-446c-428a-87ff-d53bfe615da5","Type":"ContainerDied","Data":"c898d44612e9d67387cffbb37e43a6eea8d233e143b6ad5e9329baae3034a4ea"} Jul 09 11:12:05.605666 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:05.605635 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:12:05.605666 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:05.605660 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:12:05.605855 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:05.605665 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:12:05.605855 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:05.605740 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:12:05.605855 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:05.605842 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:12:05.605979 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:05.605927 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:12:06.787984 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:06.787950 2562 generic.go:356] "Generic (PLEG): container finished" podID="ebe189cd-446c-428a-87ff-d53bfe615da5" containerID="da17691576d8e6f5b5e1f1d8c3e79cbe105571b63f8b601f8edc327a44108138" exitCode=0 Jul 09 11:12:06.788609 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:06.788015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px86s" event={"ID":"ebe189cd-446c-428a-87ff-d53bfe615da5","Type":"ContainerDied","Data":"da17691576d8e6f5b5e1f1d8c3e79cbe105571b63f8b601f8edc327a44108138"} Jul 09 11:12:07.605446 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:07.605406 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:12:07.605654 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:07.605451 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:12:07.605654 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:07.605452 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:12:07.605654 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:07.605533 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tp6c" podUID="3e079363-7a35-4ffd-a0e0-9763e5e6e0a6" Jul 09 11:12:07.605814 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:07.605678 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55rts" podUID="672a99ff-7087-4603-a419-f4594bc9cbfd" Jul 09 11:12:07.605814 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:07.605759 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:12:08.269678 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:08.269641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:12:08.270389 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:08.269797 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:12:08.270389 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:08.269859 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs podName:9a462c5b-8391-4aaa-a694-a1ef4effd722 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:40.269841561 +0000 UTC m=+66.180686084 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs") pod "network-metrics-daemon-h5dgn" (UID: "9a462c5b-8391-4aaa-a694-a1ef4effd722") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 11:12:08.370937 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:08.370901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:12:08.371109 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:08.371038 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 11:12:08.371109 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:08.371104 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret podName:3e079363-7a35-4ffd-a0e0-9763e5e6e0a6 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:40.371086239 +0000 UTC m=+66.281930750 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret") pod "global-pull-secret-syncer-4tp6c" (UID: "3e079363-7a35-4ffd-a0e0-9763e5e6e0a6") : object "kube-system"/"original-pull-secret" not registered Jul 09 11:12:08.471624 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:08.471590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bm8\" (UniqueName: \"kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8\") pod \"network-check-target-55rts\" (UID: \"672a99ff-7087-4603-a419-f4594bc9cbfd\") " pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:12:08.471786 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:08.471750 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 11:12:08.471786 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:08.471767 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 11:12:08.471786 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:08.471778 2562 projected.go:196] Error preparing data for projected volume kube-api-access-j9bm8 for pod openshift-network-diagnostics/network-check-target-55rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:12:08.471898 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:08.471835 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8 podName:672a99ff-7087-4603-a419-f4594bc9cbfd nodeName:}" failed. No retries permitted until 2026-07-09 11:12:40.471819877 +0000 UTC m=+66.382664401 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9bm8" (UniqueName: "kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8") pod "network-check-target-55rts" (UID: "672a99ff-7087-4603-a419-f4594bc9cbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 11:12:09.373596 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.373548 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeReady" Jul 09 11:12:09.374060 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.373718 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 11:12:09.426861 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.426817 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc"] Jul 09 11:12:09.428816 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.428790 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-96767b5b5-zmtlw"] Jul 09 11:12:09.428974 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.428930 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:09.430748 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.430728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.452597 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.452568 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 11:12:09.452730 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.452608 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 11:12:09.452730 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.452619 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mcsj2\"" Jul 09 11:12:09.453072 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.453052 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 11:12:09.453291 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.453264 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5q9mj\"" Jul 09 11:12:09.454464 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.454447 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 11:12:09.455065 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.454924 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 11:12:09.456305 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.456263 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc"] Jul 09 11:12:09.459748 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.459693 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-96767b5b5-zmtlw"] Jul 09 11:12:09.468681 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.468659 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 11:12:09.479014 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.478987 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x7qvq"] Jul 09 11:12:09.480884 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.480861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.484877 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.484853 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6pmqk\"" Jul 09 11:12:09.485232 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.485204 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 11:12:09.485331 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.485259 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 11:12:09.488815 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.488733 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l9dl7"] Jul 09 11:12:09.490584 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.490553 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l9dl7" Jul 09 11:12:09.493531 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.493511 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 11:12:09.493962 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.493943 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 11:12:09.494061 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.494045 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 11:12:09.494221 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.494204 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8jsqk\"" Jul 09 11:12:09.507572 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.507542 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x7qvq"] Jul 09 11:12:09.510489 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.510462 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l9dl7"] Jul 09 11:12:09.579855 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.579826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v74z\" (UniqueName: \"kubernetes.io/projected/7c5ca9ec-f699-4051-a7ec-24010d1bd331-kube-api-access-7v74z\") pod \"ingress-canary-l9dl7\" (UID: \"7c5ca9ec-f699-4051-a7ec-24010d1bd331\") " pod="openshift-ingress-canary/ingress-canary-l9dl7" Jul 09 11:12:09.579855 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.579859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:09.580086 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.579891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c73e118a-de16-4c50-95f8-3b96314365b8-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:09.580086 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.579919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a3acf38-52b2-4368-834a-35ec650fa955-config-volume\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.580086 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.579985 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xk8m\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-kube-api-access-7xk8m\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.580086 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.580029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c049af70-6066-4edb-a95e-257d9f6b6307-ca-trust-extracted\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.580086 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.580045 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-installation-pull-secrets\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.580086 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.580087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.580394 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.580124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-image-registry-private-configuration\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.580394 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.580145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a3acf38-52b2-4368-834a-35ec650fa955-tmp-dir\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.580394 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.580207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c5ca9ec-f699-4051-a7ec-24010d1bd331-cert\") pod \"ingress-canary-l9dl7\" (UID: \"7c5ca9ec-f699-4051-a7ec-24010d1bd331\") " pod="openshift-ingress-canary/ingress-canary-l9dl7" Jul 09 11:12:09.580394 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.580238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76fpp\" (UniqueName: \"kubernetes.io/projected/4a3acf38-52b2-4368-834a-35ec650fa955-kube-api-access-76fpp\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.580394 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.580269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-trusted-ca\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.580394 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.580358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-registry-certificates\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.580394 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.580380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-bound-sa-token\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.580649 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.580406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.605779 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.605748 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:12:09.605960 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.605855 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:12:09.606066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.606030 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:12:09.608754 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.608703 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 11:12:09.608959 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.608893 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 11:12:09.609075 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.609053 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 11:12:09.609171 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.609161 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dn2v5\"" Jul 09 11:12:09.609450 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.609429 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 11:12:09.609594 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.609550 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h6b4g\"" Jul 09 11:12:09.681780 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.681738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-registry-certificates\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.681780 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.681776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-bound-sa-token\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.682034 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.681805 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.682034 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:09.681907 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 11:12:09.682034 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:09.681967 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls podName:4a3acf38-52b2-4368-834a-35ec650fa955 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:10.181948122 +0000 UTC m=+36.092792626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls") pod "dns-default-x7qvq" (UID: "4a3acf38-52b2-4368-834a-35ec650fa955") : secret "dns-default-metrics-tls" not found Jul 09 11:12:09.682185 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v74z\" (UniqueName: \"kubernetes.io/projected/7c5ca9ec-f699-4051-a7ec-24010d1bd331-kube-api-access-7v74z\") pod \"ingress-canary-l9dl7\" (UID: \"7c5ca9ec-f699-4051-a7ec-24010d1bd331\") " pod="openshift-ingress-canary/ingress-canary-l9dl7" Jul 09 11:12:09.682185 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:09.682315 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:09.682243 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 11:12:09.682315 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:09.682310 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert podName:c73e118a-de16-4c50-95f8-3b96314365b8 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:10.182270266 +0000 UTC m=+36.093114785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ws6jc" (UID: "c73e118a-de16-4c50-95f8-3b96314365b8") : secret "networking-console-plugin-cert" not found Jul 09 11:12:09.682430 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c73e118a-de16-4c50-95f8-3b96314365b8-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:09.682430 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a3acf38-52b2-4368-834a-35ec650fa955-config-volume\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.682430 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xk8m\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-kube-api-access-7xk8m\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.682569 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c049af70-6066-4edb-a95e-257d9f6b6307-ca-trust-extracted\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.682569 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-installation-pull-secrets\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.682569 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.682569 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-registry-certificates\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.682569 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-image-registry-private-configuration\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.682805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a3acf38-52b2-4368-834a-35ec650fa955-tmp-dir\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.682805 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:09.682625 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 11:12:09.682805 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:09.682641 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96767b5b5-zmtlw: secret "image-registry-tls" not found Jul 09 11:12:09.682805 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:09.682695 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls podName:c049af70-6066-4edb-a95e-257d9f6b6307 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:10.182678607 +0000 UTC m=+36.093523113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls") pod "image-registry-96767b5b5-zmtlw" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307") : secret "image-registry-tls" not found Jul 09 11:12:09.683052 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682906 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a3acf38-52b2-4368-834a-35ec650fa955-tmp-dir\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.683052 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682965 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c5ca9ec-f699-4051-a7ec-24010d1bd331-cert\") pod \"ingress-canary-l9dl7\" (UID: \"7c5ca9ec-f699-4051-a7ec-24010d1bd331\") " pod="openshift-ingress-canary/ingress-canary-l9dl7" Jul 09 11:12:09.683052 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.682991 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76fpp\" (UniqueName: \"kubernetes.io/projected/4a3acf38-52b2-4368-834a-35ec650fa955-kube-api-access-76fpp\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.683052 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.683020 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-trusted-ca\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.683052 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.683037 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c73e118a-de16-4c50-95f8-3b96314365b8-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:09.683325 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.683153 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a3acf38-52b2-4368-834a-35ec650fa955-config-volume\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.684225 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.683978 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-trusted-ca\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.684392 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.684371 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c049af70-6066-4edb-a95e-257d9f6b6307-ca-trust-extracted\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.688162 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.688138 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-image-registry-private-configuration\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.688320 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.688177 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c5ca9ec-f699-4051-a7ec-24010d1bd331-cert\") pod \"ingress-canary-l9dl7\" (UID: \"7c5ca9ec-f699-4051-a7ec-24010d1bd331\") " pod="openshift-ingress-canary/ingress-canary-l9dl7" Jul 09 11:12:09.688434 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.688418 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-installation-pull-secrets\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.691732 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.691712 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v74z\" (UniqueName: \"kubernetes.io/projected/7c5ca9ec-f699-4051-a7ec-24010d1bd331-kube-api-access-7v74z\") pod \"ingress-canary-l9dl7\" (UID: \"7c5ca9ec-f699-4051-a7ec-24010d1bd331\") " pod="openshift-ingress-canary/ingress-canary-l9dl7" Jul 09 11:12:09.696231 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.696211 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-bound-sa-token\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.698330 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.698268 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfllx_b99c44de-f215-4688-b81e-9e4cdee6a0b0/konnectivity-agent/0.log" limit=1024 Jul 09 11:12:09.702459 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.702425 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xk8m\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-kube-api-access-7xk8m\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:09.703544 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.703521 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76fpp\" (UniqueName: \"kubernetes.io/projected/4a3acf38-52b2-4368-834a-35ec650fa955-kube-api-access-76fpp\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:09.800053 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.800023 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l9dl7" Jul 09 11:12:09.859877 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.859821 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfllx_b99c44de-f215-4688-b81e-9e4cdee6a0b0/konnectivity-agent/0.log" limit=1024 Jul 09 11:12:09.959721 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:09.959582 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfllx_b99c44de-f215-4688-b81e-9e4cdee6a0b0/konnectivity-agent/0.log" limit=1024 Jul 09 11:12:10.187761 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:10.187724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:10.187761 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:10.187768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:10.188006 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:10.187815 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:10.188006 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:10.187899 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 11:12:10.188006 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:10.187960 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 11:12:10.188006 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:10.187994 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls podName:4a3acf38-52b2-4368-834a-35ec650fa955 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:11.18796998 +0000 UTC m=+37.098814498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls") pod "dns-default-x7qvq" (UID: "4a3acf38-52b2-4368-834a-35ec650fa955") : secret "dns-default-metrics-tls" not found Jul 09 11:12:10.188202 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:10.188026 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert podName:c73e118a-de16-4c50-95f8-3b96314365b8 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:11.188006203 +0000 UTC m=+37.098850709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ws6jc" (UID: "c73e118a-de16-4c50-95f8-3b96314365b8") : secret "networking-console-plugin-cert" not found Jul 09 11:12:10.188202 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:10.187964 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 11:12:10.188202 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:10.188045 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96767b5b5-zmtlw: secret "image-registry-tls" not found Jul 09 11:12:10.188202 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:10.188084 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls podName:c049af70-6066-4edb-a95e-257d9f6b6307 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:11.188073246 +0000 UTC m=+37.098917754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls") pod "image-registry-96767b5b5-zmtlw" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307") : secret "image-registry-tls" not found Jul 09 11:12:11.111739 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:11.111705 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l9dl7"] Jul 09 11:12:11.118019 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:12:11.117995 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5ca9ec_f699_4051_a7ec_24010d1bd331.slice/crio-8679642a81df84a4d94935eb1d9c108d5d600e3000ad37c047c5cb414ba30953 WatchSource:0}: Error finding container 8679642a81df84a4d94935eb1d9c108d5d600e3000ad37c047c5cb414ba30953: Status 404 returned error can't find the container with id 8679642a81df84a4d94935eb1d9c108d5d600e3000ad37c047c5cb414ba30953 Jul 09 11:12:11.196217 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:11.196188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:11.196366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:11.196246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:11.196366 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:11.196350 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 11:12:11.196366 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:11.196361 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96767b5b5-zmtlw: secret "image-registry-tls" not found Jul 09 11:12:11.196509 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:11.196365 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 11:12:11.196509 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:11.196417 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls podName:c049af70-6066-4edb-a95e-257d9f6b6307 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:13.19640345 +0000 UTC m=+39.107247975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls") pod "image-registry-96767b5b5-zmtlw" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307") : secret "image-registry-tls" not found Jul 09 11:12:11.196509 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:11.196481 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert podName:c73e118a-de16-4c50-95f8-3b96314365b8 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:13.196463909 +0000 UTC m=+39.107308424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ws6jc" (UID: "c73e118a-de16-4c50-95f8-3b96314365b8") : secret "networking-console-plugin-cert" not found Jul 09 11:12:11.196616 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:11.196556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:11.196673 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:11.196661 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 11:12:11.196714 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:11.196705 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls podName:4a3acf38-52b2-4368-834a-35ec650fa955 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:13.196694192 +0000 UTC m=+39.107538712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls") pod "dns-default-x7qvq" (UID: "4a3acf38-52b2-4368-834a-35ec650fa955") : secret "dns-default-metrics-tls" not found Jul 09 11:12:11.802801 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:11.802766 2562 generic.go:356] "Generic (PLEG): container finished" podID="ebe189cd-446c-428a-87ff-d53bfe615da5" containerID="8534340985fbedd56c7659a1ca2de048a955bd1175290f5b6b876fe1425c79ea" exitCode=0 Jul 09 11:12:11.802996 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:11.802849 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px86s" event={"ID":"ebe189cd-446c-428a-87ff-d53bfe615da5","Type":"ContainerDied","Data":"8534340985fbedd56c7659a1ca2de048a955bd1175290f5b6b876fe1425c79ea"} Jul 09 11:12:11.803976 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:11.803950 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l9dl7" event={"ID":"7c5ca9ec-f699-4051-a7ec-24010d1bd331","Type":"ContainerStarted","Data":"8679642a81df84a4d94935eb1d9c108d5d600e3000ad37c047c5cb414ba30953"} Jul 09 11:12:12.808922 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:12.808749 2562 generic.go:356] "Generic (PLEG): container finished" podID="ebe189cd-446c-428a-87ff-d53bfe615da5" containerID="e87934048958297afeb5509578dcb6be519371f7bad8aefc11b30ecf92d7cc0b" exitCode=0 Jul 09 11:12:12.809391 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:12.808825 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px86s" event={"ID":"ebe189cd-446c-428a-87ff-d53bfe615da5","Type":"ContainerDied","Data":"e87934048958297afeb5509578dcb6be519371f7bad8aefc11b30ecf92d7cc0b"} Jul 09 11:12:13.214167 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:13.214127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:13.214375 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:13.214212 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:13.214375 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:13.214240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:13.214375 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:13.214313 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 11:12:13.214375 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:13.214335 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96767b5b5-zmtlw: secret "image-registry-tls" not found Jul 09 11:12:13.214375 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:13.214366 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 11:12:13.214631 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:13.214393 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 11:12:13.214631 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:13.214406 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls podName:c049af70-6066-4edb-a95e-257d9f6b6307 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:17.214384559 +0000 UTC m=+43.125229084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls") pod "image-registry-96767b5b5-zmtlw" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307") : secret "image-registry-tls" not found Jul 09 11:12:13.214631 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:13.214425 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert podName:c73e118a-de16-4c50-95f8-3b96314365b8 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:17.214416114 +0000 UTC m=+43.125260617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ws6jc" (UID: "c73e118a-de16-4c50-95f8-3b96314365b8") : secret "networking-console-plugin-cert" not found Jul 09 11:12:13.214631 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:13.214451 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls podName:4a3acf38-52b2-4368-834a-35ec650fa955 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:17.214431934 +0000 UTC m=+43.125276441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls") pod "dns-default-x7qvq" (UID: "4a3acf38-52b2-4368-834a-35ec650fa955") : secret "dns-default-metrics-tls" not found Jul 09 11:12:13.692759 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:13.692726 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfllx_b99c44de-f215-4688-b81e-9e4cdee6a0b0/konnectivity-agent/0.log" limit=1024 Jul 09 11:12:13.795338 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:13.795304 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfllx_b99c44de-f215-4688-b81e-9e4cdee6a0b0/konnectivity-agent/0.log" limit=1024 Jul 09 11:12:13.815554 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:13.815503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-px86s" event={"ID":"ebe189cd-446c-428a-87ff-d53bfe615da5","Type":"ContainerStarted","Data":"c8448e0c4a542d756c15e21a85dedb8f4dcc01be1be2df91ed08959166f9b9df"} Jul 09 11:12:13.863977 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:13.863923 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-px86s" podStartSLOduration=8.632301712 podStartE2EDuration="39.86389939s" totalImagesPullingTime="31.231597678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:11:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:12:13.863273442 +0000 UTC m=+39.774118008" watchObservedRunningTime="2026-07-09 11:12:13.86389939 +0000 UTC m=+39.774743915" Jul 09 11:12:14.010143 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:14.010057 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfllx_b99c44de-f215-4688-b81e-9e4cdee6a0b0/konnectivity-agent/0.log" limit=1024 Jul 09 11:12:14.107023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:14.106988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfllx_b99c44de-f215-4688-b81e-9e4cdee6a0b0/konnectivity-agent/0.log" limit=1024 Jul 09 11:12:14.819059 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:14.819021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l9dl7" event={"ID":"7c5ca9ec-f699-4051-a7ec-24010d1bd331","Type":"ContainerStarted","Data":"4ca7e5f5f969362960d6bcabcb1848a1d8a7ae8e48ee6a5a410b5530bee8ad0b"} Jul 09 11:12:14.837138 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:14.837087 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l9dl7" podStartSLOduration=2.680232638 podStartE2EDuration="5.837072867s" totalImagesPullingTime="3.156840229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:12:14.836100834 +0000 UTC m=+40.746945380" watchObservedRunningTime="2026-07-09 11:12:14.837072867 +0000 UTC m=+40.747917452" Jul 09 11:12:17.246486 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:17.246440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:17.246969 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:17.246531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:17.246969 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:17.246558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:17.246969 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:17.246581 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 11:12:17.246969 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:17.246607 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96767b5b5-zmtlw: secret "image-registry-tls" not found Jul 09 11:12:17.246969 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:17.246665 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 11:12:17.246969 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:17.246681 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls podName:c049af70-6066-4edb-a95e-257d9f6b6307 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:25.246662229 +0000 UTC m=+51.157506749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls") pod "image-registry-96767b5b5-zmtlw" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307") : secret "image-registry-tls" not found Jul 09 11:12:17.246969 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:17.246710 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert podName:c73e118a-de16-4c50-95f8-3b96314365b8 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:25.246698381 +0000 UTC m=+51.157542884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ws6jc" (UID: "c73e118a-de16-4c50-95f8-3b96314365b8") : secret "networking-console-plugin-cert" not found Jul 09 11:12:17.246969 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:17.246667 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 11:12:17.246969 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:17.246734 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls podName:4a3acf38-52b2-4368-834a-35ec650fa955 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:25.246726189 +0000 UTC m=+51.157570693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls") pod "dns-default-x7qvq" (UID: "4a3acf38-52b2-4368-834a-35ec650fa955") : secret "dns-default-metrics-tls" not found Jul 09 11:12:25.305501 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:25.305459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:25.305501 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:25.305505 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:25.306025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:25.305554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:25.306025 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:25.305629 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 11:12:25.306025 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:25.305656 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 11:12:25.306025 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:25.305682 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96767b5b5-zmtlw: secret "image-registry-tls" not found Jul 09 11:12:25.306025 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:25.305684 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 11:12:25.306025 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:25.305700 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls podName:4a3acf38-52b2-4368-834a-35ec650fa955 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:41.305683143 +0000 UTC m=+67.216527662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls") pod "dns-default-x7qvq" (UID: "4a3acf38-52b2-4368-834a-35ec650fa955") : secret "dns-default-metrics-tls" not found Jul 09 11:12:25.306025 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:25.305719 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls podName:c049af70-6066-4edb-a95e-257d9f6b6307 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:41.305708488 +0000 UTC m=+67.216552992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls") pod "image-registry-96767b5b5-zmtlw" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307") : secret "image-registry-tls" not found Jul 09 11:12:25.306025 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:25.305732 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert podName:c73e118a-de16-4c50-95f8-3b96314365b8 nodeName:}" failed. No retries permitted until 2026-07-09 11:12:41.305726196 +0000 UTC m=+67.216570700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ws6jc" (UID: "c73e118a-de16-4c50-95f8-3b96314365b8") : secret "networking-console-plugin-cert" not found Jul 09 11:12:35.798980 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:35.798950 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f672m" Jul 09 11:12:40.321578 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.321529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:12:40.324628 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.324606 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 11:12:40.332275 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:40.332254 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 11:12:40.332365 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:40.332355 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs podName:9a462c5b-8391-4aaa-a694-a1ef4effd722 nodeName:}" failed. No retries permitted until 2026-07-09 11:13:44.332335905 +0000 UTC m=+130.243180408 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs") pod "network-metrics-daemon-h5dgn" (UID: "9a462c5b-8391-4aaa-a694-a1ef4effd722") : secret "metrics-daemon-secret" not found Jul 09 11:12:40.422389 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.422344 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:12:40.425573 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.425552 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 11:12:40.436326 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.436297 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e079363-7a35-4ffd-a0e0-9763e5e6e0a6-original-pull-secret\") pod \"global-pull-secret-syncer-4tp6c\" (UID: \"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6\") " pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:12:40.523037 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.522980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bm8\" (UniqueName: \"kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8\") pod \"network-check-target-55rts\" (UID: \"672a99ff-7087-4603-a419-f4594bc9cbfd\") " pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:12:40.526306 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.526275 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 11:12:40.529534 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.529518 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tp6c" Jul 09 11:12:40.536739 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.536712 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 11:12:40.546914 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.546891 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9bm8\" (UniqueName: \"kubernetes.io/projected/672a99ff-7087-4603-a419-f4594bc9cbfd-kube-api-access-j9bm8\") pod \"network-check-target-55rts\" (UID: \"672a99ff-7087-4603-a419-f4594bc9cbfd\") " pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:12:40.667832 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.667801 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4tp6c"] Jul 09 11:12:40.671480 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:12:40.671454 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e079363_7a35_4ffd_a0e0_9763e5e6e0a6.slice/crio-f4095c6067b0dc19efbdf23cca0cbd8cc0da4d0162fcf2809aa956dc3a029ca9 WatchSource:0}: Error finding container f4095c6067b0dc19efbdf23cca0cbd8cc0da4d0162fcf2809aa956dc3a029ca9: Status 404 returned error can't find the container with id f4095c6067b0dc19efbdf23cca0cbd8cc0da4d0162fcf2809aa956dc3a029ca9 Jul 09 11:12:40.820226 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.820201 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dn2v5\"" Jul 09 11:12:40.827871 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.827844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:12:40.880833 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.880793 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4tp6c" event={"ID":"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6","Type":"ContainerStarted","Data":"f4095c6067b0dc19efbdf23cca0cbd8cc0da4d0162fcf2809aa956dc3a029ca9"} Jul 09 11:12:40.951896 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:40.951871 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-55rts"] Jul 09 11:12:40.954109 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:12:40.954084 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672a99ff_7087_4603_a419_f4594bc9cbfd.slice/crio-93680f5b3d895508854043aa27627a1ea524ae947447d6651fb2378a66c82f80 WatchSource:0}: Error finding container 93680f5b3d895508854043aa27627a1ea524ae947447d6651fb2378a66c82f80: Status 404 returned error can't find the container with id 93680f5b3d895508854043aa27627a1ea524ae947447d6651fb2378a66c82f80 Jul 09 11:12:41.328483 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:41.328453 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:12:41.328841 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:41.328494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:12:41.328841 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:41.328544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:12:41.328841 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:41.328624 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 11:12:41.328841 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:41.328662 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 11:12:41.328841 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:41.328631 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 11:12:41.328841 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:41.328701 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls podName:4a3acf38-52b2-4368-834a-35ec650fa955 nodeName:}" failed. No retries permitted until 2026-07-09 11:13:13.328680927 +0000 UTC m=+99.239525433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls") pod "dns-default-x7qvq" (UID: "4a3acf38-52b2-4368-834a-35ec650fa955") : secret "dns-default-metrics-tls" not found Jul 09 11:12:41.328841 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:41.328703 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96767b5b5-zmtlw: secret "image-registry-tls" not found Jul 09 11:12:41.328841 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:41.328720 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert podName:c73e118a-de16-4c50-95f8-3b96314365b8 nodeName:}" failed. No retries permitted until 2026-07-09 11:13:13.328709871 +0000 UTC m=+99.239554376 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ws6jc" (UID: "c73e118a-de16-4c50-95f8-3b96314365b8") : secret "networking-console-plugin-cert" not found Jul 09 11:12:41.328841 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:12:41.328736 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls podName:c049af70-6066-4edb-a95e-257d9f6b6307 nodeName:}" failed. No retries permitted until 2026-07-09 11:13:13.328727552 +0000 UTC m=+99.239572060 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls") pod "image-registry-96767b5b5-zmtlw" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307") : secret "image-registry-tls" not found Jul 09 11:12:41.885312 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:41.885259 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-55rts" event={"ID":"672a99ff-7087-4603-a419-f4594bc9cbfd","Type":"ContainerStarted","Data":"93680f5b3d895508854043aa27627a1ea524ae947447d6651fb2378a66c82f80"} Jul 09 11:12:45.897654 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:45.897614 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4tp6c" event={"ID":"3e079363-7a35-4ffd-a0e0-9763e5e6e0a6","Type":"ContainerStarted","Data":"6c0a4117f384b0a2b92fde3c0c1e658ed2a104a233bd352357a9d8b5cdcc90bc"} Jul 09 11:12:45.899092 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:45.899070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-55rts" event={"ID":"672a99ff-7087-4603-a419-f4594bc9cbfd","Type":"ContainerStarted","Data":"e8856cfef202e360f43378d5fcca615e775551074c8d3e73bb7e8629fd0671d3"} Jul 09 11:12:45.899210 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:45.899197 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:12:45.939492 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:45.939438 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4tp6c" podStartSLOduration=66.209048431 podStartE2EDuration="1m10.939421247s" totalImagesPullingTime="4.730372816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:12:45.918593209 +0000 UTC m=+71.829437735" watchObservedRunningTime="2026-07-09 11:12:45.939421247 +0000 UTC m=+71.850265776" Jul 09 11:12:45.939670 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:12:45.939569 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-55rts" podStartSLOduration=67.49498943 podStartE2EDuration="1m11.939562098s" totalImagesPullingTime="4.444572668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:12:45.938327297 +0000 UTC m=+71.849171824" watchObservedRunningTime="2026-07-09 11:12:45.939562098 +0000 UTC m=+71.850407031" Jul 09 11:13:13.368953 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:13:13.368804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:13:13.368953 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:13:13.368879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:13:13.368953 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:13:13.368903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:13:13.369499 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:13:13.368986 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 11:13:13.369499 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:13:13.369017 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96767b5b5-zmtlw: secret "image-registry-tls" not found Jul 09 11:13:13.369499 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:13:13.369036 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 11:13:13.369499 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:13:13.368990 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 11:13:13.369499 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:13:13.369085 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls podName:c049af70-6066-4edb-a95e-257d9f6b6307 nodeName:}" failed. No retries permitted until 2026-07-09 11:14:17.369063485 +0000 UTC m=+163.279908007 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls") pod "image-registry-96767b5b5-zmtlw" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307") : secret "image-registry-tls" not found Jul 09 11:13:13.369499 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:13:13.369105 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls podName:4a3acf38-52b2-4368-834a-35ec650fa955 nodeName:}" failed. No retries permitted until 2026-07-09 11:14:17.369096206 +0000 UTC m=+163.279940718 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls") pod "dns-default-x7qvq" (UID: "4a3acf38-52b2-4368-834a-35ec650fa955") : secret "dns-default-metrics-tls" not found Jul 09 11:13:13.369499 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:13:13.369126 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert podName:c73e118a-de16-4c50-95f8-3b96314365b8 nodeName:}" failed. No retries permitted until 2026-07-09 11:14:17.369113904 +0000 UTC m=+163.279958408 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ws6jc" (UID: "c73e118a-de16-4c50-95f8-3b96314365b8") : secret "networking-console-plugin-cert" not found Jul 09 11:13:16.904438 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:13:16.904400 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-55rts" Jul 09 11:13:44.402497 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:13:44.402440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:13:44.403013 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:13:44.402597 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 11:13:44.403013 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:13:44.402669 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs podName:9a462c5b-8391-4aaa-a694-a1ef4effd722 nodeName:}" failed. No retries permitted until 2026-07-09 11:15:46.402652676 +0000 UTC m=+252.313497179 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs") pod "network-metrics-daemon-h5dgn" (UID: "9a462c5b-8391-4aaa-a694-a1ef4effd722") : secret "metrics-daemon-secret" not found Jul 09 11:14:12.440957 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:14:12.440907 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" podUID="c73e118a-de16-4c50-95f8-3b96314365b8" Jul 09 11:14:12.447201 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:14:12.447160 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" podUID="c049af70-6066-4edb-a95e-257d9f6b6307" Jul 09 11:14:12.492568 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:14:12.492529 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x7qvq" podUID="4a3acf38-52b2-4368-834a-35ec650fa955" Jul 09 11:14:12.623342 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:14:12.623277 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:14:13.106568 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:14:13.106537 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7qvq" Jul 09 11:14:13.106744 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:14:13.106537 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:14:13.106744 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:14:13.106538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:14:17.446662 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:14:17.446623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:14:17.446662 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:14:17.446664 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:14:17.447376 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:14:17.446702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:14:17.447376 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:14:17.446776 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 11:14:17.447376 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:14:17.446794 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 11:14:17.447376 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:14:17.446796 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 11:14:17.447376 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:14:17.446806 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96767b5b5-zmtlw: secret "image-registry-tls" not found Jul 09 11:14:17.447376 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:14:17.446854 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls podName:4a3acf38-52b2-4368-834a-35ec650fa955 nodeName:}" failed. No retries permitted until 2026-07-09 11:16:19.446837176 +0000 UTC m=+285.357681681 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls") pod "dns-default-x7qvq" (UID: "4a3acf38-52b2-4368-834a-35ec650fa955") : secret "dns-default-metrics-tls" not found Jul 09 11:14:17.447376 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:14:17.446868 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert podName:c73e118a-de16-4c50-95f8-3b96314365b8 nodeName:}" failed. No retries permitted until 2026-07-09 11:16:19.446862612 +0000 UTC m=+285.357707116 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ws6jc" (UID: "c73e118a-de16-4c50-95f8-3b96314365b8") : secret "networking-console-plugin-cert" not found Jul 09 11:14:17.447376 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:14:17.446878 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls podName:c049af70-6066-4edb-a95e-257d9f6b6307 nodeName:}" failed. No retries permitted until 2026-07-09 11:16:19.446873235 +0000 UTC m=+285.357717739 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls") pod "image-registry-96767b5b5-zmtlw" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307") : secret "image-registry-tls" not found Jul 09 11:14:27.605642 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:14:27.605540 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:15:46.498738 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:46.498693 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:15:46.499220 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:46.498863 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 11:15:46.499220 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:46.498937 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs podName:9a462c5b-8391-4aaa-a694-a1ef4effd722 nodeName:}" failed. No retries permitted until 2026-07-09 11:17:48.49891923 +0000 UTC m=+374.409763755 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs") pod "network-metrics-daemon-h5dgn" (UID: "9a462c5b-8391-4aaa-a694-a1ef4effd722") : secret "metrics-daemon-secret" not found Jul 09 11:15:49.122203 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.122168 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp"] Jul 09 11:15:49.124019 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.124005 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:15:49.127011 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.126989 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 11:15:49.128238 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.128165 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 11:15:49.128389 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.128251 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 11:15:49.128389 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.128330 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cwxbh\"" Jul 09 11:15:49.134548 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.134524 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6dc99479f9-lmlq5"] Jul 09 11:15:49.136264 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.136245 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-smdjf"] Jul 09 11:15:49.136387 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.136373 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.137954 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.137934 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.138434 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.138414 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp"] Jul 09 11:15:49.143528 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.143507 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 11:15:49.146141 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.146121 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 11:15:49.153587 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.153569 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2nfzv\"" Jul 09 11:15:49.153767 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.153755 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 11:15:49.153810 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.153788 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-s282m\"" Jul 09 11:15:49.154140 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.154128 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 11:15:49.154429 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.154415 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 11:15:49.155986 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.155973 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 11:15:49.156154 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.156139 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 11:15:49.156241 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.156225 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 11:15:49.156355 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.156341 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 11:15:49.158191 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.158177 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 11:15:49.170028 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.170003 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 11:15:49.171687 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.171668 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dc99479f9-lmlq5"] Jul 09 11:15:49.180200 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.180176 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-smdjf"] Jul 09 11:15:49.216850 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.216816 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-stats-auth\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.217019 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.216868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd7c4\" (UniqueName: \"kubernetes.io/projected/7639dd75-934f-46c0-9a85-1a00a3eb45ef-kube-api-access-dd7c4\") pod \"cluster-samples-operator-56fcf86bf-6v5fp\" (UID: \"7639dd75-934f-46c0-9a85-1a00a3eb45ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:15:49.217019 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.216895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.217019 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.216959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-default-certificate\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.217019 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.216987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f777ccc-4045-4847-bab9-9119e307a233-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.217019 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.217008 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jssp\" (UniqueName: \"kubernetes.io/projected/7f777ccc-4045-4847-bab9-9119e307a233-kube-api-access-8jssp\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.217175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.217024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f777ccc-4045-4847-bab9-9119e307a233-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.217175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.217039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j8x6\" (UniqueName: \"kubernetes.io/projected/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-kube-api-access-4j8x6\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.217175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.217056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.217175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.217114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f777ccc-4045-4847-bab9-9119e307a233-snapshots\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.217175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.217142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6v5fp\" (UID: \"7639dd75-934f-46c0-9a85-1a00a3eb45ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:15:49.217175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.217172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f777ccc-4045-4847-bab9-9119e307a233-serving-cert\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.217377 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.217212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f777ccc-4045-4847-bab9-9119e307a233-tmp\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.225535 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.225506 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-7lrnr"] Jul 09 11:15:49.227588 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.227570 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7lrnr" Jul 09 11:15:49.230953 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.230935 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cbgzw\"" Jul 09 11:15:49.236451 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.234680 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv"] Jul 09 11:15:49.238964 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.238939 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s"] Jul 09 11:15:49.239366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.239349 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" Jul 09 11:15:49.241092 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.241070 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:49.246341 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.246319 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-7lrnr"] Jul 09 11:15:49.246524 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.246508 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 11:15:49.252315 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.252271 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 11:15:49.252467 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.252449 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 11:15:49.252467 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.252458 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 11:15:49.252707 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.252458 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 11:15:49.252707 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.252478 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 11:15:49.252894 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.252759 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 11:15:49.252894 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.252887 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vwqg4\"" Jul 09 11:15:49.252984 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.252909 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 11:15:49.252984 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.252941 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-x5mwb\"" Jul 09 11:15:49.264814 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.264739 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s"] Jul 09 11:15:49.265580 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.265560 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv"] Jul 09 11:15:49.317807 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.317765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd7c4\" (UniqueName: \"kubernetes.io/projected/7639dd75-934f-46c0-9a85-1a00a3eb45ef-kube-api-access-dd7c4\") pod \"cluster-samples-operator-56fcf86bf-6v5fp\" (UID: \"7639dd75-934f-46c0-9a85-1a00a3eb45ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:15:49.317807 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.317806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.318016 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.317834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6979d57-ba97-430b-8da4-12fb9e425387-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7jjnv\" (UID: \"d6979d57-ba97-430b-8da4-12fb9e425387\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" Jul 09 11:15:49.318016 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.317859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:49.318016 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.317894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6fhj\" (UniqueName: \"kubernetes.io/projected/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-kube-api-access-k6fhj\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:49.318016 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.317938 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-default-certificate\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.318016 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.317962 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle podName:a06ae9b5-a700-4c5c-a1aa-dbb20e981958 nodeName:}" failed. No retries permitted until 2026-07-09 11:15:49.817939432 +0000 UTC m=+255.728783938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle") pod "router-default-6dc99479f9-lmlq5" (UID: "a06ae9b5-a700-4c5c-a1aa-dbb20e981958") : configmap references non-existent config key: service-ca.crt Jul 09 11:15:49.318253 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f777ccc-4045-4847-bab9-9119e307a233-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.318253 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jssp\" (UniqueName: \"kubernetes.io/projected/7f777ccc-4045-4847-bab9-9119e307a233-kube-api-access-8jssp\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.318253 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f777ccc-4045-4847-bab9-9119e307a233-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.318253 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j8x6\" (UniqueName: \"kubernetes.io/projected/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-kube-api-access-4j8x6\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.318253 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv8mx\" (UniqueName: \"kubernetes.io/projected/13e91816-9668-4537-9476-34a554b30762-kube-api-access-qv8mx\") pod \"network-check-source-989f8b8dc-7lrnr\" (UID: \"13e91816-9668-4537-9476-34a554b30762\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7lrnr" Jul 09 11:15:49.318551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.318551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6979d57-ba97-430b-8da4-12fb9e425387-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7jjnv\" (UID: \"d6979d57-ba97-430b-8da4-12fb9e425387\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" Jul 09 11:15:49.318551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318369 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxpdd\" (UniqueName: \"kubernetes.io/projected/d6979d57-ba97-430b-8da4-12fb9e425387-kube-api-access-jxpdd\") pod \"kube-storage-version-migrator-operator-846bf668f7-7jjnv\" (UID: \"d6979d57-ba97-430b-8da4-12fb9e425387\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" Jul 09 11:15:49.318551 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.318386 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 11:15:49.318551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f777ccc-4045-4847-bab9-9119e307a233-snapshots\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.318551 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.318453 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs podName:a06ae9b5-a700-4c5c-a1aa-dbb20e981958 nodeName:}" failed. No retries permitted until 2026-07-09 11:15:49.818435946 +0000 UTC m=+255.729280473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs") pod "router-default-6dc99479f9-lmlq5" (UID: "a06ae9b5-a700-4c5c-a1aa-dbb20e981958") : secret "router-metrics-certs-default" not found Jul 09 11:15:49.318551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6v5fp\" (UID: \"7639dd75-934f-46c0-9a85-1a00a3eb45ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:15:49.318551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f777ccc-4045-4847-bab9-9119e307a233-serving-cert\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.318897 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.318588 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 11:15:49.318897 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.318654 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls podName:7639dd75-934f-46c0-9a85-1a00a3eb45ef nodeName:}" failed. No retries permitted until 2026-07-09 11:15:49.818638247 +0000 UTC m=+255.729482768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6v5fp" (UID: "7639dd75-934f-46c0-9a85-1a00a3eb45ef") : secret "samples-operator-tls" not found Jul 09 11:15:49.318897 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f777ccc-4045-4847-bab9-9119e307a233-tmp\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.318897 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318699 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f777ccc-4045-4847-bab9-9119e307a233-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.318897 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-stats-auth\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.318897 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.318760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:49.319144 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.319009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f777ccc-4045-4847-bab9-9119e307a233-tmp\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.319144 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.319059 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f777ccc-4045-4847-bab9-9119e307a233-snapshots\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.319772 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.319752 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f777ccc-4045-4847-bab9-9119e307a233-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.320530 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.320512 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-default-certificate\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.321276 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.321260 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f777ccc-4045-4847-bab9-9119e307a233-serving-cert\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.321393 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.321376 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-stats-auth\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.347431 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.347396 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd7c4\" (UniqueName: \"kubernetes.io/projected/7639dd75-934f-46c0-9a85-1a00a3eb45ef-kube-api-access-dd7c4\") pod \"cluster-samples-operator-56fcf86bf-6v5fp\" (UID: \"7639dd75-934f-46c0-9a85-1a00a3eb45ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:15:49.356860 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.356832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jssp\" (UniqueName: \"kubernetes.io/projected/7f777ccc-4045-4847-bab9-9119e307a233-kube-api-access-8jssp\") pod \"insights-operator-5c847dcfc4-smdjf\" (UID: \"7f777ccc-4045-4847-bab9-9119e307a233\") " pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.368231 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.368196 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j8x6\" (UniqueName: \"kubernetes.io/projected/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-kube-api-access-4j8x6\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.420151 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.420063 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6979d57-ba97-430b-8da4-12fb9e425387-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7jjnv\" (UID: \"d6979d57-ba97-430b-8da4-12fb9e425387\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" Jul 09 11:15:49.420151 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.420097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:49.420151 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.420124 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6fhj\" (UniqueName: \"kubernetes.io/projected/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-kube-api-access-k6fhj\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:49.420454 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.420174 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv8mx\" (UniqueName: \"kubernetes.io/projected/13e91816-9668-4537-9476-34a554b30762-kube-api-access-qv8mx\") pod \"network-check-source-989f8b8dc-7lrnr\" (UID: \"13e91816-9668-4537-9476-34a554b30762\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7lrnr" Jul 09 11:15:49.420454 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.420338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6979d57-ba97-430b-8da4-12fb9e425387-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7jjnv\" (UID: \"d6979d57-ba97-430b-8da4-12fb9e425387\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" Jul 09 11:15:49.420454 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.420379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxpdd\" (UniqueName: \"kubernetes.io/projected/d6979d57-ba97-430b-8da4-12fb9e425387-kube-api-access-jxpdd\") pod \"kube-storage-version-migrator-operator-846bf668f7-7jjnv\" (UID: \"d6979d57-ba97-430b-8da4-12fb9e425387\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" Jul 09 11:15:49.420593 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.420497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:49.420593 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.420585 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 11:15:49.420667 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.420637 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls podName:40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b nodeName:}" failed. No retries permitted until 2026-07-09 11:15:49.920624893 +0000 UTC m=+255.831469402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d6b5s" (UID: "40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b") : secret "cluster-monitoring-operator-tls" not found Jul 09 11:15:49.420885 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.420868 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:49.420925 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.420871 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6979d57-ba97-430b-8da4-12fb9e425387-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7jjnv\" (UID: \"d6979d57-ba97-430b-8da4-12fb9e425387\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" Jul 09 11:15:49.422591 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.422575 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6979d57-ba97-430b-8da4-12fb9e425387-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7jjnv\" (UID: \"d6979d57-ba97-430b-8da4-12fb9e425387\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" Jul 09 11:15:49.434414 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.434392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv8mx\" (UniqueName: \"kubernetes.io/projected/13e91816-9668-4537-9476-34a554b30762-kube-api-access-qv8mx\") pod \"network-check-source-989f8b8dc-7lrnr\" (UID: \"13e91816-9668-4537-9476-34a554b30762\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7lrnr" Jul 09 11:15:49.434524 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.434503 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxpdd\" (UniqueName: \"kubernetes.io/projected/d6979d57-ba97-430b-8da4-12fb9e425387-kube-api-access-jxpdd\") pod \"kube-storage-version-migrator-operator-846bf668f7-7jjnv\" (UID: \"d6979d57-ba97-430b-8da4-12fb9e425387\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" Jul 09 11:15:49.434637 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.434622 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6fhj\" (UniqueName: \"kubernetes.io/projected/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-kube-api-access-k6fhj\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:49.451448 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.451425 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" Jul 09 11:15:49.536707 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.536671 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7lrnr" Jul 09 11:15:49.548957 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.548928 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" Jul 09 11:15:49.586227 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.586189 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-smdjf"] Jul 09 11:15:49.591442 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:15:49.591402 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f777ccc_4045_4847_bab9_9119e307a233.slice/crio-4b238f8f51a61c0c006fe6c086ca8095189aa7499d0e3dde66df4e1e8535e945 WatchSource:0}: Error finding container 4b238f8f51a61c0c006fe6c086ca8095189aa7499d0e3dde66df4e1e8535e945: Status 404 returned error can't find the container with id 4b238f8f51a61c0c006fe6c086ca8095189aa7499d0e3dde66df4e1e8535e945 Jul 09 11:15:49.676036 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.675956 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-7lrnr"] Jul 09 11:15:49.679148 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:15:49.679121 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e91816_9668_4537_9476_34a554b30762.slice/crio-7d570c68c9ad89b46bbceb7aa0476a4805e9c351dc7f470010f8c481f83b8c3d WatchSource:0}: Error finding container 7d570c68c9ad89b46bbceb7aa0476a4805e9c351dc7f470010f8c481f83b8c3d: Status 404 returned error can't find the container with id 7d570c68c9ad89b46bbceb7aa0476a4805e9c351dc7f470010f8c481f83b8c3d Jul 09 11:15:49.706896 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.706866 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv"] Jul 09 11:15:49.710688 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:15:49.710658 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6979d57_ba97_430b_8da4_12fb9e425387.slice/crio-7d19e1cbd53e2ef83a7c1b227d6e517da98c57e511ae93cb68382aee2dd8e44f WatchSource:0}: Error finding container 7d19e1cbd53e2ef83a7c1b227d6e517da98c57e511ae93cb68382aee2dd8e44f: Status 404 returned error can't find the container with id 7d19e1cbd53e2ef83a7c1b227d6e517da98c57e511ae93cb68382aee2dd8e44f Jul 09 11:15:49.825095 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.825064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.825262 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.825126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:49.825262 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.825152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6v5fp\" (UID: \"7639dd75-934f-46c0-9a85-1a00a3eb45ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:15:49.825262 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.825232 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle podName:a06ae9b5-a700-4c5c-a1aa-dbb20e981958 nodeName:}" failed. No retries permitted until 2026-07-09 11:15:50.825214879 +0000 UTC m=+256.736059385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle") pod "router-default-6dc99479f9-lmlq5" (UID: "a06ae9b5-a700-4c5c-a1aa-dbb20e981958") : configmap references non-existent config key: service-ca.crt Jul 09 11:15:49.825424 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.825275 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 11:15:49.825424 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.825330 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls podName:7639dd75-934f-46c0-9a85-1a00a3eb45ef nodeName:}" failed. No retries permitted until 2026-07-09 11:15:50.825318713 +0000 UTC m=+256.736163216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6v5fp" (UID: "7639dd75-934f-46c0-9a85-1a00a3eb45ef") : secret "samples-operator-tls" not found Jul 09 11:15:49.825424 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.825339 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 11:15:49.825424 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.825394 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs podName:a06ae9b5-a700-4c5c-a1aa-dbb20e981958 nodeName:}" failed. No retries permitted until 2026-07-09 11:15:50.825379364 +0000 UTC m=+256.736223883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs") pod "router-default-6dc99479f9-lmlq5" (UID: "a06ae9b5-a700-4c5c-a1aa-dbb20e981958") : secret "router-metrics-certs-default" not found Jul 09 11:15:49.926733 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:49.926638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:49.926877 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.926789 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 11:15:49.926877 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:49.926857 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls podName:40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b nodeName:}" failed. No retries permitted until 2026-07-09 11:15:50.926838722 +0000 UTC m=+256.837683248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d6b5s" (UID: "40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b") : secret "cluster-monitoring-operator-tls" not found Jul 09 11:15:50.337750 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:50.337683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" event={"ID":"7f777ccc-4045-4847-bab9-9119e307a233","Type":"ContainerStarted","Data":"4b238f8f51a61c0c006fe6c086ca8095189aa7499d0e3dde66df4e1e8535e945"} Jul 09 11:15:50.339373 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:50.339313 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" event={"ID":"d6979d57-ba97-430b-8da4-12fb9e425387","Type":"ContainerStarted","Data":"7d19e1cbd53e2ef83a7c1b227d6e517da98c57e511ae93cb68382aee2dd8e44f"} Jul 09 11:15:50.341876 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:50.341831 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7lrnr" event={"ID":"13e91816-9668-4537-9476-34a554b30762","Type":"ContainerStarted","Data":"74d80bb79d935365d96a659251e3b3f7b7ba42066ded24ca9ffbf8abd5da9923"} Jul 09 11:15:50.341876 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:50.341871 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7lrnr" event={"ID":"13e91816-9668-4537-9476-34a554b30762","Type":"ContainerStarted","Data":"7d570c68c9ad89b46bbceb7aa0476a4805e9c351dc7f470010f8c481f83b8c3d"} Jul 09 11:15:50.834563 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:50.834516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:50.834767 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:50.834611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:50.834767 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:50.834650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6v5fp\" (UID: \"7639dd75-934f-46c0-9a85-1a00a3eb45ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:15:50.834881 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:50.834799 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 11:15:50.834881 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:50.834864 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls podName:7639dd75-934f-46c0-9a85-1a00a3eb45ef nodeName:}" failed. No retries permitted until 2026-07-09 11:15:52.834843723 +0000 UTC m=+258.745688229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6v5fp" (UID: "7639dd75-934f-46c0-9a85-1a00a3eb45ef") : secret "samples-operator-tls" not found Jul 09 11:15:50.835259 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:50.835227 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 11:15:50.835406 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:50.835325 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs podName:a06ae9b5-a700-4c5c-a1aa-dbb20e981958 nodeName:}" failed. No retries permitted until 2026-07-09 11:15:52.835277564 +0000 UTC m=+258.746122073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs") pod "router-default-6dc99479f9-lmlq5" (UID: "a06ae9b5-a700-4c5c-a1aa-dbb20e981958") : secret "router-metrics-certs-default" not found Jul 09 11:15:50.835406 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:50.835371 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle podName:a06ae9b5-a700-4c5c-a1aa-dbb20e981958 nodeName:}" failed. No retries permitted until 2026-07-09 11:15:52.835347441 +0000 UTC m=+258.746191960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle") pod "router-default-6dc99479f9-lmlq5" (UID: "a06ae9b5-a700-4c5c-a1aa-dbb20e981958") : configmap references non-existent config key: service-ca.crt Jul 09 11:15:50.935349 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:50.935269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:50.935506 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:50.935410 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 11:15:50.935506 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:50.935494 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls podName:40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b nodeName:}" failed. No retries permitted until 2026-07-09 11:15:52.935471736 +0000 UTC m=+258.846316256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d6b5s" (UID: "40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b") : secret "cluster-monitoring-operator-tls" not found Jul 09 11:15:52.850672 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:52.850325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:52.850672 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:52.850424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:52.850672 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:52.850465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6v5fp\" (UID: \"7639dd75-934f-46c0-9a85-1a00a3eb45ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:15:52.850672 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:52.850618 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 11:15:52.850672 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:52.850647 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 11:15:52.851311 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:52.850653 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle podName:a06ae9b5-a700-4c5c-a1aa-dbb20e981958 nodeName:}" failed. No retries permitted until 2026-07-09 11:15:56.850631329 +0000 UTC m=+262.761475850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle") pod "router-default-6dc99479f9-lmlq5" (UID: "a06ae9b5-a700-4c5c-a1aa-dbb20e981958") : configmap references non-existent config key: service-ca.crt Jul 09 11:15:52.851311 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:52.850733 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls podName:7639dd75-934f-46c0-9a85-1a00a3eb45ef nodeName:}" failed. No retries permitted until 2026-07-09 11:15:56.850714296 +0000 UTC m=+262.761558802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6v5fp" (UID: "7639dd75-934f-46c0-9a85-1a00a3eb45ef") : secret "samples-operator-tls" not found Jul 09 11:15:52.851311 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:52.850749 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs podName:a06ae9b5-a700-4c5c-a1aa-dbb20e981958 nodeName:}" failed. No retries permitted until 2026-07-09 11:15:56.850740543 +0000 UTC m=+262.761585052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs") pod "router-default-6dc99479f9-lmlq5" (UID: "a06ae9b5-a700-4c5c-a1aa-dbb20e981958") : secret "router-metrics-certs-default" not found Jul 09 11:15:52.951141 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:52.951107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:52.951347 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:52.951247 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 11:15:52.951347 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:52.951330 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls podName:40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b nodeName:}" failed. No retries permitted until 2026-07-09 11:15:56.95131309 +0000 UTC m=+262.862157595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d6b5s" (UID: "40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b") : secret "cluster-monitoring-operator-tls" not found Jul 09 11:15:53.353568 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.353530 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" event={"ID":"7f777ccc-4045-4847-bab9-9119e307a233","Type":"ContainerStarted","Data":"eb37431b03d927fceb61a4971d2240d8eabdfdb923cc414a90104c23024019bb"} Jul 09 11:15:53.354956 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.354928 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" event={"ID":"d6979d57-ba97-430b-8da4-12fb9e425387","Type":"ContainerStarted","Data":"95ca414bb311b971edf8a17b5a0d31cd80f9adcefa53b1b2e7e28d6182efb676"} Jul 09 11:15:53.389302 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.389237 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" podStartSLOduration=1.672861412 podStartE2EDuration="4.389220474s" totalImagesPullingTime="2.716359062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:15:53.388267735 +0000 UTC m=+259.299112260" watchObservedRunningTime="2026-07-09 11:15:53.389220474 +0000 UTC m=+259.300064999" Jul 09 11:15:53.389474 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.389453 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-7lrnr" podStartSLOduration=4.389447583 podStartE2EDuration="4.389447583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:15:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:15:50.369990575 +0000 UTC m=+256.280835103" watchObservedRunningTime="2026-07-09 11:15:53.389447583 +0000 UTC m=+259.300292108" Jul 09 11:15:53.421497 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.421439 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" podStartSLOduration=1.823776887 podStartE2EDuration="4.421420798s" totalImagesPullingTime="2.597643911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:15:53.421378062 +0000 UTC m=+259.332222587" watchObservedRunningTime="2026-07-09 11:15:53.421420798 +0000 UTC m=+259.332265324" Jul 09 11:15:53.521748 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.521705 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rnkdd"] Jul 09 11:15:53.524483 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.524460 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.527316 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.527276 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 11:15:53.527444 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.527296 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8hzfb\"" Jul 09 11:15:53.527444 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.527401 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 11:15:53.537581 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.537558 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rnkdd"] Jul 09 11:15:53.556824 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.556790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.556824 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.556827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3790962-44af-4405-be62-112f125ebc4c-data-volume\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.557025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.556867 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3790962-44af-4405-be62-112f125ebc4c-crio-socket\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.557025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.556900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc7jr\" (UniqueName: \"kubernetes.io/projected/e3790962-44af-4405-be62-112f125ebc4c-kube-api-access-fc7jr\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.557025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.556976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.657877 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.657764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.657877 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.657820 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3790962-44af-4405-be62-112f125ebc4c-data-volume\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.658089 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:53.657910 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 11:15:53.658089 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.657944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3790962-44af-4405-be62-112f125ebc4c-crio-socket\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.658089 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:53.657981 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm podName:e3790962-44af-4405-be62-112f125ebc4c nodeName:}" failed. No retries permitted until 2026-07-09 11:15:54.157962107 +0000 UTC m=+260.068806611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rnkdd" (UID: "e3790962-44af-4405-be62-112f125ebc4c") : configmap "kube-rbac-proxy" not found Jul 09 11:15:53.658089 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.658010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3790962-44af-4405-be62-112f125ebc4c-crio-socket\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.658089 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.658037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7jr\" (UniqueName: \"kubernetes.io/projected/e3790962-44af-4405-be62-112f125ebc4c-kube-api-access-fc7jr\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.658271 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.658094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.658271 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:53.658220 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 11:15:53.658271 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:53.658263 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls podName:e3790962-44af-4405-be62-112f125ebc4c nodeName:}" failed. No retries permitted until 2026-07-09 11:15:54.158248161 +0000 UTC m=+260.069092670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rnkdd" (UID: "e3790962-44af-4405-be62-112f125ebc4c") : secret "insights-runtime-extractor-tls" not found Jul 09 11:15:53.658271 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.658265 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3790962-44af-4405-be62-112f125ebc4c-data-volume\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:53.668805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:53.668780 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc7jr\" (UniqueName: \"kubernetes.io/projected/e3790962-44af-4405-be62-112f125ebc4c-kube-api-access-fc7jr\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:54.161455 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:54.161402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:54.161906 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:54.161535 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 11:15:54.161906 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:54.161546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:54.161906 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:54.161605 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm podName:e3790962-44af-4405-be62-112f125ebc4c nodeName:}" failed. No retries permitted until 2026-07-09 11:15:55.161587032 +0000 UTC m=+261.072431540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rnkdd" (UID: "e3790962-44af-4405-be62-112f125ebc4c") : configmap "kube-rbac-proxy" not found Jul 09 11:15:54.161906 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:54.161656 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 11:15:54.161906 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:54.161707 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls podName:e3790962-44af-4405-be62-112f125ebc4c nodeName:}" failed. No retries permitted until 2026-07-09 11:15:55.161687784 +0000 UTC m=+261.072532288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rnkdd" (UID: "e3790962-44af-4405-be62-112f125ebc4c") : secret "insights-runtime-extractor-tls" not found Jul 09 11:15:55.169768 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:55.169721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:55.170132 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:55.169837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:55.170132 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:55.169904 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 11:15:55.170132 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:55.169973 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls podName:e3790962-44af-4405-be62-112f125ebc4c nodeName:}" failed. No retries permitted until 2026-07-09 11:15:57.169956405 +0000 UTC m=+263.080800929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rnkdd" (UID: "e3790962-44af-4405-be62-112f125ebc4c") : secret "insights-runtime-extractor-tls" not found Jul 09 11:15:55.170132 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:55.169975 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 11:15:55.170132 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:55.170034 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm podName:e3790962-44af-4405-be62-112f125ebc4c nodeName:}" failed. No retries permitted until 2026-07-09 11:15:57.170018106 +0000 UTC m=+263.080862614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rnkdd" (UID: "e3790962-44af-4405-be62-112f125ebc4c") : configmap "kube-rbac-proxy" not found Jul 09 11:15:56.087646 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:56.087615 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btfhm_0b0a1137-bae7-4ffe-867c-51ad32e22c15/dns-node-resolver/0.log" Jul 09 11:15:56.884632 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:56.884597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:56.885121 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:56.884639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6v5fp\" (UID: \"7639dd75-934f-46c0-9a85-1a00a3eb45ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:15:56.885121 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:56.884708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:15:56.885121 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:56.884750 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 11:15:56.885121 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:56.884816 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs podName:a06ae9b5-a700-4c5c-a1aa-dbb20e981958 nodeName:}" failed. No retries permitted until 2026-07-09 11:16:04.884801435 +0000 UTC m=+270.795645940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs") pod "router-default-6dc99479f9-lmlq5" (UID: "a06ae9b5-a700-4c5c-a1aa-dbb20e981958") : secret "router-metrics-certs-default" not found Jul 09 11:15:56.885121 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:56.884830 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle podName:a06ae9b5-a700-4c5c-a1aa-dbb20e981958 nodeName:}" failed. No retries permitted until 2026-07-09 11:16:04.884824546 +0000 UTC m=+270.795669050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle") pod "router-default-6dc99479f9-lmlq5" (UID: "a06ae9b5-a700-4c5c-a1aa-dbb20e981958") : configmap references non-existent config key: service-ca.crt Jul 09 11:15:56.885121 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:56.884842 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 11:15:56.885121 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:56.884914 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls podName:7639dd75-934f-46c0-9a85-1a00a3eb45ef nodeName:}" failed. No retries permitted until 2026-07-09 11:16:04.884894902 +0000 UTC m=+270.795739435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6v5fp" (UID: "7639dd75-934f-46c0-9a85-1a00a3eb45ef") : secret "samples-operator-tls" not found Jul 09 11:15:56.985651 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:56.985609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:15:56.985831 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:56.985776 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 11:15:56.985870 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:56.985841 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls podName:40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b nodeName:}" failed. No retries permitted until 2026-07-09 11:16:04.98582514 +0000 UTC m=+270.896669665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d6b5s" (UID: "40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b") : secret "cluster-monitoring-operator-tls" not found Jul 09 11:15:57.187071 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:57.186966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:57.187071 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:57.187070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:15:57.187267 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:57.187140 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 11:15:57.187267 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:57.187160 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 11:15:57.187267 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:57.187217 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls podName:e3790962-44af-4405-be62-112f125ebc4c nodeName:}" failed. No retries permitted until 2026-07-09 11:16:01.187197129 +0000 UTC m=+267.098041649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rnkdd" (UID: "e3790962-44af-4405-be62-112f125ebc4c") : secret "insights-runtime-extractor-tls" not found Jul 09 11:15:57.187267 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:15:57.187240 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm podName:e3790962-44af-4405-be62-112f125ebc4c nodeName:}" failed. No retries permitted until 2026-07-09 11:16:01.187229032 +0000 UTC m=+267.098073540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rnkdd" (UID: "e3790962-44af-4405-be62-112f125ebc4c") : configmap "kube-rbac-proxy" not found Jul 09 11:15:57.305556 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:57.305530 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t5l5s_2de16fdd-03a8-47ac-a739-71a61b51bf59/node-ca/0.log" Jul 09 11:15:58.314743 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:58.314715 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l9dl7_7c5ca9ec-f699-4051-a7ec-24010d1bd331/serve-healthcheck-canary/0.log" Jul 09 11:15:58.895809 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:15:58.895781 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-7jjnv_d6979d57-ba97-430b-8da4-12fb9e425387/kube-storage-version-migrator-operator/0.log" Jul 09 11:16:01.217893 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:01.217851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:16:01.218325 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:01.217949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:16:01.218325 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:01.217980 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 11:16:01.218325 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:01.218045 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm podName:e3790962-44af-4405-be62-112f125ebc4c nodeName:}" failed. No retries permitted until 2026-07-09 11:16:09.218030578 +0000 UTC m=+275.128875081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rnkdd" (UID: "e3790962-44af-4405-be62-112f125ebc4c") : configmap "kube-rbac-proxy" not found Jul 09 11:16:01.218325 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:01.218057 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 11:16:01.218325 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:01.218102 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls podName:e3790962-44af-4405-be62-112f125ebc4c nodeName:}" failed. No retries permitted until 2026-07-09 11:16:09.218087154 +0000 UTC m=+275.128931676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rnkdd" (UID: "e3790962-44af-4405-be62-112f125ebc4c") : secret "insights-runtime-extractor-tls" not found Jul 09 11:16:04.953131 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:04.953086 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:16:04.953568 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:04.953157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:16:04.953568 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:04.953179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6v5fp\" (UID: \"7639dd75-934f-46c0-9a85-1a00a3eb45ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:16:04.953568 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:04.953312 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle podName:a06ae9b5-a700-4c5c-a1aa-dbb20e981958 nodeName:}" failed. No retries permitted until 2026-07-09 11:16:20.953266974 +0000 UTC m=+286.864111500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle") pod "router-default-6dc99479f9-lmlq5" (UID: "a06ae9b5-a700-4c5c-a1aa-dbb20e981958") : configmap references non-existent config key: service-ca.crt Jul 09 11:16:04.955627 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:04.955603 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7639dd75-934f-46c0-9a85-1a00a3eb45ef-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6v5fp\" (UID: \"7639dd75-934f-46c0-9a85-1a00a3eb45ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:16:04.955722 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:04.955603 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-metrics-certs\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:16:05.032192 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:05.032157 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" Jul 09 11:16:05.054579 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:05.054550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:16:05.054710 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:05.054682 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 11:16:05.054746 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:05.054735 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls podName:40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b nodeName:}" failed. No retries permitted until 2026-07-09 11:16:21.054721893 +0000 UTC m=+286.965566397 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-d6b5s" (UID: "40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b") : secret "cluster-monitoring-operator-tls" not found Jul 09 11:16:05.168563 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:05.168537 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp"] Jul 09 11:16:05.390596 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:05.390557 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" event={"ID":"7639dd75-934f-46c0-9a85-1a00a3eb45ef","Type":"ContainerStarted","Data":"ccea9d7e3383045a4b5f8173a70453fe3bab2064365b7e4c814055e128eeb570"} Jul 09 11:16:07.404177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:07.404133 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" event={"ID":"7639dd75-934f-46c0-9a85-1a00a3eb45ef","Type":"ContainerStarted","Data":"3f72ddcc92f4281a63a9479143430b85b07f9b1408d0d5625dfab659a558146f"} Jul 09 11:16:07.404571 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:07.404241 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" event={"ID":"7639dd75-934f-46c0-9a85-1a00a3eb45ef","Type":"ContainerStarted","Data":"b02efc1e41ea013e02085c52cf94b87ed1b4132752c30f19ff965545a7109550"} Jul 09 11:16:07.444563 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:07.444462 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6v5fp" podStartSLOduration=16.5029036 podStartE2EDuration="18.444442122s" totalImagesPullingTime="1.941538522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:07.443771451 +0000 UTC m=+273.354615977" watchObservedRunningTime="2026-07-09 11:16:07.444442122 +0000 UTC m=+273.355286626" Jul 09 11:16:09.293829 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:09.293784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:16:09.294201 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:09.293870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:16:09.294201 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:09.293969 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 11:16:09.294201 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:09.294033 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls podName:e3790962-44af-4405-be62-112f125ebc4c nodeName:}" failed. No retries permitted until 2026-07-09 11:16:25.294017536 +0000 UTC m=+291.204862045 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rnkdd" (UID: "e3790962-44af-4405-be62-112f125ebc4c") : secret "insights-runtime-extractor-tls" not found Jul 09 11:16:09.294362 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:09.294273 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3790962-44af-4405-be62-112f125ebc4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:16:16.107927 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:16.107859 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" podUID="c73e118a-de16-4c50-95f8-3b96314365b8" Jul 09 11:16:16.107927 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:16.107859 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x7qvq" podUID="4a3acf38-52b2-4368-834a-35ec650fa955" Jul 09 11:16:16.107927 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:16.107859 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" podUID="c049af70-6066-4edb-a95e-257d9f6b6307" Jul 09 11:16:16.429897 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:16.429814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:16:16.429897 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:16.429829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7qvq" Jul 09 11:16:16.430064 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:16.429814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:16:19.476463 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.476423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:16:19.476953 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.476494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:16:19.476953 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.476546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:16:19.478787 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.478763 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a3acf38-52b2-4368-834a-35ec650fa955-metrics-tls\") pod \"dns-default-x7qvq\" (UID: \"4a3acf38-52b2-4368-834a-35ec650fa955\") " pod="openshift-dns/dns-default-x7qvq" Jul 09 11:16:19.478887 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.478875 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c73e118a-de16-4c50-95f8-3b96314365b8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ws6jc\" (UID: \"c73e118a-de16-4c50-95f8-3b96314365b8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:16:19.478948 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.478899 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"image-registry-96767b5b5-zmtlw\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:16:19.735703 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.735606 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6pmqk\"" Jul 09 11:16:19.735703 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.735628 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5q9mj\"" Jul 09 11:16:19.735703 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.735673 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mcsj2\"" Jul 09 11:16:19.740676 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.740660 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7qvq" Jul 09 11:16:19.740738 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.740680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" Jul 09 11:16:19.740738 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.740707 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:16:19.909607 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.909578 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc"] Jul 09 11:16:19.912259 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:19.912223 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc73e118a_de16_4c50_95f8_3b96314365b8.slice/crio-04be74e34a34324bf61124f9f6eab3d2cc688d41c7654457382be4b5f0c17e39 WatchSource:0}: Error finding container 04be74e34a34324bf61124f9f6eab3d2cc688d41c7654457382be4b5f0c17e39: Status 404 returned error can't find the container with id 04be74e34a34324bf61124f9f6eab3d2cc688d41c7654457382be4b5f0c17e39 Jul 09 11:16:19.927521 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.927495 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x7qvq"] Jul 09 11:16:19.931195 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:19.931165 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3acf38_52b2_4368_834a_35ec650fa955.slice/crio-c9547c9e44d04dab3a8578e54bfbb5941024bd5f15058608d29bdab0db490262 WatchSource:0}: Error finding container c9547c9e44d04dab3a8578e54bfbb5941024bd5f15058608d29bdab0db490262: Status 404 returned error can't find the container with id c9547c9e44d04dab3a8578e54bfbb5941024bd5f15058608d29bdab0db490262 Jul 09 11:16:19.954268 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:19.954239 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-96767b5b5-zmtlw"] Jul 09 11:16:19.957008 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:19.956980 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc049af70_6066_4edb_a95e_257d9f6b6307.slice/crio-73f19fe4f99d643a79a3ed4bcedd116594e5c370b3d24b851fd38cef05650e07 WatchSource:0}: Error finding container 73f19fe4f99d643a79a3ed4bcedd116594e5c370b3d24b851fd38cef05650e07: Status 404 returned error can't find the container with id 73f19fe4f99d643a79a3ed4bcedd116594e5c370b3d24b851fd38cef05650e07 Jul 09 11:16:20.445494 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:20.445452 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x7qvq" event={"ID":"4a3acf38-52b2-4368-834a-35ec650fa955","Type":"ContainerStarted","Data":"c9547c9e44d04dab3a8578e54bfbb5941024bd5f15058608d29bdab0db490262"} Jul 09 11:16:20.446872 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:20.446844 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" event={"ID":"c049af70-6066-4edb-a95e-257d9f6b6307","Type":"ContainerStarted","Data":"0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d"} Jul 09 11:16:20.446991 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:20.446888 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" event={"ID":"c049af70-6066-4edb-a95e-257d9f6b6307","Type":"ContainerStarted","Data":"73f19fe4f99d643a79a3ed4bcedd116594e5c370b3d24b851fd38cef05650e07"} Jul 09 11:16:20.447054 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:20.447004 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:16:20.447871 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:20.447851 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" event={"ID":"c73e118a-de16-4c50-95f8-3b96314365b8","Type":"ContainerStarted","Data":"04be74e34a34324bf61124f9f6eab3d2cc688d41c7654457382be4b5f0c17e39"} Jul 09 11:16:20.489750 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:20.489695 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" podStartSLOduration=285.489678793 podStartE2EDuration="4m45.489678793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:20.488432069 +0000 UTC m=+286.399276597" watchObservedRunningTime="2026-07-09 11:16:20.489678793 +0000 UTC m=+286.400523296" Jul 09 11:16:20.990764 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:20.990723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:16:20.991557 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:20.991524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a06ae9b5-a700-4c5c-a1aa-dbb20e981958-service-ca-bundle\") pod \"router-default-6dc99479f9-lmlq5\" (UID: \"a06ae9b5-a700-4c5c-a1aa-dbb20e981958\") " pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:16:21.091657 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:21.091619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:16:21.094242 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:21.094212 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-d6b5s\" (UID: \"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:16:21.246558 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:21.246487 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:16:21.355483 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:21.355449 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" Jul 09 11:16:22.045496 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.045408 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dc99479f9-lmlq5"] Jul 09 11:16:22.046809 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.046783 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s"] Jul 09 11:16:22.051489 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:22.051454 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06ae9b5_a700_4c5c_a1aa_dbb20e981958.slice/crio-5cc62f4a658ae8c60533b452f9da6b0b01dfa9b296f4fa9388f13fd7569917a1 WatchSource:0}: Error finding container 5cc62f4a658ae8c60533b452f9da6b0b01dfa9b296f4fa9388f13fd7569917a1: Status 404 returned error can't find the container with id 5cc62f4a658ae8c60533b452f9da6b0b01dfa9b296f4fa9388f13fd7569917a1 Jul 09 11:16:22.052230 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:22.052181 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a02d4a_5ffa_4d0f_8642_dd281fe6ee5b.slice/crio-ac49dd012c6f73cf34a5e7adef7c8628c6f90d956e023020714ee5bbaffefc91 WatchSource:0}: Error finding container ac49dd012c6f73cf34a5e7adef7c8628c6f90d956e023020714ee5bbaffefc91: Status 404 returned error can't find the container with id ac49dd012c6f73cf34a5e7adef7c8628c6f90d956e023020714ee5bbaffefc91 Jul 09 11:16:22.456902 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.456804 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" event={"ID":"c73e118a-de16-4c50-95f8-3b96314365b8","Type":"ContainerStarted","Data":"b8ba519203d415c0dc210f7adb2301ca9fb93dbd7b1b46226163dd4923572269"} Jul 09 11:16:22.458271 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.458246 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" event={"ID":"a06ae9b5-a700-4c5c-a1aa-dbb20e981958","Type":"ContainerStarted","Data":"8601a9992263528b2ded79f77af287fa769b7a6b700702d0b890b84aff38a97c"} Jul 09 11:16:22.458446 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.458305 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" event={"ID":"a06ae9b5-a700-4c5c-a1aa-dbb20e981958","Type":"ContainerStarted","Data":"5cc62f4a658ae8c60533b452f9da6b0b01dfa9b296f4fa9388f13fd7569917a1"} Jul 09 11:16:22.459347 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.459327 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" event={"ID":"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b","Type":"ContainerStarted","Data":"ac49dd012c6f73cf34a5e7adef7c8628c6f90d956e023020714ee5bbaffefc91"} Jul 09 11:16:22.460868 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.460849 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x7qvq" event={"ID":"4a3acf38-52b2-4368-834a-35ec650fa955","Type":"ContainerStarted","Data":"1bccf5b7f30bffb2175b910bb79dcf6c9ae4abec6e7b1b43f46a0395327e7fe2"} Jul 09 11:16:22.460953 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.460886 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x7qvq" event={"ID":"4a3acf38-52b2-4368-834a-35ec650fa955","Type":"ContainerStarted","Data":"5777eb177b8cca7423de738b81250ef1cd5b2661d231389901d304e4918594fa"} Jul 09 11:16:22.460953 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.460908 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x7qvq" Jul 09 11:16:22.505123 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.505076 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ws6jc" podStartSLOduration=276.568654912 podStartE2EDuration="4m38.505059593s" totalImagesPullingTime="1.936404681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:22.504775845 +0000 UTC m=+288.415620382" watchObservedRunningTime="2026-07-09 11:16:22.505059593 +0000 UTC m=+288.415904118" Jul 09 11:16:22.546899 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.546843 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" podStartSLOduration=33.546825972 podStartE2EDuration="33.546825972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:15:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:22.54498152 +0000 UTC m=+288.455826047" watchObservedRunningTime="2026-07-09 11:16:22.546825972 +0000 UTC m=+288.457670500" Jul 09 11:16:22.584781 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:22.584731 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x7qvq" podStartSLOduration=251.661274971 podStartE2EDuration="4m13.584715108s" totalImagesPullingTime="1.923440137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:22.583837089 +0000 UTC m=+288.494681627" watchObservedRunningTime="2026-07-09 11:16:22.584715108 +0000 UTC m=+288.495559633" Jul 09 11:16:23.247220 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:23.247179 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:16:23.249863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:23.249833 2562 patch_prober.go:28] interesting pod/router-default-6dc99479f9-lmlq5 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 09 11:16:23.249863 ip-10-0-131-226 kubenswrapper[2562]: [-]has-synced failed: reason withheld Jul 09 11:16:23.249863 ip-10-0-131-226 kubenswrapper[2562]: [+]process-running ok Jul 09 11:16:23.249863 ip-10-0-131-226 kubenswrapper[2562]: healthz check failed Jul 09 11:16:23.250067 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:23.249888 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" podUID="a06ae9b5-a700-4c5c-a1aa-dbb20e981958" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 11:16:24.248507 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:24.248478 2562 patch_prober.go:28] interesting pod/router-default-6dc99479f9-lmlq5 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 09 11:16:24.248507 ip-10-0-131-226 kubenswrapper[2562]: [-]has-synced failed: reason withheld Jul 09 11:16:24.248507 ip-10-0-131-226 kubenswrapper[2562]: [+]process-running ok Jul 09 11:16:24.248507 ip-10-0-131-226 kubenswrapper[2562]: healthz check failed Jul 09 11:16:24.248866 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:24.248529 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" podUID="a06ae9b5-a700-4c5c-a1aa-dbb20e981958" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 11:16:24.470204 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:24.470159 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" event={"ID":"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b","Type":"ContainerStarted","Data":"99f7dad2f1f1fb2a664fd48fc8a0f558db6050ef6c7efa38e4cbe1d8ec9e73e5"} Jul 09 11:16:24.965930 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:24.965866 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" podStartSLOduration=33.796392659 podStartE2EDuration="35.965847582s" totalImagesPullingTime="2.169454923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:24.50683323 +0000 UTC m=+290.417677755" watchObservedRunningTime="2026-07-09 11:16:24.965847582 +0000 UTC m=+290.876692111" Jul 09 11:16:24.966808 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:24.966792 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg"] Jul 09 11:16:24.969728 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:24.969713 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg" Jul 09 11:16:24.973584 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:24.973560 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 11:16:24.974669 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:24.974656 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zcrlv\"" Jul 09 11:16:24.986275 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:24.986251 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg"] Jul 09 11:16:25.126038 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.125995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/078eb3e4-fcff-4176-a5d8-fa26cd880f56-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6s5pg\" (UID: \"078eb3e4-fcff-4176-a5d8-fa26cd880f56\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg" Jul 09 11:16:25.227238 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.227146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/078eb3e4-fcff-4176-a5d8-fa26cd880f56-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6s5pg\" (UID: \"078eb3e4-fcff-4176-a5d8-fa26cd880f56\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg" Jul 09 11:16:25.229765 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.229740 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/078eb3e4-fcff-4176-a5d8-fa26cd880f56-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6s5pg\" (UID: \"078eb3e4-fcff-4176-a5d8-fa26cd880f56\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg" Jul 09 11:16:25.248605 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.248575 2562 patch_prober.go:28] interesting pod/router-default-6dc99479f9-lmlq5 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 09 11:16:25.248605 ip-10-0-131-226 kubenswrapper[2562]: [-]has-synced failed: reason withheld Jul 09 11:16:25.248605 ip-10-0-131-226 kubenswrapper[2562]: [+]process-running ok Jul 09 11:16:25.248605 ip-10-0-131-226 kubenswrapper[2562]: healthz check failed Jul 09 11:16:25.249000 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.248635 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" podUID="a06ae9b5-a700-4c5c-a1aa-dbb20e981958" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 11:16:25.279015 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.278982 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg" Jul 09 11:16:25.329930 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.328960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:16:25.331734 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.331675 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3790962-44af-4405-be62-112f125ebc4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rnkdd\" (UID: \"e3790962-44af-4405-be62-112f125ebc4c\") " pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:16:25.333589 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.333562 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rnkdd" Jul 09 11:16:25.435415 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.435382 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg"] Jul 09 11:16:25.439604 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:25.439571 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078eb3e4_fcff_4176_a5d8_fa26cd880f56.slice/crio-4779259c21c5628048685c8abfa02b3f1b9a40c8287ba57964ae185a742792a7 WatchSource:0}: Error finding container 4779259c21c5628048685c8abfa02b3f1b9a40c8287ba57964ae185a742792a7: Status 404 returned error can't find the container with id 4779259c21c5628048685c8abfa02b3f1b9a40c8287ba57964ae185a742792a7 Jul 09 11:16:25.475181 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.475149 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg" event={"ID":"078eb3e4-fcff-4176-a5d8-fa26cd880f56","Type":"ContainerStarted","Data":"4779259c21c5628048685c8abfa02b3f1b9a40c8287ba57964ae185a742792a7"} Jul 09 11:16:25.505350 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:25.505327 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rnkdd"] Jul 09 11:16:25.507393 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:25.507373 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3790962_44af_4405_be62_112f125ebc4c.slice/crio-8dc7c53a2b87dab1978fbb7e4ea075ba3211d026a2e7688a246686a5ac63f7a6 WatchSource:0}: Error finding container 8dc7c53a2b87dab1978fbb7e4ea075ba3211d026a2e7688a246686a5ac63f7a6: Status 404 returned error can't find the container with id 8dc7c53a2b87dab1978fbb7e4ea075ba3211d026a2e7688a246686a5ac63f7a6 Jul 09 11:16:26.248832 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:26.248802 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:16:26.249964 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:26.249892 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:16:26.251071 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:26.251050 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6dc99479f9-lmlq5" Jul 09 11:16:26.482433 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:26.482346 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rnkdd" event={"ID":"e3790962-44af-4405-be62-112f125ebc4c","Type":"ContainerStarted","Data":"8dc7c53a2b87dab1978fbb7e4ea075ba3211d026a2e7688a246686a5ac63f7a6"} Jul 09 11:16:27.487708 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:27.487670 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg" event={"ID":"078eb3e4-fcff-4176-a5d8-fa26cd880f56","Type":"ContainerStarted","Data":"0b0b71ba292e78f1e3162ce1e5e2f0dd483a7451e352a4eaf85ab14b0e5e5898"} Jul 09 11:16:27.488174 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:27.488033 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg" Jul 09 11:16:27.492835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:27.492801 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg" Jul 09 11:16:27.564722 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:27.564666 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6s5pg" podStartSLOduration=2.104470429 podStartE2EDuration="3.564649805s" totalImagesPullingTime="1.460179376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:27.53466243 +0000 UTC m=+293.445506957" watchObservedRunningTime="2026-07-09 11:16:27.564649805 +0000 UTC m=+293.475494359" Jul 09 11:16:28.110074 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.110037 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm"] Jul 09 11:16:28.134856 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.134814 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm"] Jul 09 11:16:28.135034 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.134943 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.140517 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.140203 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 11:16:28.140517 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.140338 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 11:16:28.141181 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.141153 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cbz25\"" Jul 09 11:16:28.141325 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.141217 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 11:16:28.256624 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.256579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d674c831-9ebc-4aed-94b5-af904a6bb2b6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.256624 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.256629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d674c831-9ebc-4aed-94b5-af904a6bb2b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.256825 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.256661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkwbj\" (UniqueName: \"kubernetes.io/projected/d674c831-9ebc-4aed-94b5-af904a6bb2b6-kube-api-access-tkwbj\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.256825 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.256729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d674c831-9ebc-4aed-94b5-af904a6bb2b6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.357569 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.357533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d674c831-9ebc-4aed-94b5-af904a6bb2b6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.357569 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.357573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d674c831-9ebc-4aed-94b5-af904a6bb2b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.357780 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.357596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkwbj\" (UniqueName: \"kubernetes.io/projected/d674c831-9ebc-4aed-94b5-af904a6bb2b6-kube-api-access-tkwbj\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.357780 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.357616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d674c831-9ebc-4aed-94b5-af904a6bb2b6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.358262 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.358230 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d674c831-9ebc-4aed-94b5-af904a6bb2b6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.360054 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.360021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d674c831-9ebc-4aed-94b5-af904a6bb2b6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.360054 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.360031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d674c831-9ebc-4aed-94b5-af904a6bb2b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.367757 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.367701 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkwbj\" (UniqueName: \"kubernetes.io/projected/d674c831-9ebc-4aed-94b5-af904a6bb2b6-kube-api-access-tkwbj\") pod \"prometheus-operator-567f7b8b7c-dqcqm\" (UID: \"d674c831-9ebc-4aed-94b5-af904a6bb2b6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:28.446980 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:28.446946 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" Jul 09 11:16:29.441196 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:29.441159 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm"] Jul 09 11:16:29.454784 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:29.454749 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd674c831_9ebc_4aed_94b5_af904a6bb2b6.slice/crio-c5ed344a639d689e1a134fded949ca0e649334f3e63e55d65f164949416e9e92 WatchSource:0}: Error finding container c5ed344a639d689e1a134fded949ca0e649334f3e63e55d65f164949416e9e92: Status 404 returned error can't find the container with id c5ed344a639d689e1a134fded949ca0e649334f3e63e55d65f164949416e9e92 Jul 09 11:16:29.498413 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:29.498375 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rnkdd" event={"ID":"e3790962-44af-4405-be62-112f125ebc4c","Type":"ContainerStarted","Data":"08c3142f5ae878c2bf75a8b860af1844d62fb92dbe9111b6db441e96f275dfd3"} Jul 09 11:16:29.499540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:29.499479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" event={"ID":"d674c831-9ebc-4aed-94b5-af904a6bb2b6","Type":"ContainerStarted","Data":"c5ed344a639d689e1a134fded949ca0e649334f3e63e55d65f164949416e9e92"} Jul 09 11:16:30.506959 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:30.506919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rnkdd" event={"ID":"e3790962-44af-4405-be62-112f125ebc4c","Type":"ContainerStarted","Data":"348d299a94b71e44afaded6a3cbb63bec3d1e267a1beea11049dde5c1c5f70e0"} Jul 09 11:16:30.606781 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:30.606730 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h5dgn" podUID="9a462c5b-8391-4aaa-a694-a1ef4effd722" Jul 09 11:16:31.512799 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:31.512758 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" event={"ID":"d674c831-9ebc-4aed-94b5-af904a6bb2b6","Type":"ContainerStarted","Data":"9a7b16037357a25901cef224e0493bed06d3c1748ec1e3a8841939aeb46459e7"} Jul 09 11:16:31.513227 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:31.512831 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" event={"ID":"d674c831-9ebc-4aed-94b5-af904a6bb2b6","Type":"ContainerStarted","Data":"3e5295b21c1078107135ec220f45c86c23d48854cf7c67aaa2a3fc072e199a2b"} Jul 09 11:16:31.552659 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:31.552595 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dqcqm" podStartSLOduration=2.064786511 podStartE2EDuration="3.552575123s" totalImagesPullingTime="1.487788612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:31.551729045 +0000 UTC m=+297.462573566" watchObservedRunningTime="2026-07-09 11:16:31.552575123 +0000 UTC m=+297.463419649" Jul 09 11:16:32.468006 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:32.467977 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x7qvq" Jul 09 11:16:32.517571 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:32.517537 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rnkdd" event={"ID":"e3790962-44af-4405-be62-112f125ebc4c","Type":"ContainerStarted","Data":"56dd296a48bf46055aa4f9fd3c6c291304be1482e4183787b4269ee221cd8091"} Jul 09 11:16:32.558194 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:32.558145 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rnkdd" podStartSLOduration=32.745131982 podStartE2EDuration="39.558126978s" totalImagesPullingTime="6.812994996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:15:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:32.556439039 +0000 UTC m=+298.467283566" watchObservedRunningTime="2026-07-09 11:16:32.558126978 +0000 UTC m=+298.468971503" Jul 09 11:16:33.522823 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:33.522743 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:16:33.522823 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:33.522782 2562 generic.go:356] "Generic (PLEG): container finished" podID="40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b" containerID="99f7dad2f1f1fb2a664fd48fc8a0f558db6050ef6c7efa38e4cbe1d8ec9e73e5" exitCode=2 Jul 09 11:16:33.523237 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:33.522865 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" event={"ID":"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b","Type":"ContainerDied","Data":"99f7dad2f1f1fb2a664fd48fc8a0f558db6050ef6c7efa38e4cbe1d8ec9e73e5"} Jul 09 11:16:33.523351 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:33.523334 2562 scope.go:117] "RemoveContainer" containerID="99f7dad2f1f1fb2a664fd48fc8a0f558db6050ef6c7efa38e4cbe1d8ec9e73e5" Jul 09 11:16:34.508123 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:34.508093 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:16:34.512236 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:34.512209 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:16:34.515833 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:34.515809 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:16:34.520552 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:34.520528 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:16:34.521257 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:34.521235 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 11:16:34.527967 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:34.527947 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:16:34.528370 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:34.527994 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-d6b5s" event={"ID":"40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b","Type":"ContainerStarted","Data":"42572c7d8f0d304d1a5180e0c3addb3c6ba695618877e47b3abb6f849d1122f9"} Jul 09 11:16:37.345384 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.345347 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lrqdr"] Jul 09 11:16:37.347439 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.347423 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.351975 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.351925 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 11:16:37.352249 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.352006 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 11:16:37.352249 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.352173 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kn2d9\"" Jul 09 11:16:37.353078 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.353059 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 11:16:37.426088 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.426046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/412646ab-ae7a-43b8-8b27-f58d4ad6414f-root\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.426088 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.426081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/412646ab-ae7a-43b8-8b27-f58d4ad6414f-metrics-client-ca\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.426386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.426115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/412646ab-ae7a-43b8-8b27-f58d4ad6414f-sys\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.426386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.426130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xw2s\" (UniqueName: \"kubernetes.io/projected/412646ab-ae7a-43b8-8b27-f58d4ad6414f-kube-api-access-6xw2s\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.426386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.426155 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-textfile\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.426386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.426195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.426386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.426226 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-wtmp\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.426386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.426255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-accelerators-collector-config\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.426386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.426307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-tls\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.429441 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.429417 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22"] Jul 09 11:16:37.431740 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.431721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.434510 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.434492 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 11:16:37.434703 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.434689 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 11:16:37.434890 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.434876 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8dwzd\"" Jul 09 11:16:37.446989 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.446967 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22"] Jul 09 11:16:37.527239 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/412646ab-ae7a-43b8-8b27-f58d4ad6414f-sys\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527239 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xw2s\" (UniqueName: \"kubernetes.io/projected/412646ab-ae7a-43b8-8b27-f58d4ad6414f-kube-api-access-6xw2s\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527462 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-textfile\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527462 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527315 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/412646ab-ae7a-43b8-8b27-f58d4ad6414f-sys\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527462 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527462 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-wtmp\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527626 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527495 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-accelerators-collector-config\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527626 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-tls\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527626 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527567 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-textfile\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527626 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/412646ab-ae7a-43b8-8b27-f58d4ad6414f-root\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/412646ab-ae7a-43b8-8b27-f58d4ad6414f-metrics-client-ca\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527672 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-wtmp\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527685 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.527817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/412646ab-ae7a-43b8-8b27-f58d4ad6414f-root\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.527817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7wf9\" (UniqueName: \"kubernetes.io/projected/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-kube-api-access-c7wf9\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.527817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.527817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.527798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.528187 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.528049 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-accelerators-collector-config\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.528244 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.528218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/412646ab-ae7a-43b8-8b27-f58d4ad6414f-metrics-client-ca\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.529869 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.529843 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.529992 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.529922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/412646ab-ae7a-43b8-8b27-f58d4ad6414f-node-exporter-tls\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.539050 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.539023 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xw2s\" (UniqueName: \"kubernetes.io/projected/412646ab-ae7a-43b8-8b27-f58d4ad6414f-kube-api-access-6xw2s\") pod \"node-exporter-lrqdr\" (UID: \"412646ab-ae7a-43b8-8b27-f58d4ad6414f\") " pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.628266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.628180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.628266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.628218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.628514 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.628332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.628514 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.628358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7wf9\" (UniqueName: \"kubernetes.io/projected/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-kube-api-access-c7wf9\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.628978 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.628952 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.630617 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.630589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.630720 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.630657 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.640020 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.639998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7wf9\" (UniqueName: \"kubernetes.io/projected/a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2-kube-api-access-c7wf9\") pod \"openshift-state-metrics-54cf96dfcf-99b22\" (UID: \"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.656923 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.656889 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lrqdr" Jul 09 11:16:37.667692 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:37.667666 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod412646ab_ae7a_43b8_8b27_f58d4ad6414f.slice/crio-6ca8bc86af1c03d21a03f67aa02e34186824cdd05aed67c602bc92b641c4aed9 WatchSource:0}: Error finding container 6ca8bc86af1c03d21a03f67aa02e34186824cdd05aed67c602bc92b641c4aed9: Status 404 returned error can't find the container with id 6ca8bc86af1c03d21a03f67aa02e34186824cdd05aed67c602bc92b641c4aed9 Jul 09 11:16:37.669988 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.669752 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 11:16:37.740826 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.740792 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" Jul 09 11:16:37.884497 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:37.884409 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22"] Jul 09 11:16:37.887071 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:37.887045 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2cf7bcc_b090_4dd0_b6f4_8a46e24d1da2.slice/crio-c38fef6abdcc5e2ba0bff04737f9504b1a1b6291c770b16559433b77f1072047 WatchSource:0}: Error finding container c38fef6abdcc5e2ba0bff04737f9504b1a1b6291c770b16559433b77f1072047: Status 404 returned error can't find the container with id c38fef6abdcc5e2ba0bff04737f9504b1a1b6291c770b16559433b77f1072047 Jul 09 11:16:38.544814 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.544743 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrqdr" event={"ID":"412646ab-ae7a-43b8-8b27-f58d4ad6414f","Type":"ContainerStarted","Data":"6ca8bc86af1c03d21a03f67aa02e34186824cdd05aed67c602bc92b641c4aed9"} Jul 09 11:16:38.549250 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.549213 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" event={"ID":"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2","Type":"ContainerStarted","Data":"25dae01b115d85aa98423f6cad451cd252bff18e3898a77db2b615a46bdc20ad"} Jul 09 11:16:38.549437 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.549344 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" event={"ID":"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2","Type":"ContainerStarted","Data":"67c81e813a35c7cbd58bd1320ec7a11979a1f17a4164b08b350684b8dd1cb551"} Jul 09 11:16:38.549437 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.549375 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" event={"ID":"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2","Type":"ContainerStarted","Data":"c38fef6abdcc5e2ba0bff04737f9504b1a1b6291c770b16559433b77f1072047"} Jul 09 11:16:38.665393 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.662869 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 11:16:38.667204 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.667179 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.677516 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.677477 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 11:16:38.677837 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.677816 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 11:16:38.678051 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.677998 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 11:16:38.678130 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.678076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 11:16:38.678130 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.678099 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 11:16:38.678419 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.678401 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fsfds\"" Jul 09 11:16:38.678492 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.678413 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 11:16:38.678552 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.678536 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 11:16:38.678676 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.678657 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 11:16:38.678744 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.678693 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 11:16:38.703668 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.703563 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 11:16:38.737962 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.737916 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.737962 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.737965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.738209 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.738058 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.738209 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.738112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-out\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.738209 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.738134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.738209 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.738159 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-web-config\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.738209 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.738193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.738493 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.738216 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggxdc\" (UniqueName: \"kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-kube-api-access-ggxdc\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.738493 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.738250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.738493 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.738297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.738493 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.738323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.738493 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.738347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.738493 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.738372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839269 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839485 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-out\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839485 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839485 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-web-config\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839485 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839485 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggxdc\" (UniqueName: \"kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-kube-api-access-ggxdc\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839958 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839490 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839958 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839958 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839958 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839958 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839958 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839958 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.839958 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.839678 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.840936 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:38.840857 2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 09 11:16:38.841041 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.841009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.841108 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:38.841086 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-main-tls podName:9a627582-9dd7-42fe-ba2f-be65c0e00b5a nodeName:}" failed. No retries permitted until 2026-07-09 11:16:39.340904461 +0000 UTC m=+305.251748969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a") : secret "alertmanager-main-tls" not found Jul 09 11:16:38.841931 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.841876 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.844437 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.844389 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.844437 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.844418 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-out\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.844755 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.844707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-web-config\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.844863 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.844755 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.845584 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.845561 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.845974 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.845935 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.846425 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.846403 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.846901 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.846876 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:38.852344 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:38.852323 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggxdc\" (UniqueName: \"kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-kube-api-access-ggxdc\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:39.344491 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:39.344459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:39.346914 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:39.346887 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:39.554621 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:39.554533 2562 generic.go:356] "Generic (PLEG): container finished" podID="412646ab-ae7a-43b8-8b27-f58d4ad6414f" containerID="73a1d235d2f695ccb755161400137c601bc92ee75ba8475f33bac4bb0583b815" exitCode=0 Jul 09 11:16:39.555048 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:39.554619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrqdr" event={"ID":"412646ab-ae7a-43b8-8b27-f58d4ad6414f","Type":"ContainerDied","Data":"73a1d235d2f695ccb755161400137c601bc92ee75ba8475f33bac4bb0583b815"} Jul 09 11:16:39.556859 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:39.556831 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" event={"ID":"a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2","Type":"ContainerStarted","Data":"73460007df502d0cf06165f156bb5a6ceb001c3ff68aad61ef6432f5385fba59"} Jul 09 11:16:39.580551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:39.580522 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:16:39.609259 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:39.609189 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-99b22" podStartSLOduration=1.319103079 podStartE2EDuration="2.609164767s" totalImagesPullingTime="1.290061688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:39.606059071 +0000 UTC m=+305.516903620" watchObservedRunningTime="2026-07-09 11:16:39.609164767 +0000 UTC m=+305.520009299" Jul 09 11:16:39.745611 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:39.745576 2562 patch_prober.go:28] interesting pod/image-registry-96767b5b5-zmtlw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 11:16:39.745803 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:39.745634 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" podUID="c049af70-6066-4edb-a95e-257d9f6b6307" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 11:16:39.757454 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:39.757422 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 11:16:39.761143 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:39.761106 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a627582_9dd7_42fe_ba2f_be65c0e00b5a.slice/crio-50a1691c88d790da12f92f223e3998ee78c0f508be2acad5ff6299763a25bf9d WatchSource:0}: Error finding container 50a1691c88d790da12f92f223e3998ee78c0f508be2acad5ff6299763a25bf9d: Status 404 returned error can't find the container with id 50a1691c88d790da12f92f223e3998ee78c0f508be2acad5ff6299763a25bf9d Jul 09 11:16:40.563566 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.563529 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrqdr" event={"ID":"412646ab-ae7a-43b8-8b27-f58d4ad6414f","Type":"ContainerStarted","Data":"21dd571f35bf019b59a1db3a6d78f7a7212ff80cd6e6306a5ff8474bac276bbc"} Jul 09 11:16:40.564052 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.563592 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrqdr" event={"ID":"412646ab-ae7a-43b8-8b27-f58d4ad6414f","Type":"ContainerStarted","Data":"a14b19eb9ffe0ae17234990b44c60d52995596c7ca9fa09f66e132ebf6c1a98e"} Jul 09 11:16:40.564978 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.564950 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerStarted","Data":"50a1691c88d790da12f92f223e3998ee78c0f508be2acad5ff6299763a25bf9d"} Jul 09 11:16:40.575849 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.575783 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-89575b84c-zrqrg"] Jul 09 11:16:40.578763 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.578738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.588040 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.588008 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 11:16:40.588182 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.588039 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 11:16:40.588182 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.588014 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 11:16:40.588182 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.588177 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-25e6vt694lm51\"" Jul 09 11:16:40.588441 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.588424 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 11:16:40.588519 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.588486 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 11:16:40.588929 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.588911 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-k5rxd\"" Jul 09 11:16:40.626099 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.626067 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-89575b84c-zrqrg"] Jul 09 11:16:40.628060 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.627993 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lrqdr" podStartSLOduration=1.9338547400000001 podStartE2EDuration="3.62797178s" totalImagesPullingTime="1.625098896s" totalInitContainerRuntime="69.018144ms" isStatefulPod=true podCreationTimestamp="2026-07-09 11:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:40.624932313 +0000 UTC m=+306.535776839" watchObservedRunningTime="2026-07-09 11:16:40.62797178 +0000 UTC m=+306.538816307" Jul 09 11:16:40.656960 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.656928 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.657163 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.656993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.657163 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.657042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvkt4\" (UniqueName: \"kubernetes.io/projected/5d1f1329-673b-4b2e-a001-66f005392970-kube-api-access-vvkt4\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.657308 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.657253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.657620 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.657478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-grpc-tls\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.657749 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.657614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.657749 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.657668 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d1f1329-673b-4b2e-a001-66f005392970-metrics-client-ca\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.657749 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.657736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-tls\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.758872 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.758839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-tls\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.758872 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.758875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.759125 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.758906 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.759125 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.758934 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvkt4\" (UniqueName: \"kubernetes.io/projected/5d1f1329-673b-4b2e-a001-66f005392970-kube-api-access-vvkt4\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.759125 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.758995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.759125 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.759051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-grpc-tls\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.759125 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.759080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.759125 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.759112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d1f1329-673b-4b2e-a001-66f005392970-metrics-client-ca\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.759949 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.759898 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d1f1329-673b-4b2e-a001-66f005392970-metrics-client-ca\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.762231 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.762179 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.762638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.762418 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.762638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.762537 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-grpc-tls\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.762638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.762577 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-tls\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.762811 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.762689 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.762811 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.762778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5d1f1329-673b-4b2e-a001-66f005392970-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.772389 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.772362 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvkt4\" (UniqueName: \"kubernetes.io/projected/5d1f1329-673b-4b2e-a001-66f005392970-kube-api-access-vvkt4\") pod \"thanos-querier-89575b84c-zrqrg\" (UID: \"5d1f1329-673b-4b2e-a001-66f005392970\") " pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:40.891112 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:40.891090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:41.048408 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:41.048376 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-89575b84c-zrqrg"] Jul 09 11:16:41.051344 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:41.051313 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1f1329_673b_4b2e_a001_66f005392970.slice/crio-ec774dd2f7389c6576a27c7849bc0a674711c3660d13e68b3ad199a8cd4d11b8 WatchSource:0}: Error finding container ec774dd2f7389c6576a27c7849bc0a674711c3660d13e68b3ad199a8cd4d11b8: Status 404 returned error can't find the container with id ec774dd2f7389c6576a27c7849bc0a674711c3660d13e68b3ad199a8cd4d11b8 Jul 09 11:16:41.455498 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:41.455467 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:16:41.575540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:41.575500 2562 generic.go:356] "Generic (PLEG): container finished" podID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerID="09001a1c78c5dcdd350546bccac9181ee08a3b7c442644dd711165c8a51204c1" exitCode=0 Jul 09 11:16:41.576002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:41.575598 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerDied","Data":"09001a1c78c5dcdd350546bccac9181ee08a3b7c442644dd711165c8a51204c1"} Jul 09 11:16:41.577594 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:41.577542 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" event={"ID":"5d1f1329-673b-4b2e-a001-66f005392970","Type":"ContainerStarted","Data":"ec774dd2f7389c6576a27c7849bc0a674711c3660d13e68b3ad199a8cd4d11b8"} Jul 09 11:16:42.130175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:42.130139 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv"] Jul 09 11:16:42.132858 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:42.132833 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:42.135767 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:42.135730 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"monitoring-plugin-d5dcff7cf-5lvhv\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="a271cf57-6633-4660-8675-22986461c23a" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:42.136031 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:42.135999 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"monitoring-plugin-dockercfg-msjbc\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-msjbc\"" type="*v1.Secret" Jul 09 11:16:42.136228 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:42.136212 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 11:16:42.152290 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:42.152260 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv"] Jul 09 11:16:42.173675 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:42.173627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a271cf57-6633-4660-8675-22986461c23a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5lvhv\" (UID: \"a271cf57-6633-4660-8675-22986461c23a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:42.173865 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:42.173735 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqkg5\" (UniqueName: \"kubernetes.io/projected/a271cf57-6633-4660-8675-22986461c23a-kube-api-access-nqkg5\") pod \"monitoring-plugin-d5dcff7cf-5lvhv\" (UID: \"a271cf57-6633-4660-8675-22986461c23a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:42.275168 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:42.275134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a271cf57-6633-4660-8675-22986461c23a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5lvhv\" (UID: \"a271cf57-6633-4660-8675-22986461c23a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:42.275373 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:42.275197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqkg5\" (UniqueName: \"kubernetes.io/projected/a271cf57-6633-4660-8675-22986461c23a-kube-api-access-nqkg5\") pod \"monitoring-plugin-d5dcff7cf-5lvhv\" (UID: \"a271cf57-6633-4660-8675-22986461c23a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:42.275373 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:42.275301 2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 09 11:16:42.275373 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:16:42.275366 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a271cf57-6633-4660-8675-22986461c23a-monitoring-plugin-cert podName:a271cf57-6633-4660-8675-22986461c23a nodeName:}" failed. No retries permitted until 2026-07-09 11:16:42.775349605 +0000 UTC m=+308.686194108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a271cf57-6633-4660-8675-22986461c23a-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-5lvhv" (UID: "a271cf57-6633-4660-8675-22986461c23a") : secret "monitoring-plugin-cert" not found Jul 09 11:16:42.294075 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:42.294042 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqkg5\" (UniqueName: \"kubernetes.io/projected/a271cf57-6633-4660-8675-22986461c23a-kube-api-access-nqkg5\") pod \"monitoring-plugin-d5dcff7cf-5lvhv\" (UID: \"a271cf57-6633-4660-8675-22986461c23a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:42.779168 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:42.779129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a271cf57-6633-4660-8675-22986461c23a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5lvhv\" (UID: \"a271cf57-6633-4660-8675-22986461c23a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:42.781697 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:42.781673 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a271cf57-6633-4660-8675-22986461c23a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5lvhv\" (UID: \"a271cf57-6633-4660-8675-22986461c23a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:43.219677 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:43.219641 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-msjbc\"" Jul 09 11:16:43.223936 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:43.223744 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:43.280616 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:43.280579 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-96767b5b5-zmtlw"] Jul 09 11:16:43.593665 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:43.593505 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" event={"ID":"5d1f1329-673b-4b2e-a001-66f005392970","Type":"ContainerStarted","Data":"c45605e8f470a49748a457ff8976a5385dd3fb3852bf8b7c23134b9716f4a4f2"} Jul 09 11:16:43.593665 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:43.593593 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" event={"ID":"5d1f1329-673b-4b2e-a001-66f005392970","Type":"ContainerStarted","Data":"1ef234069031156ec7521c6f0e6ee05aa8752efec0e4f922bed337ae747b1c66"} Jul 09 11:16:43.605251 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:43.605227 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:16:43.705211 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:43.705181 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv"] Jul 09 11:16:43.707846 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:43.707817 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda271cf57_6633_4660_8675_22986461c23a.slice/crio-80523e4a333df6597484ff137090efb9c2bc14bef8440f318f6cc45d8e4fc71a WatchSource:0}: Error finding container 80523e4a333df6597484ff137090efb9c2bc14bef8440f318f6cc45d8e4fc71a: Status 404 returned error can't find the container with id 80523e4a333df6597484ff137090efb9c2bc14bef8440f318f6cc45d8e4fc71a Jul 09 11:16:44.127101 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.127064 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-74q7t"] Jul 09 11:16:44.131747 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.131711 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-74q7t" Jul 09 11:16:44.143086 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.143043 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 11:16:44.143086 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.143070 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 11:16:44.143341 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.143043 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-t62q7\"" Jul 09 11:16:44.157269 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.157241 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-74q7t"] Jul 09 11:16:44.195006 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.194250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhrrv\" (UniqueName: \"kubernetes.io/projected/cd59919e-b9a1-4052-b7fb-bb4f5df4fe55-kube-api-access-zhrrv\") pod \"downloads-685bfb5f64-74q7t\" (UID: \"cd59919e-b9a1-4052-b7fb-bb4f5df4fe55\") " pod="openshift-console/downloads-685bfb5f64-74q7t" Jul 09 11:16:44.297136 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.295414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhrrv\" (UniqueName: \"kubernetes.io/projected/cd59919e-b9a1-4052-b7fb-bb4f5df4fe55-kube-api-access-zhrrv\") pod \"downloads-685bfb5f64-74q7t\" (UID: \"cd59919e-b9a1-4052-b7fb-bb4f5df4fe55\") " pod="openshift-console/downloads-685bfb5f64-74q7t" Jul 09 11:16:44.309841 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.309811 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhrrv\" (UniqueName: \"kubernetes.io/projected/cd59919e-b9a1-4052-b7fb-bb4f5df4fe55-kube-api-access-zhrrv\") pod \"downloads-685bfb5f64-74q7t\" (UID: \"cd59919e-b9a1-4052-b7fb-bb4f5df4fe55\") " pod="openshift-console/downloads-685bfb5f64-74q7t" Jul 09 11:16:44.442338 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.442315 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-74q7t" Jul 09 11:16:44.599168 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.599136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" event={"ID":"a271cf57-6633-4660-8675-22986461c23a","Type":"ContainerStarted","Data":"80523e4a333df6597484ff137090efb9c2bc14bef8440f318f6cc45d8e4fc71a"} Jul 09 11:16:44.603532 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.603161 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerStarted","Data":"09968824267feb3090a1aa33a4025540d980dbbf0947c5292b7a469915c428cb"} Jul 09 11:16:44.603532 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.603235 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerStarted","Data":"c8c522ec80b1cff5d5941498e8b5024dbeda3e0916b1c8198b17486fd36b04a3"} Jul 09 11:16:44.603532 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.603336 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerStarted","Data":"8569e54fcc3917d1fd17f224e03f356d461c289ff5cda1a21fa8a676ae2026b6"} Jul 09 11:16:44.603532 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.603377 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerStarted","Data":"26f82e676977e975c16ec108361c09440a12636e01aaac7b78f8387dcfde307a"} Jul 09 11:16:44.603532 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.603415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerStarted","Data":"c09a804febe8ea4b68c77b626dcc6bf108a3cdb31700786fcd06f55f0b4b307f"} Jul 09 11:16:44.603532 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.603455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerStarted","Data":"848a40bc129db4744f85c0501ecf34595653f475ceb68755f8a3795257d1c08b"} Jul 09 11:16:44.604677 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.604650 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-74q7t"] Jul 09 11:16:44.608894 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:44.608858 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd59919e_b9a1_4052_b7fb_bb4f5df4fe55.slice/crio-c608fcf54a62010e788a4242517e7b7e304201b5de7307a477f99ec4fc40ccd7 WatchSource:0}: Error finding container c608fcf54a62010e788a4242517e7b7e304201b5de7307a477f99ec4fc40ccd7: Status 404 returned error can't find the container with id c608fcf54a62010e788a4242517e7b7e304201b5de7307a477f99ec4fc40ccd7 Jul 09 11:16:44.613575 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.613532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" event={"ID":"5d1f1329-673b-4b2e-a001-66f005392970","Type":"ContainerStarted","Data":"5b321be7fd4e37b047dc3c6f6578e48ef96c1cdcf1d998811af2bc446c937402"} Jul 09 11:16:44.613666 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.613615 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:44.613666 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.613659 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" event={"ID":"5d1f1329-673b-4b2e-a001-66f005392970","Type":"ContainerStarted","Data":"8c7058e281180a7887174779af7f5a646ca81fc664a16ee3f81012b4a46d573d"} Jul 09 11:16:44.613754 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.613699 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" event={"ID":"5d1f1329-673b-4b2e-a001-66f005392970","Type":"ContainerStarted","Data":"a9381a8a2e7dc6c96cc30728326da24c4f6b5afd607f3cbfa75f963792662582"} Jul 09 11:16:44.613754 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.613746 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" event={"ID":"5d1f1329-673b-4b2e-a001-66f005392970","Type":"ContainerStarted","Data":"289b50a7e1df5d3843f991cddd46fd1115d9bcd2f1a848a27c21943affe8eb6b"} Jul 09 11:16:44.656949 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.656837 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.077282273 podStartE2EDuration="6.65681361s" totalImagesPullingTime="3.561960194s" totalInitContainerRuntime="17.571143ms" isStatefulPod=false podCreationTimestamp="2026-07-09 11:16:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:44.655133253 +0000 UTC m=+310.565977779" watchObservedRunningTime="2026-07-09 11:16:44.65681361 +0000 UTC m=+310.567658137" Jul 09 11:16:44.705089 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:44.705036 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" podStartSLOduration=1.968267768 podStartE2EDuration="4.705016667s" totalImagesPullingTime="2.736748899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:16:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:44.703415503 +0000 UTC m=+310.614260055" watchObservedRunningTime="2026-07-09 11:16:44.705016667 +0000 UTC m=+310.615861193" Jul 09 11:16:45.614544 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:45.614508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-74q7t" event={"ID":"cd59919e-b9a1-4052-b7fb-bb4f5df4fe55","Type":"ContainerStarted","Data":"c608fcf54a62010e788a4242517e7b7e304201b5de7307a477f99ec4fc40ccd7"} Jul 09 11:16:45.616437 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:45.616400 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" event={"ID":"a271cf57-6633-4660-8675-22986461c23a","Type":"ContainerStarted","Data":"4756e0c02e684395633e7d1bad71586cd278a949df30cc6017bfef5da1535e2a"} Jul 09 11:16:45.617221 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:45.617194 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:45.622796 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:45.622773 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" Jul 09 11:16:45.656595 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:45.656534 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5lvhv" podStartSLOduration=1.9550191099999998 podStartE2EDuration="3.65651168s" totalImagesPullingTime="1.70149257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:45.655734966 +0000 UTC m=+311.566579493" watchObservedRunningTime="2026-07-09 11:16:45.65651168 +0000 UTC m=+311.567356209" Jul 09 11:16:50.496844 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.496807 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ccbcf9dc4-8jktj"] Jul 09 11:16:50.501745 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.501718 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.507034 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.507010 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 11:16:50.507198 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.507166 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-99jbh\"" Jul 09 11:16:50.508407 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.508376 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 11:16:50.508407 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.508395 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 11:16:50.508592 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.508420 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 11:16:50.508699 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.508683 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 11:16:50.529819 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.529786 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ccbcf9dc4-8jktj"] Jul 09 11:16:50.561107 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.561069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-serving-cert\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.561312 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.561127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hkgc\" (UniqueName: \"kubernetes.io/projected/d3345002-2b18-499b-b986-098e516b0f1b-kube-api-access-6hkgc\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.561312 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.561172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-oauth-config\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.561312 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.561193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-oauth-serving-cert\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.561312 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.561251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-service-ca\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.561459 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.561316 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-console-config\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.661862 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.661827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hkgc\" (UniqueName: \"kubernetes.io/projected/d3345002-2b18-499b-b986-098e516b0f1b-kube-api-access-6hkgc\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.662164 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.661900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-oauth-config\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.662164 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.661926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-oauth-serving-cert\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.662164 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.661943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-service-ca\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.662164 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.661975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-console-config\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.662164 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.662038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-serving-cert\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.662834 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.662807 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-oauth-serving-cert\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.662959 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.662860 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-service-ca\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.663028 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.662984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-console-config\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.664762 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.664714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-serving-cert\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.664762 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.664722 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-oauth-config\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.675316 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.675271 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hkgc\" (UniqueName: \"kubernetes.io/projected/d3345002-2b18-499b-b986-098e516b0f1b-kube-api-access-6hkgc\") pod \"console-ccbcf9dc4-8jktj\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.814534 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.814439 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:16:50.986864 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:50.986836 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ccbcf9dc4-8jktj"] Jul 09 11:16:50.989663 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:16:50.989628 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3345002_2b18_499b_b986_098e516b0f1b.slice/crio-e3a09d41cf815148a693db331fbfb44bc021ce59de40ecff370bf6f448022b88 WatchSource:0}: Error finding container e3a09d41cf815148a693db331fbfb44bc021ce59de40ecff370bf6f448022b88: Status 404 returned error can't find the container with id e3a09d41cf815148a693db331fbfb44bc021ce59de40ecff370bf6f448022b88 Jul 09 11:16:51.631418 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:51.631385 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-89575b84c-zrqrg" Jul 09 11:16:51.646551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:51.646512 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ccbcf9dc4-8jktj" event={"ID":"d3345002-2b18-499b-b986-098e516b0f1b","Type":"ContainerStarted","Data":"e3a09d41cf815148a693db331fbfb44bc021ce59de40ecff370bf6f448022b88"} Jul 09 11:16:54.667239 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:54.667200 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ccbcf9dc4-8jktj" event={"ID":"d3345002-2b18-499b-b986-098e516b0f1b","Type":"ContainerStarted","Data":"9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6"} Jul 09 11:16:55.112692 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.112625 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ccbcf9dc4-8jktj" podStartSLOduration=1.596691482 podStartE2EDuration="5.112596399s" totalImagesPullingTime="3.515904917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:16:54.751473254 +0000 UTC m=+320.662317787" watchObservedRunningTime="2026-07-09 11:16:55.112596399 +0000 UTC m=+321.023440926" Jul 09 11:16:55.113402 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.113376 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cdf6b768-l9mbl"] Jul 09 11:16:55.117297 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.117258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.127292 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.127172 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 11:16:55.145967 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.145908 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cdf6b768-l9mbl"] Jul 09 11:16:55.207122 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.207084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-service-ca\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.207317 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.207134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-oauth-serving-cert\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.207317 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.207214 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-trusted-ca-bundle\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.207317 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.207267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-serving-cert\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.207493 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.207318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-config\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.207493 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.207386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9zql\" (UniqueName: \"kubernetes.io/projected/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-kube-api-access-s9zql\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.207493 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.207430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-oauth-config\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.308826 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.308787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-serving-cert\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.308826 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.308831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-config\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.309050 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.308893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9zql\" (UniqueName: \"kubernetes.io/projected/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-kube-api-access-s9zql\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.309050 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.308921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-oauth-config\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.309050 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.308966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-service-ca\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.309050 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.308994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-oauth-serving-cert\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.309264 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.309052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-trusted-ca-bundle\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.309900 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.309842 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-oauth-serving-cert\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.310023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.309913 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-config\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.310023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.309934 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-service-ca\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.310137 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.310072 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-trusted-ca-bundle\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.312245 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.312221 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-oauth-config\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.312535 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.312515 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-serving-cert\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.348793 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.348761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9zql\" (UniqueName: \"kubernetes.io/projected/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-kube-api-access-s9zql\") pod \"console-6cdf6b768-l9mbl\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:16:55.427980 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:16:55.427887 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:17:00.815347 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:00.815277 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:17:00.815825 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:00.815380 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:17:00.820850 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:00.820825 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:17:01.703794 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:01.703761 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:17:02.525479 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:02.525450 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cdf6b768-l9mbl"] Jul 09 11:17:02.641448 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:17:02.641370 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aeb0095_3c54_46b4_b38f_0f9ba4e96da4.slice/crio-751169ee0257ab372d03d4c3b7c86d7a59625034ee9a44ac4d01cb515c8bce83 WatchSource:0}: Error finding container 751169ee0257ab372d03d4c3b7c86d7a59625034ee9a44ac4d01cb515c8bce83: Status 404 returned error can't find the container with id 751169ee0257ab372d03d4c3b7c86d7a59625034ee9a44ac4d01cb515c8bce83 Jul 09 11:17:02.704959 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:02.704925 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdf6b768-l9mbl" event={"ID":"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4","Type":"ContainerStarted","Data":"751169ee0257ab372d03d4c3b7c86d7a59625034ee9a44ac4d01cb515c8bce83"} Jul 09 11:17:02.706345 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:02.706318 2562 generic.go:356] "Generic (PLEG): container finished" podID="d6979d57-ba97-430b-8da4-12fb9e425387" containerID="95ca414bb311b971edf8a17b5a0d31cd80f9adcefa53b1b2e7e28d6182efb676" exitCode=0 Jul 09 11:17:02.706493 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:02.706385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" event={"ID":"d6979d57-ba97-430b-8da4-12fb9e425387","Type":"ContainerDied","Data":"95ca414bb311b971edf8a17b5a0d31cd80f9adcefa53b1b2e7e28d6182efb676"} Jul 09 11:17:02.706751 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:02.706735 2562 scope.go:117] "RemoveContainer" containerID="95ca414bb311b971edf8a17b5a0d31cd80f9adcefa53b1b2e7e28d6182efb676" Jul 09 11:17:03.714106 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:03.714043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdf6b768-l9mbl" event={"ID":"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4","Type":"ContainerStarted","Data":"7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d"} Jul 09 11:17:03.716636 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:03.716603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7jjnv" event={"ID":"d6979d57-ba97-430b-8da4-12fb9e425387","Type":"ContainerStarted","Data":"db98ef4cbd4dfb266398602b7ef3319ee127b23e8335c5404a794492cf2a200c"} Jul 09 11:17:03.718410 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:03.718383 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-74q7t" event={"ID":"cd59919e-b9a1-4052-b7fb-bb4f5df4fe55","Type":"ContainerStarted","Data":"a1013b56ef5634ebaeffc494390f0c69b7a4c48006655ac490ac94ed114c2446"} Jul 09 11:17:03.718637 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:03.718612 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-74q7t" Jul 09 11:17:03.732990 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:03.732961 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-74q7t" Jul 09 11:17:03.738498 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:03.738448 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cdf6b768-l9mbl" podStartSLOduration=8.738430868 podStartE2EDuration="8.738430868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:17:03.73621816 +0000 UTC m=+329.647062781" watchObservedRunningTime="2026-07-09 11:17:03.738430868 +0000 UTC m=+329.649275394" Jul 09 11:17:03.758541 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:03.758486 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-74q7t" podStartSLOduration=1.682223226 podStartE2EDuration="19.758464704s" totalImagesPullingTime="18.076241478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:17:03.755704753 +0000 UTC m=+329.666549335" watchObservedRunningTime="2026-07-09 11:17:03.758464704 +0000 UTC m=+329.669309234" Jul 09 11:17:05.428299 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:05.428244 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:17:05.428763 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:05.428347 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:17:05.434084 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:05.434058 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:17:05.732447 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:05.732370 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:17:05.814598 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:05.814563 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ccbcf9dc4-8jktj"] Jul 09 11:17:08.304965 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.304868 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" podUID="c049af70-6066-4edb-a95e-257d9f6b6307" containerName="registry" containerID="cri-o://0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d" gracePeriod=30 Jul 09 11:17:08.608834 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.608794 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:17:08.743981 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.743947 2562 generic.go:356] "Generic (PLEG): container finished" podID="7f777ccc-4045-4847-bab9-9119e307a233" containerID="eb37431b03d927fceb61a4971d2240d8eabdfdb923cc414a90104c23024019bb" exitCode=0 Jul 09 11:17:08.744176 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.744021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" event={"ID":"7f777ccc-4045-4847-bab9-9119e307a233","Type":"ContainerDied","Data":"eb37431b03d927fceb61a4971d2240d8eabdfdb923cc414a90104c23024019bb"} Jul 09 11:17:08.744497 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.744471 2562 scope.go:117] "RemoveContainer" containerID="eb37431b03d927fceb61a4971d2240d8eabdfdb923cc414a90104c23024019bb" Jul 09 11:17:08.745764 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.745740 2562 generic.go:356] "Generic (PLEG): container finished" podID="c049af70-6066-4edb-a95e-257d9f6b6307" containerID="0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d" exitCode=0 Jul 09 11:17:08.745854 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.745788 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" Jul 09 11:17:08.745854 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.745800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" event={"ID":"c049af70-6066-4edb-a95e-257d9f6b6307","Type":"ContainerDied","Data":"0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d"} Jul 09 11:17:08.745854 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.745841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96767b5b5-zmtlw" event={"ID":"c049af70-6066-4edb-a95e-257d9f6b6307","Type":"ContainerDied","Data":"73f19fe4f99d643a79a3ed4bcedd116594e5c370b3d24b851fd38cef05650e07"} Jul 09 11:17:08.745984 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.745880 2562 scope.go:117] "RemoveContainer" containerID="0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d" Jul 09 11:17:08.748237 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.748215 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-image-registry-private-configuration\") pod \"c049af70-6066-4edb-a95e-257d9f6b6307\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " Jul 09 11:17:08.748363 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.748244 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-bound-sa-token\") pod \"c049af70-6066-4edb-a95e-257d9f6b6307\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " Jul 09 11:17:08.748363 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.748273 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c049af70-6066-4edb-a95e-257d9f6b6307-ca-trust-extracted\") pod \"c049af70-6066-4edb-a95e-257d9f6b6307\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " Jul 09 11:17:08.748363 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.748321 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-installation-pull-secrets\") pod \"c049af70-6066-4edb-a95e-257d9f6b6307\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " Jul 09 11:17:08.748363 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.748356 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xk8m\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-kube-api-access-7xk8m\") pod \"c049af70-6066-4edb-a95e-257d9f6b6307\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " Jul 09 11:17:08.748575 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.748400 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-registry-certificates\") pod \"c049af70-6066-4edb-a95e-257d9f6b6307\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " Jul 09 11:17:08.748575 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.748434 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") pod \"c049af70-6066-4edb-a95e-257d9f6b6307\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " Jul 09 11:17:08.748575 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.748478 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-trusted-ca\") pod \"c049af70-6066-4edb-a95e-257d9f6b6307\" (UID: \"c049af70-6066-4edb-a95e-257d9f6b6307\") " Jul 09 11:17:08.750612 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.750001 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c049af70-6066-4edb-a95e-257d9f6b6307" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:17:08.751417 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.751362 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c049af70-6066-4edb-a95e-257d9f6b6307" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:17:08.752971 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.752236 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c049af70-6066-4edb-a95e-257d9f6b6307" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:17:08.752971 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.752389 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c049af70-6066-4edb-a95e-257d9f6b6307" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:17:08.753264 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.753044 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c049af70-6066-4edb-a95e-257d9f6b6307" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:17:08.753844 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.753809 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-kube-api-access-7xk8m" (OuterVolumeSpecName: "kube-api-access-7xk8m") pod "c049af70-6066-4edb-a95e-257d9f6b6307" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307"). InnerVolumeSpecName "kube-api-access-7xk8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:17:08.754151 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.754116 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c049af70-6066-4edb-a95e-257d9f6b6307" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:17:08.762211 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.762179 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c049af70-6066-4edb-a95e-257d9f6b6307-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c049af70-6066-4edb-a95e-257d9f6b6307" (UID: "c049af70-6066-4edb-a95e-257d9f6b6307"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:17:08.772121 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.772092 2562 scope.go:117] "RemoveContainer" containerID="0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d" Jul 09 11:17:08.772616 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:17:08.772547 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d\": container with ID starting with 0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d not found: ID does not exist" containerID="0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d" Jul 09 11:17:08.772688 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.772595 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d"} err="failed to get container status \"0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d\": rpc error: code = NotFound desc = could not find container \"0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d\": container with ID starting with 0dd8149e17bc2fc398fcb4e1fe5d239e9f80638c9537949a8df7850bddf2612d not found: ID does not exist" Jul 09 11:17:08.849763 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.849731 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-image-registry-private-configuration\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:08.849763 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.849763 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-bound-sa-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:08.850193 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.849780 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c049af70-6066-4edb-a95e-257d9f6b6307-ca-trust-extracted\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:08.850193 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.849795 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c049af70-6066-4edb-a95e-257d9f6b6307-installation-pull-secrets\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:08.850193 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.849809 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xk8m\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-kube-api-access-7xk8m\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:08.850193 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.849822 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-registry-certificates\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:08.850193 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.849838 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c049af70-6066-4edb-a95e-257d9f6b6307-registry-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:08.850193 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:08.849851 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c049af70-6066-4edb-a95e-257d9f6b6307-trusted-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:09.078555 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:09.078514 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-96767b5b5-zmtlw"] Jul 09 11:17:09.086858 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:09.086830 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-96767b5b5-zmtlw"] Jul 09 11:17:09.752906 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:09.752863 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-smdjf" event={"ID":"7f777ccc-4045-4847-bab9-9119e307a233","Type":"ContainerStarted","Data":"aa6cba784597ef7a69e7c73a81a56c60c58fc38c5b95c9df83379abfeee0a3b4"} Jul 09 11:17:10.611752 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:10.611710 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c049af70-6066-4edb-a95e-257d9f6b6307" path="/var/lib/kubelet/pods/c049af70-6066-4edb-a95e-257d9f6b6307/volumes" Jul 09 11:17:30.844893 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:30.844791 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-ccbcf9dc4-8jktj" podUID="d3345002-2b18-499b-b986-098e516b0f1b" containerName="console" containerID="cri-o://9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6" gracePeriod=15 Jul 09 11:17:31.138703 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.138653 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:17:31.245355 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.245318 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-serving-cert\") pod \"d3345002-2b18-499b-b986-098e516b0f1b\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " Jul 09 11:17:31.245545 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.245368 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-console-config\") pod \"d3345002-2b18-499b-b986-098e516b0f1b\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " Jul 09 11:17:31.245545 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.245389 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-oauth-config\") pod \"d3345002-2b18-499b-b986-098e516b0f1b\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " Jul 09 11:17:31.245545 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.245505 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-oauth-serving-cert\") pod \"d3345002-2b18-499b-b986-098e516b0f1b\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " Jul 09 11:17:31.245545 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.245537 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-service-ca\") pod \"d3345002-2b18-499b-b986-098e516b0f1b\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " Jul 09 11:17:31.245761 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.245581 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hkgc\" (UniqueName: \"kubernetes.io/projected/d3345002-2b18-499b-b986-098e516b0f1b-kube-api-access-6hkgc\") pod \"d3345002-2b18-499b-b986-098e516b0f1b\" (UID: \"d3345002-2b18-499b-b986-098e516b0f1b\") " Jul 09 11:17:31.245929 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.245903 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-console-config" (OuterVolumeSpecName: "console-config") pod "d3345002-2b18-499b-b986-098e516b0f1b" (UID: "d3345002-2b18-499b-b986-098e516b0f1b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:17:31.246020 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.245959 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-service-ca" (OuterVolumeSpecName: "service-ca") pod "d3345002-2b18-499b-b986-098e516b0f1b" (UID: "d3345002-2b18-499b-b986-098e516b0f1b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:17:31.246020 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.245967 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d3345002-2b18-499b-b986-098e516b0f1b" (UID: "d3345002-2b18-499b-b986-098e516b0f1b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:17:31.247873 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.247819 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d3345002-2b18-499b-b986-098e516b0f1b" (UID: "d3345002-2b18-499b-b986-098e516b0f1b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:17:31.247873 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.247847 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d3345002-2b18-499b-b986-098e516b0f1b" (UID: "d3345002-2b18-499b-b986-098e516b0f1b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:17:31.248023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.247878 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3345002-2b18-499b-b986-098e516b0f1b-kube-api-access-6hkgc" (OuterVolumeSpecName: "kube-api-access-6hkgc") pod "d3345002-2b18-499b-b986-098e516b0f1b" (UID: "d3345002-2b18-499b-b986-098e516b0f1b"). InnerVolumeSpecName "kube-api-access-6hkgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:17:31.346471 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.346432 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-serving-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:31.346471 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.346464 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-console-config\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:31.346471 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.346474 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3345002-2b18-499b-b986-098e516b0f1b-console-oauth-config\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:31.346471 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.346482 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-oauth-serving-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:31.346747 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.346491 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3345002-2b18-499b-b986-098e516b0f1b-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:31.346747 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.346499 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hkgc\" (UniqueName: \"kubernetes.io/projected/d3345002-2b18-499b-b986-098e516b0f1b-kube-api-access-6hkgc\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:31.849022 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.848984 2562 generic.go:356] "Generic (PLEG): container finished" podID="d3345002-2b18-499b-b986-098e516b0f1b" containerID="9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6" exitCode=0 Jul 09 11:17:31.849512 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.849029 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ccbcf9dc4-8jktj" Jul 09 11:17:31.849512 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.849056 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ccbcf9dc4-8jktj" event={"ID":"d3345002-2b18-499b-b986-098e516b0f1b","Type":"ContainerDied","Data":"9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6"} Jul 09 11:17:31.849512 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.849105 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ccbcf9dc4-8jktj" event={"ID":"d3345002-2b18-499b-b986-098e516b0f1b","Type":"ContainerDied","Data":"e3a09d41cf815148a693db331fbfb44bc021ce59de40ecff370bf6f448022b88"} Jul 09 11:17:31.849512 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.849135 2562 scope.go:117] "RemoveContainer" containerID="9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6" Jul 09 11:17:31.857732 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.857705 2562 scope.go:117] "RemoveContainer" containerID="9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6" Jul 09 11:17:31.858034 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:17:31.858016 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6\": container with ID starting with 9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6 not found: ID does not exist" containerID="9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6" Jul 09 11:17:31.858090 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.858046 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6"} err="failed to get container status \"9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6\": rpc error: code = NotFound desc = could not find container \"9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6\": container with ID starting with 9bf926840c7183b289084fd55583fe7868b016b4cdc739b6bc79ee33bdc190e6 not found: ID does not exist" Jul 09 11:17:31.875415 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.875384 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ccbcf9dc4-8jktj"] Jul 09 11:17:31.879697 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:31.879669 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-ccbcf9dc4-8jktj"] Jul 09 11:17:32.610889 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:32.610855 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3345002-2b18-499b-b986-098e516b0f1b" path="/var/lib/kubelet/pods/d3345002-2b18-499b-b986-098e516b0f1b/volumes" Jul 09 11:17:48.499903 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:48.499866 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:17:48.502180 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:48.502156 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a462c5b-8391-4aaa-a694-a1ef4effd722-metrics-certs\") pod \"network-metrics-daemon-h5dgn\" (UID: \"9a462c5b-8391-4aaa-a694-a1ef4effd722\") " pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:17:48.709429 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:48.709399 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h6b4g\"" Jul 09 11:17:48.717134 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:48.717098 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dgn" Jul 09 11:17:48.881335 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:48.881268 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h5dgn"] Jul 09 11:17:48.883630 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:17:48.883604 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a462c5b_8391_4aaa_a694_a1ef4effd722.slice/crio-c9dc698aa0e000f127639812ad9705b82e116f38afb7f7b72d5a56af229fee45 WatchSource:0}: Error finding container c9dc698aa0e000f127639812ad9705b82e116f38afb7f7b72d5a56af229fee45: Status 404 returned error can't find the container with id c9dc698aa0e000f127639812ad9705b82e116f38afb7f7b72d5a56af229fee45 Jul 09 11:17:48.921879 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:48.921849 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5dgn" event={"ID":"9a462c5b-8391-4aaa-a694-a1ef4effd722","Type":"ContainerStarted","Data":"c9dc698aa0e000f127639812ad9705b82e116f38afb7f7b72d5a56af229fee45"} Jul 09 11:17:50.939692 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:50.939656 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5dgn" event={"ID":"9a462c5b-8391-4aaa-a694-a1ef4effd722","Type":"ContainerStarted","Data":"c73433286f4c1ba0477432f8e015d4489e56eca561b930db1a5c5082f7ba13d2"} Jul 09 11:17:50.940040 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:50.939750 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5dgn" event={"ID":"9a462c5b-8391-4aaa-a694-a1ef4effd722","Type":"ContainerStarted","Data":"fa815483f8c733854880d0dbe40d5f3c84430a5ca022b63078e5ac9f1c65117c"} Jul 09 11:17:50.959676 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:50.959607 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h5dgn" podStartSLOduration=375.092549717 podStartE2EDuration="6m16.959590882s" totalImagesPullingTime="1.867041165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:17:50.95797185 +0000 UTC m=+376.868816379" watchObservedRunningTime="2026-07-09 11:17:50.959590882 +0000 UTC m=+376.870435455" Jul 09 11:17:57.822486 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.822448 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 11:17:57.823014 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.822774 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="alertmanager" containerID="cri-o://848a40bc129db4744f85c0501ecf34595653f475ceb68755f8a3795257d1c08b" gracePeriod=120 Jul 09 11:17:57.823014 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.822813 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy-metric" containerID="cri-o://c8c522ec80b1cff5d5941498e8b5024dbeda3e0916b1c8198b17486fd36b04a3" gracePeriod=120 Jul 09 11:17:57.823014 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.822842 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy-web" containerID="cri-o://26f82e676977e975c16ec108361c09440a12636e01aaac7b78f8387dcfde307a" gracePeriod=120 Jul 09 11:17:57.823014 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.822853 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy" containerID="cri-o://8569e54fcc3917d1fd17f224e03f356d461c289ff5cda1a21fa8a676ae2026b6" gracePeriod=120 Jul 09 11:17:57.823014 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.822903 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="prom-label-proxy" containerID="cri-o://09968824267feb3090a1aa33a4025540d980dbbf0947c5292b7a469915c428cb" gracePeriod=120 Jul 09 11:17:57.823014 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.822901 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="config-reloader" containerID="cri-o://c09a804febe8ea4b68c77b626dcc6bf108a3cdb31700786fcd06f55f0b4b307f" gracePeriod=120 Jul 09 11:17:57.971346 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.971316 2562 generic.go:356] "Generic (PLEG): container finished" podID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerID="09968824267feb3090a1aa33a4025540d980dbbf0947c5292b7a469915c428cb" exitCode=0 Jul 09 11:17:57.971346 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.971338 2562 generic.go:356] "Generic (PLEG): container finished" podID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerID="c8c522ec80b1cff5d5941498e8b5024dbeda3e0916b1c8198b17486fd36b04a3" exitCode=0 Jul 09 11:17:57.971346 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.971347 2562 generic.go:356] "Generic (PLEG): container finished" podID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerID="8569e54fcc3917d1fd17f224e03f356d461c289ff5cda1a21fa8a676ae2026b6" exitCode=0 Jul 09 11:17:57.971346 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.971353 2562 generic.go:356] "Generic (PLEG): container finished" podID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerID="c09a804febe8ea4b68c77b626dcc6bf108a3cdb31700786fcd06f55f0b4b307f" exitCode=0 Jul 09 11:17:57.971640 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.971358 2562 generic.go:356] "Generic (PLEG): container finished" podID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerID="848a40bc129db4744f85c0501ecf34595653f475ceb68755f8a3795257d1c08b" exitCode=0 Jul 09 11:17:57.971640 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.971390 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerDied","Data":"09968824267feb3090a1aa33a4025540d980dbbf0947c5292b7a469915c428cb"} Jul 09 11:17:57.971640 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.971454 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerDied","Data":"c8c522ec80b1cff5d5941498e8b5024dbeda3e0916b1c8198b17486fd36b04a3"} Jul 09 11:17:57.971640 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.971483 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerDied","Data":"8569e54fcc3917d1fd17f224e03f356d461c289ff5cda1a21fa8a676ae2026b6"} Jul 09 11:17:57.971640 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.971507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerDied","Data":"c09a804febe8ea4b68c77b626dcc6bf108a3cdb31700786fcd06f55f0b4b307f"} Jul 09 11:17:57.971640 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:57.971531 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerDied","Data":"848a40bc129db4744f85c0501ecf34595653f475ceb68755f8a3795257d1c08b"} Jul 09 11:17:58.979728 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:58.979697 2562 generic.go:356] "Generic (PLEG): container finished" podID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerID="26f82e676977e975c16ec108361c09440a12636e01aaac7b78f8387dcfde307a" exitCode=0 Jul 09 11:17:58.980101 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:58.979753 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerDied","Data":"26f82e676977e975c16ec108361c09440a12636e01aaac7b78f8387dcfde307a"} Jul 09 11:17:59.094319 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.094294 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:17:59.190850 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.190759 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-trusted-ca-bundle\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.190850 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.190795 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.190850 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.190828 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-metrics-client-ca\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.190850 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.190849 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-web\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.191177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.190873 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.191177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.190893 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-tls-assets\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.191177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.190911 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggxdc\" (UniqueName: \"kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-kube-api-access-ggxdc\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.191177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.190941 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-web-config\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.191177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.190986 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-out\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.191177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.191017 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-cluster-tls-config\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.191177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.191055 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-main-db\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.191177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.191107 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-main-tls\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.191177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.191143 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-volume\") pod \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\" (UID: \"9a627582-9dd7-42fe-ba2f-be65c0e00b5a\") " Jul 09 11:17:59.191617 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.191192 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:17:59.191617 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.191205 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:17:59.191617 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.191445 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.191617 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.191466 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-metrics-client-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.191818 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.191767 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:17:59.193965 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.193928 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-out" (OuterVolumeSpecName: "config-out") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:17:59.194189 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.194128 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-kube-api-access-ggxdc" (OuterVolumeSpecName: "kube-api-access-ggxdc") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "kube-api-access-ggxdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:17:59.194189 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.194159 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:17:59.194189 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.194173 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:17:59.194189 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.194187 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-volume" (OuterVolumeSpecName: "config-volume") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:17:59.194511 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.194473 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:17:59.194986 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.194961 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:17:59.195561 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.195530 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:17:59.199049 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.199020 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:17:59.206073 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.206034 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-web-config" (OuterVolumeSpecName: "web-config") pod "9a627582-9dd7-42fe-ba2f-be65c0e00b5a" (UID: "9a627582-9dd7-42fe-ba2f-be65c0e00b5a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:17:59.297769 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.297726 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-main-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.297769 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.297764 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-volume\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.297987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.297778 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.297987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.297930 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.297987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.297939 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.297987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.297948 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-tls-assets\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.297987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.297957 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggxdc\" (UniqueName: \"kubernetes.io/projected/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-kube-api-access-ggxdc\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.297987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.297965 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-web-config\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.297987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.297973 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-config-out\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.297987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.297981 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-cluster-tls-config\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.297987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.297989 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a627582-9dd7-42fe-ba2f-be65c0e00b5a-alertmanager-main-db\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:17:59.987223 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.987191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a627582-9dd7-42fe-ba2f-be65c0e00b5a","Type":"ContainerDied","Data":"50a1691c88d790da12f92f223e3998ee78c0f508be2acad5ff6299763a25bf9d"} Jul 09 11:17:59.987223 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.987226 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:17:59.987775 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.987266 2562 scope.go:117] "RemoveContainer" containerID="09968824267feb3090a1aa33a4025540d980dbbf0947c5292b7a469915c428cb" Jul 09 11:17:59.995412 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:17:59.995387 2562 scope.go:117] "RemoveContainer" containerID="c8c522ec80b1cff5d5941498e8b5024dbeda3e0916b1c8198b17486fd36b04a3" Jul 09 11:18:00.002510 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.002491 2562 scope.go:117] "RemoveContainer" containerID="8569e54fcc3917d1fd17f224e03f356d461c289ff5cda1a21fa8a676ae2026b6" Jul 09 11:18:00.009965 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.009945 2562 scope.go:117] "RemoveContainer" containerID="26f82e676977e975c16ec108361c09440a12636e01aaac7b78f8387dcfde307a" Jul 09 11:18:00.016818 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.016798 2562 scope.go:117] "RemoveContainer" containerID="c09a804febe8ea4b68c77b626dcc6bf108a3cdb31700786fcd06f55f0b4b307f" Jul 09 11:18:00.024760 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.024729 2562 scope.go:117] "RemoveContainer" containerID="848a40bc129db4744f85c0501ecf34595653f475ceb68755f8a3795257d1c08b" Jul 09 11:18:00.026016 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.025998 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 11:18:00.029806 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.029785 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 11:18:00.033188 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.033172 2562 scope.go:117] "RemoveContainer" containerID="09001a1c78c5dcdd350546bccac9181ee08a3b7c442644dd711165c8a51204c1" Jul 09 11:18:00.099069 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099038 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 11:18:00.099382 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099369 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3345002-2b18-499b-b986-098e516b0f1b" containerName="console" Jul 09 11:18:00.099431 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099383 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3345002-2b18-499b-b986-098e516b0f1b" containerName="console" Jul 09 11:18:00.099431 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099396 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy" Jul 09 11:18:00.099431 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099402 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy" Jul 09 11:18:00.099431 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099412 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="alertmanager" Jul 09 11:18:00.099431 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099419 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="alertmanager" Jul 09 11:18:00.099431 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099427 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="init-config-reloader" Jul 09 11:18:00.099431 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099432 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="init-config-reloader" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099439 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="prom-label-proxy" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099445 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="prom-label-proxy" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099453 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="config-reloader" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099457 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="config-reloader" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099463 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy-metric" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099468 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy-metric" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099474 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy-web" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099479 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy-web" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099488 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c049af70-6066-4edb-a95e-257d9f6b6307" containerName="registry" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099492 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c049af70-6066-4edb-a95e-257d9f6b6307" containerName="registry" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099544 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="prom-label-proxy" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099552 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3345002-2b18-499b-b986-098e516b0f1b" containerName="console" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099559 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099566 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy-metric" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099571 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="config-reloader" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099590 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c049af70-6066-4edb-a95e-257d9f6b6307" containerName="registry" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099596 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="alertmanager" Jul 09 11:18:00.099638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.099603 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" containerName="kube-rbac-proxy-web" Jul 09 11:18:00.103374 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.103356 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.107435 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.107404 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 11:18:00.107435 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.107418 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 11:18:00.107862 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.107843 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 11:18:00.108014 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.107991 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 11:18:00.108126 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.108015 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 11:18:00.108363 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.108341 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 11:18:00.108467 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.108450 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 11:18:00.108599 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.108584 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 11:18:00.109604 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.109580 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fsfds\"" Jul 09 11:18:00.120974 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.120948 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 11:18:00.130182 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.130151 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 11:18:00.206551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206451 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/543ff77a-1021-4476-9c7d-b7d95582942f-config-out\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206551 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206514 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-web-config\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206782 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543ff77a-1021-4476-9c7d-b7d95582942f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206782 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/543ff77a-1021-4476-9c7d-b7d95582942f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206782 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206782 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/543ff77a-1021-4476-9c7d-b7d95582942f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206782 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206994 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206994 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206994 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-config-volume\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206994 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/543ff77a-1021-4476-9c7d-b7d95582942f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.206994 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.206880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbhk8\" (UniqueName: \"kubernetes.io/projected/543ff77a-1021-4476-9c7d-b7d95582942f-kube-api-access-qbhk8\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.307944 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.307905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.307944 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.307941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.308206 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.307962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-config-volume\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.308206 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/543ff77a-1021-4476-9c7d-b7d95582942f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.308206 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbhk8\" (UniqueName: \"kubernetes.io/projected/543ff77a-1021-4476-9c7d-b7d95582942f-kube-api-access-qbhk8\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.308817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/543ff77a-1021-4476-9c7d-b7d95582942f-config-out\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.308817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.308817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-web-config\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.308817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308323 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543ff77a-1021-4476-9c7d-b7d95582942f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.308817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/543ff77a-1021-4476-9c7d-b7d95582942f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.308817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.308817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/543ff77a-1021-4476-9c7d-b7d95582942f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.308817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.309245 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308842 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/543ff77a-1021-4476-9c7d-b7d95582942f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.309245 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.308885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/543ff77a-1021-4476-9c7d-b7d95582942f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.311134 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.311001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.311407 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.311377 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.311519 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.311387 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.311519 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.311479 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543ff77a-1021-4476-9c7d-b7d95582942f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.311519 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.311507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-web-config\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.311696 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.311614 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.311767 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.311742 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-config-volume\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.311821 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.311810 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/543ff77a-1021-4476-9c7d-b7d95582942f-config-out\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.312655 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.312632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/543ff77a-1021-4476-9c7d-b7d95582942f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.313322 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.313300 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/543ff77a-1021-4476-9c7d-b7d95582942f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.323763 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.323741 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbhk8\" (UniqueName: \"kubernetes.io/projected/543ff77a-1021-4476-9c7d-b7d95582942f-kube-api-access-qbhk8\") pod \"alertmanager-main-0\" (UID: \"543ff77a-1021-4476-9c7d-b7d95582942f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.413116 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.413072 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 11:18:00.563110 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.561030 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 11:18:00.563256 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:18:00.563204 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543ff77a_1021_4476_9c7d_b7d95582942f.slice/crio-cb1a901ce578947b69d07a28544be1087724fba9390d3f4c5f9d8ce0dd671164 WatchSource:0}: Error finding container cb1a901ce578947b69d07a28544be1087724fba9390d3f4c5f9d8ce0dd671164: Status 404 returned error can't find the container with id cb1a901ce578947b69d07a28544be1087724fba9390d3f4c5f9d8ce0dd671164 Jul 09 11:18:00.611592 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.611558 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a627582-9dd7-42fe-ba2f-be65c0e00b5a" path="/var/lib/kubelet/pods/9a627582-9dd7-42fe-ba2f-be65c0e00b5a/volumes" Jul 09 11:18:00.993481 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.993444 2562 generic.go:356] "Generic (PLEG): container finished" podID="543ff77a-1021-4476-9c7d-b7d95582942f" containerID="094edfa8a6dee7b13711024a0bdeb9f2fb71c2718e236c0e549a69b37ecaaf0d" exitCode=0 Jul 09 11:18:00.993984 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.993515 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"543ff77a-1021-4476-9c7d-b7d95582942f","Type":"ContainerDied","Data":"094edfa8a6dee7b13711024a0bdeb9f2fb71c2718e236c0e549a69b37ecaaf0d"} Jul 09 11:18:00.993984 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:00.993590 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"543ff77a-1021-4476-9c7d-b7d95582942f","Type":"ContainerStarted","Data":"cb1a901ce578947b69d07a28544be1087724fba9390d3f4c5f9d8ce0dd671164"} Jul 09 11:18:02.001765 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:02.001728 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"543ff77a-1021-4476-9c7d-b7d95582942f","Type":"ContainerStarted","Data":"690a4177be0dd0659eeb22fde2311d0d914445617a4192c4eb618a20077cfe74"} Jul 09 11:18:02.002175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:02.001847 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"543ff77a-1021-4476-9c7d-b7d95582942f","Type":"ContainerStarted","Data":"0b5a0b4925ef53c82500f72961024b76583f3a1d0f7125fb739a45a613dbff16"} Jul 09 11:18:02.002175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:02.001878 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"543ff77a-1021-4476-9c7d-b7d95582942f","Type":"ContainerStarted","Data":"f976423992ded42aa6e9673ef2bddb89f381029b86f6a3659e793515c4437469"} Jul 09 11:18:02.002175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:02.001905 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"543ff77a-1021-4476-9c7d-b7d95582942f","Type":"ContainerStarted","Data":"c148082a02627711d7ad2cdd86798e39c2f45aaa8d1b421673442af19f44cb15"} Jul 09 11:18:02.002175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:02.001938 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"543ff77a-1021-4476-9c7d-b7d95582942f","Type":"ContainerStarted","Data":"371f0356115227f5111c85a1009c63efb42bb0ae3f8f3ec99b442535e2786dc2"} Jul 09 11:18:02.002175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:02.001973 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"543ff77a-1021-4476-9c7d-b7d95582942f","Type":"ContainerStarted","Data":"57e06d017c38363f4c00fc5b04969c79bcf45416e729f7a86aba22e262381676"} Jul 09 11:18:02.041931 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:02.041873 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.026425186 podStartE2EDuration="2.041854346s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.42916ms" isStatefulPod=false podCreationTimestamp="2026-07-09 11:18:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:18:02.041143054 +0000 UTC m=+387.951987580" watchObservedRunningTime="2026-07-09 11:18:02.041854346 +0000 UTC m=+387.952698872" Jul 09 11:18:03.780774 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.780745 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7979f66cc7-xjh5m"] Jul 09 11:18:03.783369 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.783351 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.808075 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.808038 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7979f66cc7-xjh5m"] Jul 09 11:18:03.838943 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.838905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-serving-cert\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.839134 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.838974 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-service-ca\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.839134 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.839000 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-trusted-ca-bundle\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.839134 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.839037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q889f\" (UniqueName: \"kubernetes.io/projected/5a7d903a-eed6-4080-8fbe-37160f8284c0-kube-api-access-q889f\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.839134 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.839065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-config\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.839134 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.839111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-oauth-config\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.839417 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.839158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-oauth-serving-cert\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.940140 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.940097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-serving-cert\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.940140 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.940146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-service-ca\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.940389 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.940257 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-trusted-ca-bundle\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.940389 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.940353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q889f\" (UniqueName: \"kubernetes.io/projected/5a7d903a-eed6-4080-8fbe-37160f8284c0-kube-api-access-q889f\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.940459 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.940398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-config\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.940459 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.940430 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-oauth-config\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.940546 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.940467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-oauth-serving-cert\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.940957 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.940924 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-service-ca\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.941096 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.941072 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-config\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.941141 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.941079 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-trusted-ca-bundle\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.941196 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.941172 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-oauth-serving-cert\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.942647 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.942626 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-serving-cert\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.942837 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.942811 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-oauth-config\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:03.951077 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:03.951055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q889f\" (UniqueName: \"kubernetes.io/projected/5a7d903a-eed6-4080-8fbe-37160f8284c0-kube-api-access-q889f\") pod \"console-7979f66cc7-xjh5m\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:04.094262 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:04.094223 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:04.230486 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:04.230389 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7979f66cc7-xjh5m"] Jul 09 11:18:04.233154 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:18:04.233122 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7d903a_eed6_4080_8fbe_37160f8284c0.slice/crio-799071777f27b25461ff8aab668f1d73ab5aca6cd2673e189103e2e9646a171f WatchSource:0}: Error finding container 799071777f27b25461ff8aab668f1d73ab5aca6cd2673e189103e2e9646a171f: Status 404 returned error can't find the container with id 799071777f27b25461ff8aab668f1d73ab5aca6cd2673e189103e2e9646a171f Jul 09 11:18:05.017473 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:05.017436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7979f66cc7-xjh5m" event={"ID":"5a7d903a-eed6-4080-8fbe-37160f8284c0","Type":"ContainerStarted","Data":"a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0"} Jul 09 11:18:05.017840 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:05.017493 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7979f66cc7-xjh5m" event={"ID":"5a7d903a-eed6-4080-8fbe-37160f8284c0","Type":"ContainerStarted","Data":"799071777f27b25461ff8aab668f1d73ab5aca6cd2673e189103e2e9646a171f"} Jul 09 11:18:05.056880 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:05.056826 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7979f66cc7-xjh5m" podStartSLOduration=2.056810041 podStartE2EDuration="2.056810041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:18:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:18:05.054735424 +0000 UTC m=+390.965579993" watchObservedRunningTime="2026-07-09 11:18:05.056810041 +0000 UTC m=+390.967654624" Jul 09 11:18:14.094611 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:14.094571 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:14.095088 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:14.094639 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:14.099449 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:14.099418 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:15.065708 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:15.065679 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:18:15.119494 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:15.119461 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cdf6b768-l9mbl"] Jul 09 11:18:40.142057 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.142018 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cdf6b768-l9mbl" podUID="0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" containerName="console" containerID="cri-o://7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d" gracePeriod=15 Jul 09 11:18:40.383388 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.383364 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:18:40.557646 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.557553 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-oauth-config\") pod \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " Jul 09 11:18:40.557646 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.557596 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-trusted-ca-bundle\") pod \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " Jul 09 11:18:40.557646 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.557633 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-config\") pod \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " Jul 09 11:18:40.557933 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.557656 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-service-ca\") pod \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " Jul 09 11:18:40.557933 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.557684 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9zql\" (UniqueName: \"kubernetes.io/projected/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-kube-api-access-s9zql\") pod \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " Jul 09 11:18:40.557933 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.557727 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-serving-cert\") pod \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " Jul 09 11:18:40.557933 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.557793 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-oauth-serving-cert\") pod \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\" (UID: \"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4\") " Jul 09 11:18:40.558198 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.558116 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-service-ca" (OuterVolumeSpecName: "service-ca") pod "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" (UID: "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:18:40.558251 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.558128 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-config" (OuterVolumeSpecName: "console-config") pod "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" (UID: "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:18:40.558325 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.558259 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" (UID: "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:18:40.558325 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.558315 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" (UID: "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:18:40.559834 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.559813 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-kube-api-access-s9zql" (OuterVolumeSpecName: "kube-api-access-s9zql") pod "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" (UID: "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4"). InnerVolumeSpecName "kube-api-access-s9zql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:18:40.560241 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.560218 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" (UID: "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:18:40.560241 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.560236 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" (UID: "0aeb0095-3c54-46b4-b38f-0f9ba4e96da4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:18:40.658590 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.658549 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-oauth-serving-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:18:40.658590 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.658584 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-oauth-config\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:18:40.658590 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.658593 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-trusted-ca-bundle\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:18:40.658817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.658602 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-config\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:18:40.658817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.658614 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:18:40.658817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.658627 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9zql\" (UniqueName: \"kubernetes.io/projected/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-kube-api-access-s9zql\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:18:40.658817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:40.658640 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4-console-serving-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:18:41.183101 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:41.183067 2562 generic.go:356] "Generic (PLEG): container finished" podID="0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" containerID="7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d" exitCode=0 Jul 09 11:18:41.183529 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:41.183107 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdf6b768-l9mbl" Jul 09 11:18:41.183529 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:41.183118 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdf6b768-l9mbl" event={"ID":"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4","Type":"ContainerDied","Data":"7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d"} Jul 09 11:18:41.183529 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:41.183160 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdf6b768-l9mbl" event={"ID":"0aeb0095-3c54-46b4-b38f-0f9ba4e96da4","Type":"ContainerDied","Data":"751169ee0257ab372d03d4c3b7c86d7a59625034ee9a44ac4d01cb515c8bce83"} Jul 09 11:18:41.183529 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:41.183180 2562 scope.go:117] "RemoveContainer" containerID="7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d" Jul 09 11:18:41.191593 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:41.191574 2562 scope.go:117] "RemoveContainer" containerID="7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d" Jul 09 11:18:41.191897 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:18:41.191872 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d\": container with ID starting with 7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d not found: ID does not exist" containerID="7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d" Jul 09 11:18:41.191994 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:41.191903 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d"} err="failed to get container status \"7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d\": rpc error: code = NotFound desc = could not find container \"7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d\": container with ID starting with 7bf7da5a1b2842f2072b9b5d93570ece9519d5490e9aba141b7a6943da6c689d not found: ID does not exist" Jul 09 11:18:41.201136 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:41.201107 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cdf6b768-l9mbl"] Jul 09 11:18:41.204594 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:41.204573 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cdf6b768-l9mbl"] Jul 09 11:18:42.611155 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:18:42.611118 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" path="/var/lib/kubelet/pods/0aeb0095-3c54-46b4-b38f-0f9ba4e96da4/volumes" Jul 09 11:19:01.434009 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.433974 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz"] Jul 09 11:19:01.434454 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.434434 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" containerName="console" Jul 09 11:19:01.434497 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.434459 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" containerName="console" Jul 09 11:19:01.434544 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.434535 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aeb0095-3c54-46b4-b38f-0f9ba4e96da4" containerName="console" Jul 09 11:19:01.437894 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.437872 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:01.440860 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.440839 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 11:19:01.442183 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.442159 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rpj9v\"" Jul 09 11:19:01.442337 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.442221 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 11:19:01.447360 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.447336 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz"] Jul 09 11:19:01.522799 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.522763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb466\" (UniqueName: \"kubernetes.io/projected/4ad6975f-b746-4dc3-a59e-7347162ee5fe-kube-api-access-tb466\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:01.522987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.522815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:01.522987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.522910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:01.623645 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.623611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:01.623805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.623669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:01.623805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.623737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb466\" (UniqueName: \"kubernetes.io/projected/4ad6975f-b746-4dc3-a59e-7347162ee5fe-kube-api-access-tb466\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:01.623987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.623966 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:01.624052 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.624023 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:01.632295 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.632246 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb466\" (UniqueName: \"kubernetes.io/projected/4ad6975f-b746-4dc3-a59e-7347162ee5fe-kube-api-access-tb466\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:01.748617 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.748524 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:01.895096 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:01.895067 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz"] Jul 09 11:19:01.897021 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:19:01.896995 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad6975f_b746_4dc3_a59e_7347162ee5fe.slice/crio-7543de2476d5fc104f62a4db2d029c81248c060f95ab1dc92750ba34c703d7d1 WatchSource:0}: Error finding container 7543de2476d5fc104f62a4db2d029c81248c060f95ab1dc92750ba34c703d7d1: Status 404 returned error can't find the container with id 7543de2476d5fc104f62a4db2d029c81248c060f95ab1dc92750ba34c703d7d1 Jul 09 11:19:02.273060 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:02.273024 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" event={"ID":"4ad6975f-b746-4dc3-a59e-7347162ee5fe","Type":"ContainerStarted","Data":"7543de2476d5fc104f62a4db2d029c81248c060f95ab1dc92750ba34c703d7d1"} Jul 09 11:19:10.314344 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:10.314305 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ad6975f-b746-4dc3-a59e-7347162ee5fe" containerID="30f534cfc4aa4752acef975709f2e08632fb015db4fbdc648e5cecd405e46b25" exitCode=0 Jul 09 11:19:10.314769 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:10.314369 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" event={"ID":"4ad6975f-b746-4dc3-a59e-7347162ee5fe","Type":"ContainerDied","Data":"30f534cfc4aa4752acef975709f2e08632fb015db4fbdc648e5cecd405e46b25"} Jul 09 11:19:13.335649 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:13.335612 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ad6975f-b746-4dc3-a59e-7347162ee5fe" containerID="b2c6cea694e76480c46834507ebf0a3e48974dc2899fd722343e33a8874eb41d" exitCode=0 Jul 09 11:19:13.336114 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:13.335694 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" event={"ID":"4ad6975f-b746-4dc3-a59e-7347162ee5fe","Type":"ContainerDied","Data":"b2c6cea694e76480c46834507ebf0a3e48974dc2899fd722343e33a8874eb41d"} Jul 09 11:19:21.381510 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:21.381475 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ad6975f-b746-4dc3-a59e-7347162ee5fe" containerID="ba32a874cad9ae6a0a0ce492167424237653d911ff5c760cda2abf889f30b133" exitCode=0 Jul 09 11:19:21.381909 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:21.381547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" event={"ID":"4ad6975f-b746-4dc3-a59e-7347162ee5fe","Type":"ContainerDied","Data":"ba32a874cad9ae6a0a0ce492167424237653d911ff5c760cda2abf889f30b133"} Jul 09 11:19:22.514024 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:22.514001 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:22.610676 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:22.610638 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tb466\" (UniqueName: \"kubernetes.io/projected/4ad6975f-b746-4dc3-a59e-7347162ee5fe-kube-api-access-tb466\") pod \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " Jul 09 11:19:22.610882 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:22.610697 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-bundle\") pod \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " Jul 09 11:19:22.610882 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:22.610725 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-util\") pod \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\" (UID: \"4ad6975f-b746-4dc3-a59e-7347162ee5fe\") " Jul 09 11:19:22.611520 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:22.611486 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-bundle" (OuterVolumeSpecName: "bundle") pod "4ad6975f-b746-4dc3-a59e-7347162ee5fe" (UID: "4ad6975f-b746-4dc3-a59e-7347162ee5fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:19:22.612827 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:22.612803 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad6975f-b746-4dc3-a59e-7347162ee5fe-kube-api-access-tb466" (OuterVolumeSpecName: "kube-api-access-tb466") pod "4ad6975f-b746-4dc3-a59e-7347162ee5fe" (UID: "4ad6975f-b746-4dc3-a59e-7347162ee5fe"). InnerVolumeSpecName "kube-api-access-tb466". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:19:22.615557 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:22.615530 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-util" (OuterVolumeSpecName: "util") pod "4ad6975f-b746-4dc3-a59e-7347162ee5fe" (UID: "4ad6975f-b746-4dc3-a59e-7347162ee5fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:19:22.712190 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:22.712095 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tb466\" (UniqueName: \"kubernetes.io/projected/4ad6975f-b746-4dc3-a59e-7347162ee5fe-kube-api-access-tb466\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:19:22.712190 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:22.712127 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-bundle\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:19:22.712190 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:22.712140 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ad6975f-b746-4dc3-a59e-7347162ee5fe-util\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:19:23.392622 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:23.392581 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" event={"ID":"4ad6975f-b746-4dc3-a59e-7347162ee5fe","Type":"ContainerDied","Data":"7543de2476d5fc104f62a4db2d029c81248c060f95ab1dc92750ba34c703d7d1"} Jul 09 11:19:23.392800 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:23.392642 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7543de2476d5fc104f62a4db2d029c81248c060f95ab1dc92750ba34c703d7d1" Jul 09 11:19:23.392800 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:23.392603 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nh7qz" Jul 09 11:19:29.684952 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.684914 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk"] Jul 09 11:19:29.685361 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.685246 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad6975f-b746-4dc3-a59e-7347162ee5fe" containerName="util" Jul 09 11:19:29.685361 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.685257 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad6975f-b746-4dc3-a59e-7347162ee5fe" containerName="util" Jul 09 11:19:29.685361 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.685274 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad6975f-b746-4dc3-a59e-7347162ee5fe" containerName="pull" Jul 09 11:19:29.685361 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.685295 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad6975f-b746-4dc3-a59e-7347162ee5fe" containerName="pull" Jul 09 11:19:29.685361 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.685306 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad6975f-b746-4dc3-a59e-7347162ee5fe" containerName="extract" Jul 09 11:19:29.685361 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.685311 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad6975f-b746-4dc3-a59e-7347162ee5fe" containerName="extract" Jul 09 11:19:29.685559 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.685375 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ad6975f-b746-4dc3-a59e-7347162ee5fe" containerName="extract" Jul 09 11:19:29.687385 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.687370 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk" Jul 09 11:19:29.690202 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.690179 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 11:19:29.690451 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.690435 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-47h7d\"" Jul 09 11:19:29.690545 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.690465 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 11:19:29.704803 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.704779 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk"] Jul 09 11:19:29.776969 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.776934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/831c6e8a-aa00-4653-a89f-c6b37a945bde-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-46hhk\" (UID: \"831c6e8a-aa00-4653-a89f-c6b37a945bde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk" Jul 09 11:19:29.777157 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.777005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdqw7\" (UniqueName: \"kubernetes.io/projected/831c6e8a-aa00-4653-a89f-c6b37a945bde-kube-api-access-sdqw7\") pod \"cert-manager-operator-controller-manager-55c444bf86-46hhk\" (UID: \"831c6e8a-aa00-4653-a89f-c6b37a945bde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk" Jul 09 11:19:29.877816 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.877778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdqw7\" (UniqueName: \"kubernetes.io/projected/831c6e8a-aa00-4653-a89f-c6b37a945bde-kube-api-access-sdqw7\") pod \"cert-manager-operator-controller-manager-55c444bf86-46hhk\" (UID: \"831c6e8a-aa00-4653-a89f-c6b37a945bde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk" Jul 09 11:19:29.877979 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.877833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/831c6e8a-aa00-4653-a89f-c6b37a945bde-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-46hhk\" (UID: \"831c6e8a-aa00-4653-a89f-c6b37a945bde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk" Jul 09 11:19:29.878203 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.878187 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/831c6e8a-aa00-4653-a89f-c6b37a945bde-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-46hhk\" (UID: \"831c6e8a-aa00-4653-a89f-c6b37a945bde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk" Jul 09 11:19:29.890666 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.890640 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdqw7\" (UniqueName: \"kubernetes.io/projected/831c6e8a-aa00-4653-a89f-c6b37a945bde-kube-api-access-sdqw7\") pod \"cert-manager-operator-controller-manager-55c444bf86-46hhk\" (UID: \"831c6e8a-aa00-4653-a89f-c6b37a945bde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk" Jul 09 11:19:29.997023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:29.996937 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk" Jul 09 11:19:30.133370 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:30.133348 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk"] Jul 09 11:19:30.135914 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:19:30.135887 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831c6e8a_aa00_4653_a89f_c6b37a945bde.slice/crio-b4c4b13b4482bc965e04d7b0451a73308ac61665f45e39524846ea33402568ef WatchSource:0}: Error finding container b4c4b13b4482bc965e04d7b0451a73308ac61665f45e39524846ea33402568ef: Status 404 returned error can't find the container with id b4c4b13b4482bc965e04d7b0451a73308ac61665f45e39524846ea33402568ef Jul 09 11:19:30.433044 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:30.433005 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk" event={"ID":"831c6e8a-aa00-4653-a89f-c6b37a945bde","Type":"ContainerStarted","Data":"b4c4b13b4482bc965e04d7b0451a73308ac61665f45e39524846ea33402568ef"} Jul 09 11:19:32.444628 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:32.444589 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk" event={"ID":"831c6e8a-aa00-4653-a89f-c6b37a945bde","Type":"ContainerStarted","Data":"af18c2c3ed7ff6698f1212ab52311eae09b24fa75b2444d6459c573de77dbfe1"} Jul 09 11:19:32.490031 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:32.489983 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-46hhk" podStartSLOduration=2.145489673 podStartE2EDuration="3.489962489s" totalImagesPullingTime="1.344472816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:19:32.487996497 +0000 UTC m=+478.398841026" watchObservedRunningTime="2026-07-09 11:19:32.489962489 +0000 UTC m=+478.400807015" Jul 09 11:19:34.380940 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.380904 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sxlgv"] Jul 09 11:19:34.383640 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.383619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" Jul 09 11:19:34.390259 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.390053 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 11:19:34.391213 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.391191 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 11:19:34.391327 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.391192 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hp89z\"" Jul 09 11:19:34.397194 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.397168 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sxlgv"] Jul 09 11:19:34.418148 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.418113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fj7j\" (UniqueName: \"kubernetes.io/projected/b7de72ef-3b2d-44c4-a47c-5ac653281111-kube-api-access-5fj7j\") pod \"cert-manager-webhook-6486ffd997-sxlgv\" (UID: \"b7de72ef-3b2d-44c4-a47c-5ac653281111\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" Jul 09 11:19:34.418308 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.418171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7de72ef-3b2d-44c4-a47c-5ac653281111-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sxlgv\" (UID: \"b7de72ef-3b2d-44c4-a47c-5ac653281111\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" Jul 09 11:19:34.519077 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.519043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7de72ef-3b2d-44c4-a47c-5ac653281111-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sxlgv\" (UID: \"b7de72ef-3b2d-44c4-a47c-5ac653281111\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" Jul 09 11:19:34.519249 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.519101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fj7j\" (UniqueName: \"kubernetes.io/projected/b7de72ef-3b2d-44c4-a47c-5ac653281111-kube-api-access-5fj7j\") pod \"cert-manager-webhook-6486ffd997-sxlgv\" (UID: \"b7de72ef-3b2d-44c4-a47c-5ac653281111\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" Jul 09 11:19:34.531505 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.531482 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 11:19:34.532328 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.532301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7de72ef-3b2d-44c4-a47c-5ac653281111-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sxlgv\" (UID: \"b7de72ef-3b2d-44c4-a47c-5ac653281111\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" Jul 09 11:19:34.544275 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.544256 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 11:19:34.554338 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.554310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fj7j\" (UniqueName: \"kubernetes.io/projected/b7de72ef-3b2d-44c4-a47c-5ac653281111-kube-api-access-5fj7j\") pod \"cert-manager-webhook-6486ffd997-sxlgv\" (UID: \"b7de72ef-3b2d-44c4-a47c-5ac653281111\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" Jul 09 11:19:34.710469 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.710383 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hp89z\"" Jul 09 11:19:34.717894 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.717872 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" Jul 09 11:19:34.854579 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:34.854555 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sxlgv"] Jul 09 11:19:34.856695 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:19:34.856665 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7de72ef_3b2d_44c4_a47c_5ac653281111.slice/crio-3155c990ee8314f1f4d03f250c95252c055a32da1ee9977e3fa5f51cafb7f665 WatchSource:0}: Error finding container 3155c990ee8314f1f4d03f250c95252c055a32da1ee9977e3fa5f51cafb7f665: Status 404 returned error can't find the container with id 3155c990ee8314f1f4d03f250c95252c055a32da1ee9977e3fa5f51cafb7f665 Jul 09 11:19:35.460061 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:35.460021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" event={"ID":"b7de72ef-3b2d-44c4-a47c-5ac653281111","Type":"ContainerStarted","Data":"3155c990ee8314f1f4d03f250c95252c055a32da1ee9977e3fa5f51cafb7f665"} Jul 09 11:19:36.039125 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:36.039090 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5"] Jul 09 11:19:36.041905 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:36.041882 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5" Jul 09 11:19:36.044780 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:36.044757 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vkfsz\"" Jul 09 11:19:36.050762 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:36.050733 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5"] Jul 09 11:19:36.129708 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:36.129660 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cbrf\" (UniqueName: \"kubernetes.io/projected/8e0a2794-c184-45c9-bccc-1d20ae6dbd20-kube-api-access-9cbrf\") pod \"cert-manager-cainjector-559cdd8c87-w5mg5\" (UID: \"8e0a2794-c184-45c9-bccc-1d20ae6dbd20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5" Jul 09 11:19:36.129909 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:36.129790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e0a2794-c184-45c9-bccc-1d20ae6dbd20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w5mg5\" (UID: \"8e0a2794-c184-45c9-bccc-1d20ae6dbd20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5" Jul 09 11:19:36.230881 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:36.230847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e0a2794-c184-45c9-bccc-1d20ae6dbd20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w5mg5\" (UID: \"8e0a2794-c184-45c9-bccc-1d20ae6dbd20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5" Jul 09 11:19:36.231079 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:36.230926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbrf\" (UniqueName: \"kubernetes.io/projected/8e0a2794-c184-45c9-bccc-1d20ae6dbd20-kube-api-access-9cbrf\") pod \"cert-manager-cainjector-559cdd8c87-w5mg5\" (UID: \"8e0a2794-c184-45c9-bccc-1d20ae6dbd20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5" Jul 09 11:19:36.241041 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:36.241008 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e0a2794-c184-45c9-bccc-1d20ae6dbd20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w5mg5\" (UID: \"8e0a2794-c184-45c9-bccc-1d20ae6dbd20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5" Jul 09 11:19:36.241186 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:36.241051 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cbrf\" (UniqueName: \"kubernetes.io/projected/8e0a2794-c184-45c9-bccc-1d20ae6dbd20-kube-api-access-9cbrf\") pod \"cert-manager-cainjector-559cdd8c87-w5mg5\" (UID: \"8e0a2794-c184-45c9-bccc-1d20ae6dbd20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5" Jul 09 11:19:36.355405 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:36.355368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5" Jul 09 11:19:37.297468 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:37.297446 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5"] Jul 09 11:19:37.299877 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:19:37.299848 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e0a2794_c184_45c9_bccc_1d20ae6dbd20.slice/crio-a31ac6644a4f313a12ac0963224016a8b115bd83aece89a918792f7ab4b49b51 WatchSource:0}: Error finding container a31ac6644a4f313a12ac0963224016a8b115bd83aece89a918792f7ab4b49b51: Status 404 returned error can't find the container with id a31ac6644a4f313a12ac0963224016a8b115bd83aece89a918792f7ab4b49b51 Jul 09 11:19:37.474321 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:37.474190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5" event={"ID":"8e0a2794-c184-45c9-bccc-1d20ae6dbd20","Type":"ContainerStarted","Data":"ff08f0cf07c8f155ee54cce78968fa4f02047fd62051a1045a6faa2500e5a892"} Jul 09 11:19:37.474321 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:37.474238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5" event={"ID":"8e0a2794-c184-45c9-bccc-1d20ae6dbd20","Type":"ContainerStarted","Data":"a31ac6644a4f313a12ac0963224016a8b115bd83aece89a918792f7ab4b49b51"} Jul 09 11:19:37.475951 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:37.475929 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" event={"ID":"b7de72ef-3b2d-44c4-a47c-5ac653281111","Type":"ContainerStarted","Data":"a774cab456d95391faa7b8277918bfc858f9249515faea11981d9bea4d3cbba7"} Jul 09 11:19:37.476054 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:37.476039 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" Jul 09 11:19:37.498056 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:37.493748 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5mg5" podStartSLOduration=1.493719076 podStartE2EDuration="1.493719076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:19:37.49012102 +0000 UTC m=+483.400965549" watchObservedRunningTime="2026-07-09 11:19:37.493719076 +0000 UTC m=+483.404563603" Jul 09 11:19:37.511433 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:37.511373 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" podStartSLOduration=1.164486876 podStartE2EDuration="3.511351695s" totalImagesPullingTime="2.346864819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:19:37.511262096 +0000 UTC m=+483.422106647" watchObservedRunningTime="2026-07-09 11:19:37.511351695 +0000 UTC m=+483.422196223" Jul 09 11:19:43.482578 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:19:43.482547 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sxlgv" Jul 09 11:20:18.798854 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.798826 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf"] Jul 09 11:20:18.802369 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.802350 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.807226 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.807203 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 11:20:18.812967 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.812950 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 11:20:18.814620 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.814605 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 11:20:18.815663 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.815648 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 11:20:18.815740 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.815648 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5vbbz\"" Jul 09 11:20:18.836325 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.836299 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf"] Jul 09 11:20:18.891777 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.891739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a991007-3efa-45bb-8dbe-c2741e31d47b-tmp\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.891777 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.891775 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a991007-3efa-45bb-8dbe-c2741e31d47b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.892023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.891876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0a991007-3efa-45bb-8dbe-c2741e31d47b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.892023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.891925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0a991007-3efa-45bb-8dbe-c2741e31d47b-manifests\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.892178 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.892023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz5zk\" (UniqueName: \"kubernetes.io/projected/0a991007-3efa-45bb-8dbe-c2741e31d47b-kube-api-access-nz5zk\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.993249 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.993214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz5zk\" (UniqueName: \"kubernetes.io/projected/0a991007-3efa-45bb-8dbe-c2741e31d47b-kube-api-access-nz5zk\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.993478 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.993258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a991007-3efa-45bb-8dbe-c2741e31d47b-tmp\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.993478 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.993278 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a991007-3efa-45bb-8dbe-c2741e31d47b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.993478 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.993325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0a991007-3efa-45bb-8dbe-c2741e31d47b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.993478 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.993350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0a991007-3efa-45bb-8dbe-c2741e31d47b-manifests\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.993810 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.993784 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0a991007-3efa-45bb-8dbe-c2741e31d47b-manifests\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.995783 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.995746 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a991007-3efa-45bb-8dbe-c2741e31d47b-tmp\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.995904 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.995886 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0a991007-3efa-45bb-8dbe-c2741e31d47b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:18.995959 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:18.995945 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a991007-3efa-45bb-8dbe-c2741e31d47b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:19.005143 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:19.005117 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz5zk\" (UniqueName: \"kubernetes.io/projected/0a991007-3efa-45bb-8dbe-c2741e31d47b-kube-api-access-nz5zk\") pod \"opendatahub-operator-controller-manager-65b4d55d4c-mhkpf\" (UID: \"0a991007-3efa-45bb-8dbe-c2741e31d47b\") " pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:19.111855 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:19.111818 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:19.262638 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:19.262615 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf"] Jul 09 11:20:19.265464 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:20:19.265440 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a991007_3efa_45bb_8dbe_c2741e31d47b.slice/crio-2abe34cbdc365b3fcae44d81a334013adf89c424f2566a3adb665db83b14deaa WatchSource:0}: Error finding container 2abe34cbdc365b3fcae44d81a334013adf89c424f2566a3adb665db83b14deaa: Status 404 returned error can't find the container with id 2abe34cbdc365b3fcae44d81a334013adf89c424f2566a3adb665db83b14deaa Jul 09 11:20:19.667105 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:19.667072 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" event={"ID":"0a991007-3efa-45bb-8dbe-c2741e31d47b","Type":"ContainerStarted","Data":"2abe34cbdc365b3fcae44d81a334013adf89c424f2566a3adb665db83b14deaa"} Jul 09 11:20:22.684734 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:22.684698 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" event={"ID":"0a991007-3efa-45bb-8dbe-c2741e31d47b","Type":"ContainerStarted","Data":"e13a2adc741b142cf7ddb336be67843bf46e62638ebb73dafb418bf690a42bee"} Jul 09 11:20:23.691605 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:23.691566 2562 generic.go:356] "Generic (PLEG): container finished" podID="0a991007-3efa-45bb-8dbe-c2741e31d47b" containerID="e13a2adc741b142cf7ddb336be67843bf46e62638ebb73dafb418bf690a42bee" exitCode=0 Jul 09 11:20:23.692054 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:23.691649 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" event={"ID":"0a991007-3efa-45bb-8dbe-c2741e31d47b","Type":"ContainerDied","Data":"e13a2adc741b142cf7ddb336be67843bf46e62638ebb73dafb418bf690a42bee"} Jul 09 11:20:24.699142 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:24.699094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" event={"ID":"0a991007-3efa-45bb-8dbe-c2741e31d47b","Type":"ContainerStarted","Data":"97c1390f78c515e894180afc732cf5e894fdbe2f42f373fb521dd31251c8d478"} Jul 09 11:20:24.699694 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:24.699529 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:24.724035 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:24.723788 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" podStartSLOduration=2.3990245789999998 podStartE2EDuration="6.723770939s" totalImagesPullingTime="3.271726152s" totalInitContainerRuntime="1.053020208s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:20:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:20:24.721542582 +0000 UTC m=+530.632387109" watchObservedRunningTime="2026-07-09 11:20:24.723770939 +0000 UTC m=+530.634615466" Jul 09 11:20:35.706196 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:35.706115 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65b4d55d4c-mhkpf" Jul 09 11:20:38.541689 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:38.541653 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wb2nj"] Jul 09 11:20:38.551092 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:38.551062 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" Jul 09 11:20:38.554106 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:38.554076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 09 11:20:38.554223 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:38.554107 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jnjv5\"" Jul 09 11:20:38.561686 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:38.561660 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09e8aa95-9326-470a-89e0-d0b5b37ab1b8-cert\") pod \"odh-model-controller-7998c67dc4-wb2nj\" (UID: \"09e8aa95-9326-470a-89e0-d0b5b37ab1b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" Jul 09 11:20:38.561825 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:38.561799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7n92\" (UniqueName: \"kubernetes.io/projected/09e8aa95-9326-470a-89e0-d0b5b37ab1b8-kube-api-access-f7n92\") pod \"odh-model-controller-7998c67dc4-wb2nj\" (UID: \"09e8aa95-9326-470a-89e0-d0b5b37ab1b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" Jul 09 11:20:38.563142 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:38.563121 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wb2nj"] Jul 09 11:20:38.662435 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:38.662399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09e8aa95-9326-470a-89e0-d0b5b37ab1b8-cert\") pod \"odh-model-controller-7998c67dc4-wb2nj\" (UID: \"09e8aa95-9326-470a-89e0-d0b5b37ab1b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" Jul 09 11:20:38.662615 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:38.662494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n92\" (UniqueName: \"kubernetes.io/projected/09e8aa95-9326-470a-89e0-d0b5b37ab1b8-kube-api-access-f7n92\") pod \"odh-model-controller-7998c67dc4-wb2nj\" (UID: \"09e8aa95-9326-470a-89e0-d0b5b37ab1b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" Jul 09 11:20:38.662615 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:20:38.662554 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 09 11:20:38.662694 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:20:38.662638 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09e8aa95-9326-470a-89e0-d0b5b37ab1b8-cert podName:09e8aa95-9326-470a-89e0-d0b5b37ab1b8 nodeName:}" failed. No retries permitted until 2026-07-09 11:20:39.16261634 +0000 UTC m=+545.073460847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/09e8aa95-9326-470a-89e0-d0b5b37ab1b8-cert") pod "odh-model-controller-7998c67dc4-wb2nj" (UID: "09e8aa95-9326-470a-89e0-d0b5b37ab1b8") : secret "odh-model-controller-webhook-cert" not found Jul 09 11:20:38.679698 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:38.679673 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7n92\" (UniqueName: \"kubernetes.io/projected/09e8aa95-9326-470a-89e0-d0b5b37ab1b8-kube-api-access-f7n92\") pod \"odh-model-controller-7998c67dc4-wb2nj\" (UID: \"09e8aa95-9326-470a-89e0-d0b5b37ab1b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" Jul 09 11:20:39.166277 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.166240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09e8aa95-9326-470a-89e0-d0b5b37ab1b8-cert\") pod \"odh-model-controller-7998c67dc4-wb2nj\" (UID: \"09e8aa95-9326-470a-89e0-d0b5b37ab1b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" Jul 09 11:20:39.168680 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.168647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09e8aa95-9326-470a-89e0-d0b5b37ab1b8-cert\") pod \"odh-model-controller-7998c67dc4-wb2nj\" (UID: \"09e8aa95-9326-470a-89e0-d0b5b37ab1b8\") " pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" Jul 09 11:20:39.354840 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.354808 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w9nj5"] Jul 09 11:20:39.357616 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.357599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" Jul 09 11:20:39.360806 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.360783 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 11:20:39.367503 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.367475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fb77719-e64a-48ab-97bb-b90c1f897101-tls-certs\") pod \"model-serving-api-54d89bd5fc-w9nj5\" (UID: \"5fb77719-e64a-48ab-97bb-b90c1f897101\") " pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" Jul 09 11:20:39.367600 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.367584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrts2\" (UniqueName: \"kubernetes.io/projected/5fb77719-e64a-48ab-97bb-b90c1f897101-kube-api-access-qrts2\") pod \"model-serving-api-54d89bd5fc-w9nj5\" (UID: \"5fb77719-e64a-48ab-97bb-b90c1f897101\") " pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" Jul 09 11:20:39.370900 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.370879 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w9nj5"] Jul 09 11:20:39.461906 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.461817 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" Jul 09 11:20:39.468901 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.468881 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrts2\" (UniqueName: \"kubernetes.io/projected/5fb77719-e64a-48ab-97bb-b90c1f897101-kube-api-access-qrts2\") pod \"model-serving-api-54d89bd5fc-w9nj5\" (UID: \"5fb77719-e64a-48ab-97bb-b90c1f897101\") " pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" Jul 09 11:20:39.469020 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.468909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fb77719-e64a-48ab-97bb-b90c1f897101-tls-certs\") pod \"model-serving-api-54d89bd5fc-w9nj5\" (UID: \"5fb77719-e64a-48ab-97bb-b90c1f897101\") " pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" Jul 09 11:20:39.469080 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:20:39.469028 2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 09 11:20:39.469133 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:20:39.469091 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb77719-e64a-48ab-97bb-b90c1f897101-tls-certs podName:5fb77719-e64a-48ab-97bb-b90c1f897101 nodeName:}" failed. No retries permitted until 2026-07-09 11:20:39.969074839 +0000 UTC m=+545.879919344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5fb77719-e64a-48ab-97bb-b90c1f897101-tls-certs") pod "model-serving-api-54d89bd5fc-w9nj5" (UID: "5fb77719-e64a-48ab-97bb-b90c1f897101") : secret "model-serving-api-tls" not found Jul 09 11:20:39.481934 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.481904 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrts2\" (UniqueName: \"kubernetes.io/projected/5fb77719-e64a-48ab-97bb-b90c1f897101-kube-api-access-qrts2\") pod \"model-serving-api-54d89bd5fc-w9nj5\" (UID: \"5fb77719-e64a-48ab-97bb-b90c1f897101\") " pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" Jul 09 11:20:39.606534 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.606449 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wb2nj"] Jul 09 11:20:39.609207 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:20:39.609179 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e8aa95_9326_470a_89e0_d0b5b37ab1b8.slice/crio-b04f5409a716f72a7c22c557d9865786dd2a637207656b1c9dcd80c8b7b6801f WatchSource:0}: Error finding container b04f5409a716f72a7c22c557d9865786dd2a637207656b1c9dcd80c8b7b6801f: Status 404 returned error can't find the container with id b04f5409a716f72a7c22c557d9865786dd2a637207656b1c9dcd80c8b7b6801f Jul 09 11:20:39.772627 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.772534 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" event={"ID":"09e8aa95-9326-470a-89e0-d0b5b37ab1b8","Type":"ContainerStarted","Data":"b04f5409a716f72a7c22c557d9865786dd2a637207656b1c9dcd80c8b7b6801f"} Jul 09 11:20:39.973957 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.973917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fb77719-e64a-48ab-97bb-b90c1f897101-tls-certs\") pod \"model-serving-api-54d89bd5fc-w9nj5\" (UID: \"5fb77719-e64a-48ab-97bb-b90c1f897101\") " pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" Jul 09 11:20:39.976511 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:39.976480 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fb77719-e64a-48ab-97bb-b90c1f897101-tls-certs\") pod \"model-serving-api-54d89bd5fc-w9nj5\" (UID: \"5fb77719-e64a-48ab-97bb-b90c1f897101\") " pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" Jul 09 11:20:40.267994 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:40.267952 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" Jul 09 11:20:40.452987 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:40.452897 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w9nj5"] Jul 09 11:20:40.457472 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:20:40.457443 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb77719_e64a_48ab_97bb_b90c1f897101.slice/crio-7ab5f56169b2a15f7b25136afa4ebcef8b523ac0c90b2bdfef0a5fd247c4d09c WatchSource:0}: Error finding container 7ab5f56169b2a15f7b25136afa4ebcef8b523ac0c90b2bdfef0a5fd247c4d09c: Status 404 returned error can't find the container with id 7ab5f56169b2a15f7b25136afa4ebcef8b523ac0c90b2bdfef0a5fd247c4d09c Jul 09 11:20:40.780602 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:40.780556 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" event={"ID":"5fb77719-e64a-48ab-97bb-b90c1f897101","Type":"ContainerStarted","Data":"7ab5f56169b2a15f7b25136afa4ebcef8b523ac0c90b2bdfef0a5fd247c4d09c"} Jul 09 11:20:43.683129 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.683089 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6579588b8b-xts5c"] Jul 09 11:20:43.685677 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.685654 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" Jul 09 11:20:43.689620 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.689598 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 11:20:43.689837 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.689621 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hnmpt\"" Jul 09 11:20:43.689837 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.689704 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 11:20:43.696483 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.696461 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6579588b8b-xts5c"] Jul 09 11:20:43.711475 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.711442 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e036c346-c78a-433b-96ff-df2ba44e6ffd-tls-certs\") pod \"kube-auth-proxy-6579588b8b-xts5c\" (UID: \"e036c346-c78a-433b-96ff-df2ba44e6ffd\") " pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" Jul 09 11:20:43.711658 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.711488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnkcv\" (UniqueName: \"kubernetes.io/projected/e036c346-c78a-433b-96ff-df2ba44e6ffd-kube-api-access-nnkcv\") pod \"kube-auth-proxy-6579588b8b-xts5c\" (UID: \"e036c346-c78a-433b-96ff-df2ba44e6ffd\") " pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" Jul 09 11:20:43.711658 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.711623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e036c346-c78a-433b-96ff-df2ba44e6ffd-tmp\") pod \"kube-auth-proxy-6579588b8b-xts5c\" (UID: \"e036c346-c78a-433b-96ff-df2ba44e6ffd\") " pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" Jul 09 11:20:43.802752 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.802715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" event={"ID":"09e8aa95-9326-470a-89e0-d0b5b37ab1b8","Type":"ContainerStarted","Data":"5a2dc77770ff86369c9dcb8bc8fc7e07ffe4d9c6b202e8398569c91fec73a491"} Jul 09 11:20:43.802931 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.802786 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" Jul 09 11:20:43.804259 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.804235 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" event={"ID":"5fb77719-e64a-48ab-97bb-b90c1f897101","Type":"ContainerStarted","Data":"deba580cf4f6b3d2e2385235b15703c783c853ee804a8b5f1ec5f046a639703d"} Jul 09 11:20:43.804408 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.804393 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" Jul 09 11:20:43.813049 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.813025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e036c346-c78a-433b-96ff-df2ba44e6ffd-tmp\") pod \"kube-auth-proxy-6579588b8b-xts5c\" (UID: \"e036c346-c78a-433b-96ff-df2ba44e6ffd\") " pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" Jul 09 11:20:43.813138 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.813121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e036c346-c78a-433b-96ff-df2ba44e6ffd-tls-certs\") pod \"kube-auth-proxy-6579588b8b-xts5c\" (UID: \"e036c346-c78a-433b-96ff-df2ba44e6ffd\") " pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" Jul 09 11:20:43.813196 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.813157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnkcv\" (UniqueName: \"kubernetes.io/projected/e036c346-c78a-433b-96ff-df2ba44e6ffd-kube-api-access-nnkcv\") pod \"kube-auth-proxy-6579588b8b-xts5c\" (UID: \"e036c346-c78a-433b-96ff-df2ba44e6ffd\") " pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" Jul 09 11:20:43.815335 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.815313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e036c346-c78a-433b-96ff-df2ba44e6ffd-tmp\") pod \"kube-auth-proxy-6579588b8b-xts5c\" (UID: \"e036c346-c78a-433b-96ff-df2ba44e6ffd\") " pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" Jul 09 11:20:43.815523 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.815507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e036c346-c78a-433b-96ff-df2ba44e6ffd-tls-certs\") pod \"kube-auth-proxy-6579588b8b-xts5c\" (UID: \"e036c346-c78a-433b-96ff-df2ba44e6ffd\") " pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" Jul 09 11:20:43.822376 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.822327 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" podStartSLOduration=2.52620124 podStartE2EDuration="5.822313477s" totalImagesPullingTime="3.296112237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:20:43.820491499 +0000 UTC m=+549.731336067" watchObservedRunningTime="2026-07-09 11:20:43.822313477 +0000 UTC m=+549.733158002" Jul 09 11:20:43.825091 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.825070 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnkcv\" (UniqueName: \"kubernetes.io/projected/e036c346-c78a-433b-96ff-df2ba44e6ffd-kube-api-access-nnkcv\") pod \"kube-auth-proxy-6579588b8b-xts5c\" (UID: \"e036c346-c78a-433b-96ff-df2ba44e6ffd\") " pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" Jul 09 11:20:43.838224 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.838178 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" podStartSLOduration=2.395428836 podStartE2EDuration="4.83815902s" totalImagesPullingTime="2.442730184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:20:43.837973027 +0000 UTC m=+549.748817554" watchObservedRunningTime="2026-07-09 11:20:43.83815902 +0000 UTC m=+549.749003543" Jul 09 11:20:43.997049 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:43.996964 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" Jul 09 11:20:44.143433 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:44.143393 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6579588b8b-xts5c"] Jul 09 11:20:44.147329 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:20:44.147273 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode036c346_c78a_433b_96ff_df2ba44e6ffd.slice/crio-417a18bd61e4cdbf611f4689f732487c0306131a1ac356f303f7abf78333caee WatchSource:0}: Error finding container 417a18bd61e4cdbf611f4689f732487c0306131a1ac356f303f7abf78333caee: Status 404 returned error can't find the container with id 417a18bd61e4cdbf611f4689f732487c0306131a1ac356f303f7abf78333caee Jul 09 11:20:44.810600 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:44.810557 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" event={"ID":"e036c346-c78a-433b-96ff-df2ba44e6ffd","Type":"ContainerStarted","Data":"417a18bd61e4cdbf611f4689f732487c0306131a1ac356f303f7abf78333caee"} Jul 09 11:20:44.976128 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:44.976089 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5"] Jul 09 11:20:44.978470 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:44.978454 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:44.981393 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:44.981357 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 11:20:44.981520 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:44.981400 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 11:20:44.981520 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:44.981456 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 11:20:44.981520 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:44.981464 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 11:20:44.981683 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:44.981599 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vgn56\"" Jul 09 11:20:44.993698 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:44.993675 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5"] Jul 09 11:20:45.029520 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.029486 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-local-certs\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.029677 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.029534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.029677 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.029612 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-cacerts\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.029677 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.029654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv2pq\" (UniqueName: \"kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-kube-api-access-kv2pq\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.029824 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.029688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.029824 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.029743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.029824 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.029795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-token\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.130681 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.130617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.130878 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.130689 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-token\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.130878 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.130741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-local-certs\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.130878 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.130779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.130878 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.130823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-cacerts\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.130878 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.130859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv2pq\" (UniqueName: \"kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-kube-api-access-kv2pq\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.131157 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.130893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.131614 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.131589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.133631 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.133607 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-cacerts\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.133747 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.133612 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.133819 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.133752 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.133930 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.133909 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-local-certs\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.141980 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.141960 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-token\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.142098 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.142079 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv2pq\" (UniqueName: \"kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-kube-api-access-kv2pq\") pod \"istiod-openshift-gateway-7574459656-xc2r5\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.288749 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.288718 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:45.480496 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.480470 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5"] Jul 09 11:20:45.481556 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:20:45.481531 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871d34a5_0dfb_4ead_94f0_7ecc9c1b4aeb.slice/crio-4152fa9ceb00868ebd0047a45cea908a02e8810351e49e75d116f6dc1137a5b2 WatchSource:0}: Error finding container 4152fa9ceb00868ebd0047a45cea908a02e8810351e49e75d116f6dc1137a5b2: Status 404 returned error can't find the container with id 4152fa9ceb00868ebd0047a45cea908a02e8810351e49e75d116f6dc1137a5b2 Jul 09 11:20:45.816976 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:45.816897 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" event={"ID":"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb","Type":"ContainerStarted","Data":"4152fa9ceb00868ebd0047a45cea908a02e8810351e49e75d116f6dc1137a5b2"} Jul 09 11:20:48.124087 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:48.123577 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 11:20:48.124087 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:48.123659 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 11:20:48.836441 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:48.836400 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" event={"ID":"e036c346-c78a-433b-96ff-df2ba44e6ffd","Type":"ContainerStarted","Data":"8dd9cc8acde7f27692a44096657c2c7ccaacbcedcc7adec5461c8d35da28bae5"} Jul 09 11:20:48.838102 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:48.838071 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" event={"ID":"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb","Type":"ContainerStarted","Data":"a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda"} Jul 09 11:20:48.838222 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:48.838174 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:48.891751 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:48.891704 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6579588b8b-xts5c" podStartSLOduration=1.92911734 podStartE2EDuration="5.891689507s" totalImagesPullingTime="3.962572167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:20:48.889144993 +0000 UTC m=+554.799989536" watchObservedRunningTime="2026-07-09 11:20:48.891689507 +0000 UTC m=+554.802534033" Jul 09 11:20:48.923509 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:48.923450 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" podStartSLOduration=2.283960744 podStartE2EDuration="4.923430713s" totalImagesPullingTime="2.639469969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:20:48.921828229 +0000 UTC m=+554.832672755" watchObservedRunningTime="2026-07-09 11:20:48.923430713 +0000 UTC m=+554.834275240" Jul 09 11:20:49.681290 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.681248 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x"] Jul 09 11:20:49.684137 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.684119 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" Jul 09 11:20:49.688318 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.688295 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 11:20:49.688430 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.688299 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rssns\"" Jul 09 11:20:49.694825 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.694788 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh"] Jul 09 11:20:49.697570 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.697552 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:20:49.698947 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.698926 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x"] Jul 09 11:20:49.700741 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.700720 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2m7pz\"" Jul 09 11:20:49.700834 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.700727 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 09 11:20:49.723950 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.723924 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh"] Jul 09 11:20:49.774959 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.774924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26h97\" (UniqueName: \"kubernetes.io/projected/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-kube-api-access-26h97\") pod \"llmisvc-controller-manager-777c6bd7d5-7s5jh\" (UID: \"6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:20:49.775177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.774986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbpbt\" (UniqueName: \"kubernetes.io/projected/d30530dc-4c11-4edf-9490-2eb5b58cc145-kube-api-access-vbpbt\") pod \"kserve-controller-manager-d6f4b65b8-t9z4x\" (UID: \"d30530dc-4c11-4edf-9490-2eb5b58cc145\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" Jul 09 11:20:49.775177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.775013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7s5jh\" (UID: \"6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:20:49.775177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.775056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d30530dc-4c11-4edf-9490-2eb5b58cc145-cert\") pod \"kserve-controller-manager-d6f4b65b8-t9z4x\" (UID: \"d30530dc-4c11-4edf-9490-2eb5b58cc145\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" Jul 09 11:20:49.844653 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.844617 2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xc2r5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 11:20:49.844787 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.844667 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" podUID="871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 11:20:49.876146 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.876114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d30530dc-4c11-4edf-9490-2eb5b58cc145-cert\") pod \"kserve-controller-manager-d6f4b65b8-t9z4x\" (UID: \"d30530dc-4c11-4edf-9490-2eb5b58cc145\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" Jul 09 11:20:49.876371 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.876179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26h97\" (UniqueName: \"kubernetes.io/projected/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-kube-api-access-26h97\") pod \"llmisvc-controller-manager-777c6bd7d5-7s5jh\" (UID: \"6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:20:49.876371 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.876231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbpbt\" (UniqueName: \"kubernetes.io/projected/d30530dc-4c11-4edf-9490-2eb5b58cc145-kube-api-access-vbpbt\") pod \"kserve-controller-manager-d6f4b65b8-t9z4x\" (UID: \"d30530dc-4c11-4edf-9490-2eb5b58cc145\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" Jul 09 11:20:49.876371 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.876251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7s5jh\" (UID: \"6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:20:49.876371 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:20:49.876252 2562 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 09 11:20:49.876371 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:20:49.876328 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30530dc-4c11-4edf-9490-2eb5b58cc145-cert podName:d30530dc-4c11-4edf-9490-2eb5b58cc145 nodeName:}" failed. No retries permitted until 2026-07-09 11:20:50.376306416 +0000 UTC m=+556.287150921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d30530dc-4c11-4edf-9490-2eb5b58cc145-cert") pod "kserve-controller-manager-d6f4b65b8-t9z4x" (UID: "d30530dc-4c11-4edf-9490-2eb5b58cc145") : secret "kserve-webhook-server-cert" not found Jul 09 11:20:49.876371 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:20:49.876363 2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 09 11:20:49.876652 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:20:49.876410 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-cert podName:6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b nodeName:}" failed. No retries permitted until 2026-07-09 11:20:50.376394621 +0000 UTC m=+556.287239125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-cert") pod "llmisvc-controller-manager-777c6bd7d5-7s5jh" (UID: "6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b") : secret "llmisvc-webhook-server-cert" not found Jul 09 11:20:49.890509 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.890482 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbpbt\" (UniqueName: \"kubernetes.io/projected/d30530dc-4c11-4edf-9490-2eb5b58cc145-kube-api-access-vbpbt\") pod \"kserve-controller-manager-d6f4b65b8-t9z4x\" (UID: \"d30530dc-4c11-4edf-9490-2eb5b58cc145\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" Jul 09 11:20:49.890509 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:49.890500 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26h97\" (UniqueName: \"kubernetes.io/projected/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-kube-api-access-26h97\") pod \"llmisvc-controller-manager-777c6bd7d5-7s5jh\" (UID: \"6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:20:50.381957 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.381929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d30530dc-4c11-4edf-9490-2eb5b58cc145-cert\") pod \"kserve-controller-manager-d6f4b65b8-t9z4x\" (UID: \"d30530dc-4c11-4edf-9490-2eb5b58cc145\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" Jul 09 11:20:50.382124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.382023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7s5jh\" (UID: \"6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:20:50.382168 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:20:50.382128 2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 09 11:20:50.382202 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:20:50.382181 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-cert podName:6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b nodeName:}" failed. No retries permitted until 2026-07-09 11:20:51.382166695 +0000 UTC m=+557.293011214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-cert") pod "llmisvc-controller-manager-777c6bd7d5-7s5jh" (UID: "6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b") : secret "llmisvc-webhook-server-cert" not found Jul 09 11:20:50.384246 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.384229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d30530dc-4c11-4edf-9490-2eb5b58cc145-cert\") pod \"kserve-controller-manager-d6f4b65b8-t9z4x\" (UID: \"d30530dc-4c11-4edf-9490-2eb5b58cc145\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" Jul 09 11:20:50.410331 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.410300 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx"] Jul 09 11:20:50.413166 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.413146 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.416575 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.416558 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vvg6j\"" Jul 09 11:20:50.440907 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.440879 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx"] Jul 09 11:20:50.482636 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.482594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e48ac04e-fab5-4774-8b97-843aaf592827-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.482882 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.482857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.482995 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.482894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmqlp\" (UniqueName: \"kubernetes.io/projected/e48ac04e-fab5-4774-8b97-843aaf592827-kube-api-access-nmqlp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.482995 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.482936 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e48ac04e-fab5-4774-8b97-843aaf592827-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.483100 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.483036 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.483100 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.483077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.483164 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.483099 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.483198 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.483162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e48ac04e-fab5-4774-8b97-843aaf592827-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.483234 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.483219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.584663 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.584626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e48ac04e-fab5-4774-8b97-843aaf592827-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.584663 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.584667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.584910 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.584684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmqlp\" (UniqueName: \"kubernetes.io/projected/e48ac04e-fab5-4774-8b97-843aaf592827-kube-api-access-nmqlp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.584910 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.584704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e48ac04e-fab5-4774-8b97-843aaf592827-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.584910 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.584753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.584910 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.584780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.584910 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.584811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.584910 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.584883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e48ac04e-fab5-4774-8b97-843aaf592827-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.585315 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.584952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.585315 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.585135 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.585315 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.585211 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.585315 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.585223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.585315 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.585303 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.585643 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.585624 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e48ac04e-fab5-4774-8b97-843aaf592827-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.587041 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.587019 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e48ac04e-fab5-4774-8b97-843aaf592827-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.587123 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.587110 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e48ac04e-fab5-4774-8b97-843aaf592827-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.594066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.594036 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" Jul 09 11:20:50.596321 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.596274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmqlp\" (UniqueName: \"kubernetes.io/projected/e48ac04e-fab5-4774-8b97-843aaf592827-kube-api-access-nmqlp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.596432 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.596420 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e48ac04e-fab5-4774-8b97-843aaf592827-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hmxrx\" (UID: \"e48ac04e-fab5-4774-8b97-843aaf592827\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.723811 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.723774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:50.740590 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.740562 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x"] Jul 09 11:20:50.740899 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:20:50.740874 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30530dc_4c11_4edf_9490_2eb5b58cc145.slice/crio-f4eaa22d9bd71e1b148fd7801053fbb42ca3e01905e473563ae47bb760f4105b WatchSource:0}: Error finding container f4eaa22d9bd71e1b148fd7801053fbb42ca3e01905e473563ae47bb760f4105b: Status 404 returned error can't find the container with id f4eaa22d9bd71e1b148fd7801053fbb42ca3e01905e473563ae47bb760f4105b Jul 09 11:20:50.848371 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.848334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" event={"ID":"d30530dc-4c11-4edf-9490-2eb5b58cc145","Type":"ContainerStarted","Data":"f4eaa22d9bd71e1b148fd7801053fbb42ca3e01905e473563ae47bb760f4105b"} Jul 09 11:20:50.863316 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:50.863272 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx"] Jul 09 11:20:50.865744 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:20:50.865712 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48ac04e_fab5_4774_8b97_843aaf592827.slice/crio-6f1b9c9a86d1de519a4a002f8672bb3d9f6af1446cfb9becee660a8cde885664 WatchSource:0}: Error finding container 6f1b9c9a86d1de519a4a002f8672bb3d9f6af1446cfb9becee660a8cde885664: Status 404 returned error can't find the container with id 6f1b9c9a86d1de519a4a002f8672bb3d9f6af1446cfb9becee660a8cde885664 Jul 09 11:20:51.393386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:51.393304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7s5jh\" (UID: \"6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:20:51.396490 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:51.396464 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7s5jh\" (UID: \"6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:20:51.508057 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:51.508021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:20:51.695107 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:51.695078 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh"] Jul 09 11:20:51.697658 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:20:51.697617 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6d47fa9b_1258_4d8f_8b4b_f9ec475fb77b.slice/crio-101e69005b98f14feb950b6a97515fe0a4f47e3318fe4c34481b98dbe91af62f WatchSource:0}: Error finding container 101e69005b98f14feb950b6a97515fe0a4f47e3318fe4c34481b98dbe91af62f: Status 404 returned error can't find the container with id 101e69005b98f14feb950b6a97515fe0a4f47e3318fe4c34481b98dbe91af62f Jul 09 11:20:51.857003 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:51.856965 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" event={"ID":"e48ac04e-fab5-4774-8b97-843aaf592827","Type":"ContainerStarted","Data":"6f1b9c9a86d1de519a4a002f8672bb3d9f6af1446cfb9becee660a8cde885664"} Jul 09 11:20:51.858406 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:51.858373 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" event={"ID":"6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b","Type":"ContainerStarted","Data":"101e69005b98f14feb950b6a97515fe0a4f47e3318fe4c34481b98dbe91af62f"} Jul 09 11:20:52.012148 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.012066 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5"] Jul 09 11:20:52.012356 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.012320 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" podUID="871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" containerName="discovery" containerID="cri-o://a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda" gracePeriod=30 Jul 09 11:20:52.013329 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.013307 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:52.305186 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.305154 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:52.404276 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.404245 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-token\") pod \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " Jul 09 11:20:52.404466 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.404315 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-dns-cert\") pod \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " Jul 09 11:20:52.404466 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.404354 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv2pq\" (UniqueName: \"kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-kube-api-access-kv2pq\") pod \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " Jul 09 11:20:52.404466 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.404396 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-local-certs\") pod \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " Jul 09 11:20:52.404466 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.404434 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-kubeconfig\") pod \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " Jul 09 11:20:52.404466 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.404466 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-cacerts\") pod \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " Jul 09 11:20:52.404701 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.404542 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-ca-configmap\") pod \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\" (UID: \"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb\") " Jul 09 11:20:52.405152 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.405093 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" (UID: "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:20:52.407591 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.407549 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-local-certs" (OuterVolumeSpecName: "local-certs") pod "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" (UID: "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:20:52.407591 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.407577 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-token" (OuterVolumeSpecName: "istio-token") pod "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" (UID: "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:20:52.407758 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.407621 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" (UID: "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:20:52.407802 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.407759 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-kube-api-access-kv2pq" (OuterVolumeSpecName: "kube-api-access-kv2pq") pod "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" (UID: "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb"). InnerVolumeSpecName "kube-api-access-kv2pq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:20:52.408012 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.407975 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" (UID: "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:20:52.408379 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.408344 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-cacerts" (OuterVolumeSpecName: "cacerts") pod "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" (UID: "871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:20:52.506337 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.506302 2562 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-kubeconfig\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:20:52.506337 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.506335 2562 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-cacerts\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:20:52.506540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.506349 2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-ca-configmap\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:20:52.506540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.506366 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:20:52.506540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.506378 2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-istio-csr-dns-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:20:52.506540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.506387 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv2pq\" (UniqueName: \"kubernetes.io/projected/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-kube-api-access-kv2pq\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:20:52.506540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.506395 2562 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb-local-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:20:52.866365 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.866328 2562 generic.go:356] "Generic (PLEG): container finished" podID="871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" containerID="a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda" exitCode=0 Jul 09 11:20:52.866815 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.866384 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" Jul 09 11:20:52.866815 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.866418 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" event={"ID":"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb","Type":"ContainerDied","Data":"a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda"} Jul 09 11:20:52.866815 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.866474 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5" event={"ID":"871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb","Type":"ContainerDied","Data":"4152fa9ceb00868ebd0047a45cea908a02e8810351e49e75d116f6dc1137a5b2"} Jul 09 11:20:52.866815 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.866497 2562 scope.go:117] "RemoveContainer" containerID="a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda" Jul 09 11:20:52.892779 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.892684 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5"] Jul 09 11:20:52.895202 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:52.895176 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xc2r5"] Jul 09 11:20:53.317676 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:53.317584 2562 scope.go:117] "RemoveContainer" containerID="a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda" Jul 09 11:20:53.317958 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:20:53.317935 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda\": container with ID starting with a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda not found: ID does not exist" containerID="a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda" Jul 09 11:20:53.318014 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:53.317968 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda"} err="failed to get container status \"a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda\": rpc error: code = NotFound desc = could not find container \"a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda\": container with ID starting with a92f74e7ac7ca2539f80e4b7db397101e0654b4d4e8f93bcf009892df71d5eda not found: ID does not exist" Jul 09 11:20:54.192253 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:54.192189 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 11:20:54.192633 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:54.192330 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 11:20:54.192633 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:54.192383 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 11:20:54.614688 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:54.614655 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" path="/var/lib/kubelet/pods/871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb/volumes" Jul 09 11:20:54.813165 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:54.813138 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wb2nj" Jul 09 11:20:54.815979 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:54.815961 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-w9nj5" Jul 09 11:20:54.894724 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:54.894644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" event={"ID":"d30530dc-4c11-4edf-9490-2eb5b58cc145","Type":"ContainerStarted","Data":"a090a1f3ac7d7c9ccc85a0f8861eea1deea1c4cf81a9f9ae93a39ded3c59f1b7"} Jul 09 11:20:54.895041 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:54.895024 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" Jul 09 11:20:54.902617 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:54.902588 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" event={"ID":"e48ac04e-fab5-4774-8b97-843aaf592827","Type":"ContainerStarted","Data":"008a5171a57be7b92dc04025ad4b645045576ce7afbdbe5a61753772a18a2816"} Jul 09 11:20:54.918682 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:54.918617 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" podStartSLOduration=2.469139073 podStartE2EDuration="5.918599229s" totalImagesPullingTime="3.449460156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:20:54.917244284 +0000 UTC m=+560.828088831" watchObservedRunningTime="2026-07-09 11:20:54.918599229 +0000 UTC m=+560.829443756" Jul 09 11:20:54.938945 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:54.938888 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" podStartSLOduration=1.614710486 podStartE2EDuration="4.938867547s" totalImagesPullingTime="3.324157061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:20:54.93853763 +0000 UTC m=+560.849382158" watchObservedRunningTime="2026-07-09 11:20:54.938867547 +0000 UTC m=+560.849712075" Jul 09 11:20:55.724342 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:55.724309 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:55.728739 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:55.728718 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:55.909736 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:55.909594 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:55.910601 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:55.910579 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hmxrx" Jul 09 11:20:56.915350 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:56.915315 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" event={"ID":"6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b","Type":"ContainerStarted","Data":"f3fc77aff1343d4f1c81a6de6078e169f474f3259550fc1997d01aaf50ff4a07"} Jul 09 11:20:56.915759 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:56.915642 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:20:56.933512 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:20:56.933461 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" podStartSLOduration=3.149616051 podStartE2EDuration="7.933447141s" totalImagesPullingTime="4.78383109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:20:56.932266927 +0000 UTC m=+562.843111458" watchObservedRunningTime="2026-07-09 11:20:56.933447141 +0000 UTC m=+562.844291666" Jul 09 11:21:26.921122 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:26.921083 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t9z4x" Jul 09 11:21:27.923512 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:27.923485 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7s5jh" Jul 09 11:21:34.542921 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:34.542893 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:21:34.545514 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:34.545494 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:21:34.550376 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:34.550357 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:21:34.552439 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:34.552423 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:21:39.378471 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.378439 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q6kw5"] Jul 09 11:21:39.379731 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.378833 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" containerName="discovery" Jul 09 11:21:39.379731 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.378844 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" containerName="discovery" Jul 09 11:21:39.379731 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.378907 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="871d34a5-0dfb-4ead-94f0-7ecc9c1b4aeb" containerName="discovery" Jul 09 11:21:39.381155 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.381130 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" Jul 09 11:21:39.385625 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.385602 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 11:21:39.385821 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.385608 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jxw6s\"" Jul 09 11:21:39.387049 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.387030 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 11:21:39.397132 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.397108 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q6kw5"] Jul 09 11:21:39.431709 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.431676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kksml\" (UniqueName: \"kubernetes.io/projected/4c147415-80fa-4cc7-b17a-097c543e26f1-kube-api-access-kksml\") pod \"kuadrant-operator-catalog-q6kw5\" (UID: \"4c147415-80fa-4cc7-b17a-097c543e26f1\") " pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" Jul 09 11:21:39.533146 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.533112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kksml\" (UniqueName: \"kubernetes.io/projected/4c147415-80fa-4cc7-b17a-097c543e26f1-kube-api-access-kksml\") pod \"kuadrant-operator-catalog-q6kw5\" (UID: \"4c147415-80fa-4cc7-b17a-097c543e26f1\") " pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" Jul 09 11:21:39.548903 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.548878 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kksml\" (UniqueName: \"kubernetes.io/projected/4c147415-80fa-4cc7-b17a-097c543e26f1-kube-api-access-kksml\") pod \"kuadrant-operator-catalog-q6kw5\" (UID: \"4c147415-80fa-4cc7-b17a-097c543e26f1\") " pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" Jul 09 11:21:39.691393 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.691318 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" Jul 09 11:21:39.831518 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.831491 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q6kw5"] Jul 09 11:21:39.833463 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:21:39.833438 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c147415_80fa_4cc7_b17a_097c543e26f1.slice/crio-9dbc866c81b800675bc185552c3ab9a937c47502a8d46d151b70255c73f503c1 WatchSource:0}: Error finding container 9dbc866c81b800675bc185552c3ab9a937c47502a8d46d151b70255c73f503c1: Status 404 returned error can't find the container with id 9dbc866c81b800675bc185552c3ab9a937c47502a8d46d151b70255c73f503c1 Jul 09 11:21:39.834805 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:39.834790 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 11:21:40.136423 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:40.136390 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" event={"ID":"4c147415-80fa-4cc7-b17a-097c543e26f1","Type":"ContainerStarted","Data":"9dbc866c81b800675bc185552c3ab9a937c47502a8d46d151b70255c73f503c1"} Jul 09 11:21:42.149897 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:42.149852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" event={"ID":"4c147415-80fa-4cc7-b17a-097c543e26f1","Type":"ContainerStarted","Data":"944c8d228b4ec021009dfc80eee80c8cc3d4a21b4e224cbabc07408dd5676eb3"} Jul 09 11:21:42.174657 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:42.174594 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" podStartSLOduration=1.03346656 podStartE2EDuration="3.174569936s" totalImagesPullingTime="2.141103376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:21:42.172846421 +0000 UTC m=+608.083690948" watchObservedRunningTime="2026-07-09 11:21:42.174569936 +0000 UTC m=+608.085414463" Jul 09 11:21:49.692044 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:49.692013 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" Jul 09 11:21:49.692474 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:49.692100 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" Jul 09 11:21:49.714606 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:49.714582 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" Jul 09 11:21:50.212517 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:50.212489 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-q6kw5" Jul 09 11:21:53.213205 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.213170 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc"] Jul 09 11:21:53.216297 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.216260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:53.219732 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.219716 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t7dgp\"" Jul 09 11:21:53.226619 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.226599 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc"] Jul 09 11:21:53.358642 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.358601 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:53.358642 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.358640 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:53.358849 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.358710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4d6b\" (UniqueName: \"kubernetes.io/projected/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-kube-api-access-z4d6b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:53.459696 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.459655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:53.459696 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.459699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:53.459952 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.459745 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4d6b\" (UniqueName: \"kubernetes.io/projected/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-kube-api-access-z4d6b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:53.460087 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.460064 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:53.460160 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.460091 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:53.469515 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.469210 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4d6b\" (UniqueName: \"kubernetes.io/projected/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-kube-api-access-z4d6b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:53.526172 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.526136 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:53.666915 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.666891 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc"] Jul 09 11:21:53.669147 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:21:53.669116 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644b80ca_4889_498c_b4f7_e4ffdb8e8cce.slice/crio-590ff4ba82b36d0aa2002c27c9901f0ef9152e672d4d3460dd3f9f4efe52eb27 WatchSource:0}: Error finding container 590ff4ba82b36d0aa2002c27c9901f0ef9152e672d4d3460dd3f9f4efe52eb27: Status 404 returned error can't find the container with id 590ff4ba82b36d0aa2002c27c9901f0ef9152e672d4d3460dd3f9f4efe52eb27 Jul 09 11:21:53.812467 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.812424 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz"] Jul 09 11:21:53.815479 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.815461 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:53.829830 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.829807 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz"] Jul 09 11:21:53.965199 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.965166 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:53.965393 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.965231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h72pm\" (UniqueName: \"kubernetes.io/projected/9cea9c5c-e721-475e-ba4c-a6756160fd37-kube-api-access-h72pm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:53.965393 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:53.965324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:54.066216 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.066130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h72pm\" (UniqueName: \"kubernetes.io/projected/9cea9c5c-e721-475e-ba4c-a6756160fd37-kube-api-access-h72pm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:54.066216 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.066188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:54.066600 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.066233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:54.066600 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.066567 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:54.066751 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.066602 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:54.075162 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.075143 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h72pm\" (UniqueName: \"kubernetes.io/projected/9cea9c5c-e721-475e-ba4c-a6756160fd37-kube-api-access-h72pm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:54.136705 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.136669 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:54.211421 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.211379 2562 generic.go:356] "Generic (PLEG): container finished" podID="644b80ca-4889-498c-b4f7-e4ffdb8e8cce" containerID="b74d38d739f3cdac71d9635ac36414b3f85a6a3513a2878380f99ea9af2fe3b9" exitCode=0 Jul 09 11:21:54.211601 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.211460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" event={"ID":"644b80ca-4889-498c-b4f7-e4ffdb8e8cce","Type":"ContainerDied","Data":"b74d38d739f3cdac71d9635ac36414b3f85a6a3513a2878380f99ea9af2fe3b9"} Jul 09 11:21:54.211601 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.211508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" event={"ID":"644b80ca-4889-498c-b4f7-e4ffdb8e8cce","Type":"ContainerStarted","Data":"590ff4ba82b36d0aa2002c27c9901f0ef9152e672d4d3460dd3f9f4efe52eb27"} Jul 09 11:21:54.273769 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.273741 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz"] Jul 09 11:21:54.275223 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:21:54.275196 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cea9c5c_e721_475e_ba4c_a6756160fd37.slice/crio-32ba24b7a67f9b8502f8fefe96d8ea6d268e3ca9d9e54b8fd193f5d594c67970 WatchSource:0}: Error finding container 32ba24b7a67f9b8502f8fefe96d8ea6d268e3ca9d9e54b8fd193f5d594c67970: Status 404 returned error can't find the container with id 32ba24b7a67f9b8502f8fefe96d8ea6d268e3ca9d9e54b8fd193f5d594c67970 Jul 09 11:21:54.400514 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.400486 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr"] Jul 09 11:21:54.403208 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.403190 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:54.413565 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.413540 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr"] Jul 09 11:21:54.570654 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.570609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67n64\" (UniqueName: \"kubernetes.io/projected/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-kube-api-access-67n64\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:54.570849 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.570659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:54.570849 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.570758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:54.672110 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.672029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67n64\" (UniqueName: \"kubernetes.io/projected/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-kube-api-access-67n64\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:54.672110 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.672078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:54.672316 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.672167 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:54.672552 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.672535 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:54.672594 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.672568 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:54.680840 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.680806 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67n64\" (UniqueName: \"kubernetes.io/projected/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-kube-api-access-67n64\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:54.746397 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.746363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:54.888367 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:54.888336 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr"] Jul 09 11:21:54.921879 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:21:54.921842 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a5fad3_65b0_4029_a5a6_8c6fb3179ed5.slice/crio-5a99625a95343325226d25e306f9c51c95fd1b9d0da0e6356b52de24931d73c2 WatchSource:0}: Error finding container 5a99625a95343325226d25e306f9c51c95fd1b9d0da0e6356b52de24931d73c2: Status 404 returned error can't find the container with id 5a99625a95343325226d25e306f9c51c95fd1b9d0da0e6356b52de24931d73c2 Jul 09 11:21:55.000775 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.000743 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd"] Jul 09 11:21:55.004623 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.004601 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:21:55.013934 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.013898 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd"] Jul 09 11:21:55.076370 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.076344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:21:55.076489 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.076377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bbl4\" (UniqueName: \"kubernetes.io/projected/f1eaa168-abbb-4db8-9830-0d5a761c7465-kube-api-access-2bbl4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:21:55.076489 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.076399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:21:55.177490 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.177394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:21:55.177490 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.177429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bbl4\" (UniqueName: \"kubernetes.io/projected/f1eaa168-abbb-4db8-9830-0d5a761c7465-kube-api-access-2bbl4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:21:55.177490 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.177450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:21:55.177871 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.177847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:21:55.177921 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.177857 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:21:55.187440 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.187411 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bbl4\" (UniqueName: \"kubernetes.io/projected/f1eaa168-abbb-4db8-9830-0d5a761c7465-kube-api-access-2bbl4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:21:55.218559 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.218526 2562 generic.go:356] "Generic (PLEG): container finished" podID="9cea9c5c-e721-475e-ba4c-a6756160fd37" containerID="1f6d7d59fb1f4454ebfcc91e1946e0a064221ed26bef1bcd7c0d26881079875a" exitCode=0 Jul 09 11:21:55.218699 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.218608 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" event={"ID":"9cea9c5c-e721-475e-ba4c-a6756160fd37","Type":"ContainerDied","Data":"1f6d7d59fb1f4454ebfcc91e1946e0a064221ed26bef1bcd7c0d26881079875a"} Jul 09 11:21:55.218699 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.218664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" event={"ID":"9cea9c5c-e721-475e-ba4c-a6756160fd37","Type":"ContainerStarted","Data":"32ba24b7a67f9b8502f8fefe96d8ea6d268e3ca9d9e54b8fd193f5d594c67970"} Jul 09 11:21:55.220232 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.220206 2562 generic.go:356] "Generic (PLEG): container finished" podID="50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" containerID="cfe2ffded4959012f971eabc63cc49d2547f105e8c8ec46402e0f21b1d30ddb0" exitCode=0 Jul 09 11:21:55.220363 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.220303 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" event={"ID":"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5","Type":"ContainerDied","Data":"cfe2ffded4959012f971eabc63cc49d2547f105e8c8ec46402e0f21b1d30ddb0"} Jul 09 11:21:55.220363 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.220352 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" event={"ID":"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5","Type":"ContainerStarted","Data":"5a99625a95343325226d25e306f9c51c95fd1b9d0da0e6356b52de24931d73c2"} Jul 09 11:21:55.222332 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.222306 2562 generic.go:356] "Generic (PLEG): container finished" podID="644b80ca-4889-498c-b4f7-e4ffdb8e8cce" containerID="3a75fff1e16a57cd59e9fbaa9aaa7ab63f42b5ef271bdb4526ac2575bc58fd1b" exitCode=0 Jul 09 11:21:55.222437 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.222385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" event={"ID":"644b80ca-4889-498c-b4f7-e4ffdb8e8cce","Type":"ContainerDied","Data":"3a75fff1e16a57cd59e9fbaa9aaa7ab63f42b5ef271bdb4526ac2575bc58fd1b"} Jul 09 11:21:55.316868 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.316798 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:21:55.452264 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:55.452238 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd"] Jul 09 11:21:55.453815 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:21:55.453784 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1eaa168_abbb_4db8_9830_0d5a761c7465.slice/crio-71c5d93b5b8d96e592fa2af1a7d74d07dfb7e8254fa8085ba49effc1283ab58e WatchSource:0}: Error finding container 71c5d93b5b8d96e592fa2af1a7d74d07dfb7e8254fa8085ba49effc1283ab58e: Status 404 returned error can't find the container with id 71c5d93b5b8d96e592fa2af1a7d74d07dfb7e8254fa8085ba49effc1283ab58e Jul 09 11:21:56.229179 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:56.229144 2562 generic.go:356] "Generic (PLEG): container finished" podID="f1eaa168-abbb-4db8-9830-0d5a761c7465" containerID="d5edfbe2f4b0764eb41d8dadf0e7368284dfc5dd0c8691c06dedc09b0ffcd411" exitCode=0 Jul 09 11:21:56.229357 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:56.229237 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" event={"ID":"f1eaa168-abbb-4db8-9830-0d5a761c7465","Type":"ContainerDied","Data":"d5edfbe2f4b0764eb41d8dadf0e7368284dfc5dd0c8691c06dedc09b0ffcd411"} Jul 09 11:21:56.229357 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:56.229343 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" event={"ID":"f1eaa168-abbb-4db8-9830-0d5a761c7465","Type":"ContainerStarted","Data":"71c5d93b5b8d96e592fa2af1a7d74d07dfb7e8254fa8085ba49effc1283ab58e"} Jul 09 11:21:56.231194 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:56.231166 2562 generic.go:356] "Generic (PLEG): container finished" podID="9cea9c5c-e721-475e-ba4c-a6756160fd37" containerID="2d3c4ec9eb337467d280f2780e565ce23fc5d38cfd5d5649de5fe97882bb1f58" exitCode=0 Jul 09 11:21:56.231309 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:56.231256 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" event={"ID":"9cea9c5c-e721-475e-ba4c-a6756160fd37","Type":"ContainerDied","Data":"2d3c4ec9eb337467d280f2780e565ce23fc5d38cfd5d5649de5fe97882bb1f58"} Jul 09 11:21:56.233416 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:56.233393 2562 generic.go:356] "Generic (PLEG): container finished" podID="50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" containerID="bb56a2cadf0c8a176c0b5b88d600c71b82fb6eec37ae727622bc67132005c822" exitCode=0 Jul 09 11:21:56.233503 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:56.233480 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" event={"ID":"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5","Type":"ContainerDied","Data":"bb56a2cadf0c8a176c0b5b88d600c71b82fb6eec37ae727622bc67132005c822"} Jul 09 11:21:56.235755 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:56.235733 2562 generic.go:356] "Generic (PLEG): container finished" podID="644b80ca-4889-498c-b4f7-e4ffdb8e8cce" containerID="dc02c8f7329a25f5da4a32d333105f2e0e55602e89a71d9588150217008fcd06" exitCode=0 Jul 09 11:21:56.235861 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:56.235769 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" event={"ID":"644b80ca-4889-498c-b4f7-e4ffdb8e8cce","Type":"ContainerDied","Data":"dc02c8f7329a25f5da4a32d333105f2e0e55602e89a71d9588150217008fcd06"} Jul 09 11:21:57.243943 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.243913 2562 generic.go:356] "Generic (PLEG): container finished" podID="9cea9c5c-e721-475e-ba4c-a6756160fd37" containerID="e370c25633cfc5273657d68779a22ed5d0ff5e8f546cb9c8c06ae71d6ed7a509" exitCode=0 Jul 09 11:21:57.244426 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.243988 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" event={"ID":"9cea9c5c-e721-475e-ba4c-a6756160fd37","Type":"ContainerDied","Data":"e370c25633cfc5273657d68779a22ed5d0ff5e8f546cb9c8c06ae71d6ed7a509"} Jul 09 11:21:57.246023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.246001 2562 generic.go:356] "Generic (PLEG): container finished" podID="50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" containerID="6f9fc2690a1982b2e7cd50334ed2487eb7c12ce80e2c660a3dfaf06b8df01c4e" exitCode=0 Jul 09 11:21:57.246136 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.246075 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" event={"ID":"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5","Type":"ContainerDied","Data":"6f9fc2690a1982b2e7cd50334ed2487eb7c12ce80e2c660a3dfaf06b8df01c4e"} Jul 09 11:21:57.382582 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.382559 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:57.498474 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.498397 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-util\") pod \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " Jul 09 11:21:57.498474 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.498439 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-bundle\") pod \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " Jul 09 11:21:57.498672 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.498492 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4d6b\" (UniqueName: \"kubernetes.io/projected/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-kube-api-access-z4d6b\") pod \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\" (UID: \"644b80ca-4889-498c-b4f7-e4ffdb8e8cce\") " Jul 09 11:21:57.498957 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.498931 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-bundle" (OuterVolumeSpecName: "bundle") pod "644b80ca-4889-498c-b4f7-e4ffdb8e8cce" (UID: "644b80ca-4889-498c-b4f7-e4ffdb8e8cce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:21:57.503073 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.503042 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-kube-api-access-z4d6b" (OuterVolumeSpecName: "kube-api-access-z4d6b") pod "644b80ca-4889-498c-b4f7-e4ffdb8e8cce" (UID: "644b80ca-4889-498c-b4f7-e4ffdb8e8cce"). InnerVolumeSpecName "kube-api-access-z4d6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:21:57.505800 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.505770 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-util" (OuterVolumeSpecName: "util") pod "644b80ca-4889-498c-b4f7-e4ffdb8e8cce" (UID: "644b80ca-4889-498c-b4f7-e4ffdb8e8cce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:21:57.599992 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.599965 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-util\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:21:57.599992 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.599995 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-bundle\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:21:57.600149 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:57.600011 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4d6b\" (UniqueName: \"kubernetes.io/projected/644b80ca-4889-498c-b4f7-e4ffdb8e8cce-kube-api-access-z4d6b\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:21:58.253675 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.253645 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" Jul 09 11:21:58.254436 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.253674 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc" event={"ID":"644b80ca-4889-498c-b4f7-e4ffdb8e8cce","Type":"ContainerDied","Data":"590ff4ba82b36d0aa2002c27c9901f0ef9152e672d4d3460dd3f9f4efe52eb27"} Jul 09 11:21:58.254436 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.253747 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="590ff4ba82b36d0aa2002c27c9901f0ef9152e672d4d3460dd3f9f4efe52eb27" Jul 09 11:21:58.255691 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.255668 2562 generic.go:356] "Generic (PLEG): container finished" podID="f1eaa168-abbb-4db8-9830-0d5a761c7465" containerID="15bc36bf0d531ef4f8a0f340988b444393ae9fca980950d47307ec7f927bdc36" exitCode=0 Jul 09 11:21:58.255828 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.255794 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" event={"ID":"f1eaa168-abbb-4db8-9830-0d5a761c7465","Type":"ContainerDied","Data":"15bc36bf0d531ef4f8a0f340988b444393ae9fca980950d47307ec7f927bdc36"} Jul 09 11:21:58.395265 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.395234 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:58.478547 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.478521 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:21:58.508876 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.508851 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-util\") pod \"9cea9c5c-e721-475e-ba4c-a6756160fd37\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " Jul 09 11:21:58.509014 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.508936 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h72pm\" (UniqueName: \"kubernetes.io/projected/9cea9c5c-e721-475e-ba4c-a6756160fd37-kube-api-access-h72pm\") pod \"9cea9c5c-e721-475e-ba4c-a6756160fd37\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " Jul 09 11:21:58.509081 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.509029 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-bundle\") pod \"9cea9c5c-e721-475e-ba4c-a6756160fd37\" (UID: \"9cea9c5c-e721-475e-ba4c-a6756160fd37\") " Jul 09 11:21:58.509645 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.509617 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-bundle" (OuterVolumeSpecName: "bundle") pod "9cea9c5c-e721-475e-ba4c-a6756160fd37" (UID: "9cea9c5c-e721-475e-ba4c-a6756160fd37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:21:58.511487 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.511459 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cea9c5c-e721-475e-ba4c-a6756160fd37-kube-api-access-h72pm" (OuterVolumeSpecName: "kube-api-access-h72pm") pod "9cea9c5c-e721-475e-ba4c-a6756160fd37" (UID: "9cea9c5c-e721-475e-ba4c-a6756160fd37"). InnerVolumeSpecName "kube-api-access-h72pm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:21:58.514570 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.514541 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-util" (OuterVolumeSpecName: "util") pod "9cea9c5c-e721-475e-ba4c-a6756160fd37" (UID: "9cea9c5c-e721-475e-ba4c-a6756160fd37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:21:58.609925 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.609893 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-bundle\") pod \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " Jul 09 11:21:58.610107 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.609939 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67n64\" (UniqueName: \"kubernetes.io/projected/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-kube-api-access-67n64\") pod \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " Jul 09 11:21:58.610107 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.609965 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-util\") pod \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\" (UID: \"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5\") " Jul 09 11:21:58.610206 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.610142 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h72pm\" (UniqueName: \"kubernetes.io/projected/9cea9c5c-e721-475e-ba4c-a6756160fd37-kube-api-access-h72pm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:21:58.610206 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.610159 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-bundle\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:21:58.610206 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.610172 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cea9c5c-e721-475e-ba4c-a6756160fd37-util\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:21:58.610567 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.610526 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-bundle" (OuterVolumeSpecName: "bundle") pod "50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" (UID: "50a5fad3-65b0-4029-a5a6-8c6fb3179ed5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:21:58.612587 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.612562 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-kube-api-access-67n64" (OuterVolumeSpecName: "kube-api-access-67n64") pod "50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" (UID: "50a5fad3-65b0-4029-a5a6-8c6fb3179ed5"). InnerVolumeSpecName "kube-api-access-67n64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:21:58.615432 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.615395 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-util" (OuterVolumeSpecName: "util") pod "50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" (UID: "50a5fad3-65b0-4029-a5a6-8c6fb3179ed5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:21:58.711189 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.711147 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-util\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:21:58.711189 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.711180 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-bundle\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:21:58.711189 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:58.711194 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67n64\" (UniqueName: \"kubernetes.io/projected/50a5fad3-65b0-4029-a5a6-8c6fb3179ed5-kube-api-access-67n64\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:21:59.263041 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:59.263006 2562 generic.go:356] "Generic (PLEG): container finished" podID="f1eaa168-abbb-4db8-9830-0d5a761c7465" containerID="583f6b4e45add738fe518b5083c133d3469a5048771a8fd971cec69f7d3943a8" exitCode=0 Jul 09 11:21:59.263488 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:59.263089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" event={"ID":"f1eaa168-abbb-4db8-9830-0d5a761c7465","Type":"ContainerDied","Data":"583f6b4e45add738fe518b5083c133d3469a5048771a8fd971cec69f7d3943a8"} Jul 09 11:21:59.264952 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:59.264932 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" Jul 09 11:21:59.264952 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:59.264942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz" event={"ID":"9cea9c5c-e721-475e-ba4c-a6756160fd37","Type":"ContainerDied","Data":"32ba24b7a67f9b8502f8fefe96d8ea6d268e3ca9d9e54b8fd193f5d594c67970"} Jul 09 11:21:59.265114 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:59.264982 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32ba24b7a67f9b8502f8fefe96d8ea6d268e3ca9d9e54b8fd193f5d594c67970" Jul 09 11:21:59.266795 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:59.266773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" event={"ID":"50a5fad3-65b0-4029-a5a6-8c6fb3179ed5","Type":"ContainerDied","Data":"5a99625a95343325226d25e306f9c51c95fd1b9d0da0e6356b52de24931d73c2"} Jul 09 11:21:59.266948 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:59.266816 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a99625a95343325226d25e306f9c51c95fd1b9d0da0e6356b52de24931d73c2" Jul 09 11:21:59.266948 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:21:59.266777 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr" Jul 09 11:22:00.400558 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:00.400531 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:22:00.529466 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:00.529381 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bbl4\" (UniqueName: \"kubernetes.io/projected/f1eaa168-abbb-4db8-9830-0d5a761c7465-kube-api-access-2bbl4\") pod \"f1eaa168-abbb-4db8-9830-0d5a761c7465\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " Jul 09 11:22:00.529466 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:00.529459 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-util\") pod \"f1eaa168-abbb-4db8-9830-0d5a761c7465\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " Jul 09 11:22:00.529639 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:00.529530 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-bundle\") pod \"f1eaa168-abbb-4db8-9830-0d5a761c7465\" (UID: \"f1eaa168-abbb-4db8-9830-0d5a761c7465\") " Jul 09 11:22:00.530008 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:00.529975 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-bundle" (OuterVolumeSpecName: "bundle") pod "f1eaa168-abbb-4db8-9830-0d5a761c7465" (UID: "f1eaa168-abbb-4db8-9830-0d5a761c7465"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:22:00.531453 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:00.531433 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1eaa168-abbb-4db8-9830-0d5a761c7465-kube-api-access-2bbl4" (OuterVolumeSpecName: "kube-api-access-2bbl4") pod "f1eaa168-abbb-4db8-9830-0d5a761c7465" (UID: "f1eaa168-abbb-4db8-9830-0d5a761c7465"). InnerVolumeSpecName "kube-api-access-2bbl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:22:00.535053 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:00.535029 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-util" (OuterVolumeSpecName: "util") pod "f1eaa168-abbb-4db8-9830-0d5a761c7465" (UID: "f1eaa168-abbb-4db8-9830-0d5a761c7465"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:22:00.630517 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:00.630492 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-util\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:00.630517 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:00.630514 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1eaa168-abbb-4db8-9830-0d5a761c7465-bundle\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:00.630670 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:00.630523 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bbl4\" (UniqueName: \"kubernetes.io/projected/f1eaa168-abbb-4db8-9830-0d5a761c7465-kube-api-access-2bbl4\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:01.279501 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:01.279472 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" Jul 09 11:22:01.279501 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:01.279494 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd" event={"ID":"f1eaa168-abbb-4db8-9830-0d5a761c7465","Type":"ContainerDied","Data":"71c5d93b5b8d96e592fa2af1a7d74d07dfb7e8254fa8085ba49effc1283ab58e"} Jul 09 11:22:01.279699 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:01.279538 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71c5d93b5b8d96e592fa2af1a7d74d07dfb7e8254fa8085ba49effc1283ab58e" Jul 09 11:22:11.578786 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.578748 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6"] Jul 09 11:22:11.579201 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579166 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1eaa168-abbb-4db8-9830-0d5a761c7465" containerName="util" Jul 09 11:22:11.579201 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579180 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1eaa168-abbb-4db8-9830-0d5a761c7465" containerName="util" Jul 09 11:22:11.579201 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579194 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="644b80ca-4889-498c-b4f7-e4ffdb8e8cce" containerName="pull" Jul 09 11:22:11.579201 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579199 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="644b80ca-4889-498c-b4f7-e4ffdb8e8cce" containerName="pull" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579208 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="644b80ca-4889-498c-b4f7-e4ffdb8e8cce" containerName="util" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579215 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="644b80ca-4889-498c-b4f7-e4ffdb8e8cce" containerName="util" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579224 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1eaa168-abbb-4db8-9830-0d5a761c7465" containerName="pull" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579230 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1eaa168-abbb-4db8-9830-0d5a761c7465" containerName="pull" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579237 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cea9c5c-e721-475e-ba4c-a6756160fd37" containerName="extract" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579244 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cea9c5c-e721-475e-ba4c-a6756160fd37" containerName="extract" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579254 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" containerName="extract" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579262 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" containerName="extract" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579270 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cea9c5c-e721-475e-ba4c-a6756160fd37" containerName="util" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579275 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cea9c5c-e721-475e-ba4c-a6756160fd37" containerName="util" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579294 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" containerName="util" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579319 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" containerName="util" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579330 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="644b80ca-4889-498c-b4f7-e4ffdb8e8cce" containerName="extract" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579340 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="644b80ca-4889-498c-b4f7-e4ffdb8e8cce" containerName="extract" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579353 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" containerName="pull" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579357 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" containerName="pull" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579363 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1eaa168-abbb-4db8-9830-0d5a761c7465" containerName="extract" Jul 09 11:22:11.579366 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579368 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1eaa168-abbb-4db8-9830-0d5a761c7465" containerName="extract" Jul 09 11:22:11.579889 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579376 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cea9c5c-e721-475e-ba4c-a6756160fd37" containerName="pull" Jul 09 11:22:11.579889 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579380 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cea9c5c-e721-475e-ba4c-a6756160fd37" containerName="pull" Jul 09 11:22:11.579889 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579448 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="644b80ca-4889-498c-b4f7-e4ffdb8e8cce" containerName="extract" Jul 09 11:22:11.579889 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579456 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cea9c5c-e721-475e-ba4c-a6756160fd37" containerName="extract" Jul 09 11:22:11.579889 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579463 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="50a5fad3-65b0-4029-a5a6-8c6fb3179ed5" containerName="extract" Jul 09 11:22:11.579889 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.579469 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1eaa168-abbb-4db8-9830-0d5a761c7465" containerName="extract" Jul 09 11:22:11.583986 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.583969 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:11.587242 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.587218 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qt6jx\"" Jul 09 11:22:11.606451 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.606421 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6"] Jul 09 11:22:11.627207 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.627170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kjvg\" (UniqueName: \"kubernetes.io/projected/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-kube-api-access-6kjvg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" (UID: \"2f20abb7-68ce-4381-b4c7-8a994fbd04b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:11.627530 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.627507 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" (UID: \"2f20abb7-68ce-4381-b4c7-8a994fbd04b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:11.728135 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.728091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kjvg\" (UniqueName: \"kubernetes.io/projected/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-kube-api-access-6kjvg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" (UID: \"2f20abb7-68ce-4381-b4c7-8a994fbd04b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:11.728346 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.728192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" (UID: \"2f20abb7-68ce-4381-b4c7-8a994fbd04b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:11.728677 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.728653 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" (UID: \"2f20abb7-68ce-4381-b4c7-8a994fbd04b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:11.738916 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.738888 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kjvg\" (UniqueName: \"kubernetes.io/projected/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-kube-api-access-6kjvg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" (UID: \"2f20abb7-68ce-4381-b4c7-8a994fbd04b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:11.894527 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:11.894434 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:12.050314 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:12.050272 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6"] Jul 09 11:22:12.052154 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:22:12.052128 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f20abb7_68ce_4381_b4c7_8a994fbd04b5.slice/crio-1afea6dd81a8272854ddbd04ea49e38895d0a0e6bc58c425ac161fba83864527 WatchSource:0}: Error finding container 1afea6dd81a8272854ddbd04ea49e38895d0a0e6bc58c425ac161fba83864527: Status 404 returned error can't find the container with id 1afea6dd81a8272854ddbd04ea49e38895d0a0e6bc58c425ac161fba83864527 Jul 09 11:22:12.337774 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:12.337741 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" event={"ID":"2f20abb7-68ce-4381-b4c7-8a994fbd04b5","Type":"ContainerStarted","Data":"1afea6dd81a8272854ddbd04ea49e38895d0a0e6bc58c425ac161fba83864527"} Jul 09 11:22:14.251390 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:14.251358 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c"] Jul 09 11:22:14.255580 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:14.255558 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c" Jul 09 11:22:14.258657 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:14.258631 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jqtkb\"" Jul 09 11:22:14.276756 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:14.276678 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c"] Jul 09 11:22:14.351669 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:14.351637 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n8b5\" (UniqueName: \"kubernetes.io/projected/b4bc416d-f5b2-44ba-8693-34b01cbe711f-kube-api-access-5n8b5\") pod \"authorino-operator-75cc8d5cb7-s6g8c\" (UID: \"b4bc416d-f5b2-44ba-8693-34b01cbe711f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c" Jul 09 11:22:14.452335 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:14.452298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n8b5\" (UniqueName: \"kubernetes.io/projected/b4bc416d-f5b2-44ba-8693-34b01cbe711f-kube-api-access-5n8b5\") pod \"authorino-operator-75cc8d5cb7-s6g8c\" (UID: \"b4bc416d-f5b2-44ba-8693-34b01cbe711f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c" Jul 09 11:22:14.465054 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:14.465021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n8b5\" (UniqueName: \"kubernetes.io/projected/b4bc416d-f5b2-44ba-8693-34b01cbe711f-kube-api-access-5n8b5\") pod \"authorino-operator-75cc8d5cb7-s6g8c\" (UID: \"b4bc416d-f5b2-44ba-8693-34b01cbe711f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c" Jul 09 11:22:14.570570 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:14.570479 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c" Jul 09 11:22:14.729676 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:14.729578 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c"] Jul 09 11:22:14.729676 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:22:14.729642 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4bc416d_f5b2_44ba_8693_34b01cbe711f.slice/crio-59a012129a642bfe42bad6d798e10be2212f1c71e6565dde543e030abde71d39 WatchSource:0}: Error finding container 59a012129a642bfe42bad6d798e10be2212f1c71e6565dde543e030abde71d39: Status 404 returned error can't find the container with id 59a012129a642bfe42bad6d798e10be2212f1c71e6565dde543e030abde71d39 Jul 09 11:22:15.357993 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:15.357945 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c" event={"ID":"b4bc416d-f5b2-44ba-8693-34b01cbe711f","Type":"ContainerStarted","Data":"59a012129a642bfe42bad6d798e10be2212f1c71e6565dde543e030abde71d39"} Jul 09 11:22:16.239796 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:16.239757 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl"] Jul 09 11:22:16.247946 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:16.247912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:16.251670 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:16.251606 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9gtjf\"" Jul 09 11:22:16.253569 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:16.253542 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl"] Jul 09 11:22:16.270616 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:16.270473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk9b7\" (UniqueName: \"kubernetes.io/projected/907fd6c8-84fc-41f7-92d6-586e14b4baa0-kube-api-access-pk9b7\") pod \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" (UID: \"907fd6c8-84fc-41f7-92d6-586e14b4baa0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:16.371775 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:16.371734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk9b7\" (UniqueName: \"kubernetes.io/projected/907fd6c8-84fc-41f7-92d6-586e14b4baa0-kube-api-access-pk9b7\") pod \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" (UID: \"907fd6c8-84fc-41f7-92d6-586e14b4baa0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:16.387728 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:16.387697 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk9b7\" (UniqueName: \"kubernetes.io/projected/907fd6c8-84fc-41f7-92d6-586e14b4baa0-kube-api-access-pk9b7\") pod \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" (UID: \"907fd6c8-84fc-41f7-92d6-586e14b4baa0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:16.564886 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:16.564792 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:17.040552 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.040512 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dbbcd5bbb-nc79z"] Jul 09 11:22:17.045059 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.045029 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.074867 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.074836 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbbcd5bbb-nc79z"] Jul 09 11:22:17.078867 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.078834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afc7c0d1-b5ec-4a34-a716-edee2413da41-console-serving-cert\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.078996 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.078873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-trusted-ca-bundle\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.078996 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.078910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7znn\" (UniqueName: \"kubernetes.io/projected/afc7c0d1-b5ec-4a34-a716-edee2413da41-kube-api-access-q7znn\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.078996 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.078961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-console-config\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.079124 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.079015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afc7c0d1-b5ec-4a34-a716-edee2413da41-console-oauth-config\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.079175 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.079119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-oauth-serving-cert\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.079218 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.079173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-service-ca\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.180391 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.180348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7znn\" (UniqueName: \"kubernetes.io/projected/afc7c0d1-b5ec-4a34-a716-edee2413da41-kube-api-access-q7znn\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.180568 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.180411 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-console-config\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.180568 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.180482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afc7c0d1-b5ec-4a34-a716-edee2413da41-console-oauth-config\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.180568 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.180549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-oauth-serving-cert\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.180865 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.180589 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-service-ca\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.180865 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.180650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afc7c0d1-b5ec-4a34-a716-edee2413da41-console-serving-cert\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.180865 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.180674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-trusted-ca-bundle\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.181177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.181161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-console-config\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.181379 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.181325 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-oauth-serving-cert\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.181796 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.181767 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-service-ca\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.181966 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.181946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afc7c0d1-b5ec-4a34-a716-edee2413da41-trusted-ca-bundle\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.183915 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.183889 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afc7c0d1-b5ec-4a34-a716-edee2413da41-console-oauth-config\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.184112 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.184088 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afc7c0d1-b5ec-4a34-a716-edee2413da41-console-serving-cert\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.190156 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.190128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7znn\" (UniqueName: \"kubernetes.io/projected/afc7c0d1-b5ec-4a34-a716-edee2413da41-kube-api-access-q7znn\") pod \"console-7dbbcd5bbb-nc79z\" (UID: \"afc7c0d1-b5ec-4a34-a716-edee2413da41\") " pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:17.296655 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.296621 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl"] Jul 09 11:22:17.358660 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:17.358629 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:18.353058 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:22:18.353022 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod907fd6c8_84fc_41f7_92d6_586e14b4baa0.slice/crio-2651ddfe6cf5a30e644a545c2d59e6cd7dabb1eda2d730ece9cdce5e3a209807 WatchSource:0}: Error finding container 2651ddfe6cf5a30e644a545c2d59e6cd7dabb1eda2d730ece9cdce5e3a209807: Status 404 returned error can't find the container with id 2651ddfe6cf5a30e644a545c2d59e6cd7dabb1eda2d730ece9cdce5e3a209807 Jul 09 11:22:18.382472 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:18.382436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" event={"ID":"907fd6c8-84fc-41f7-92d6-586e14b4baa0","Type":"ContainerStarted","Data":"2651ddfe6cf5a30e644a545c2d59e6cd7dabb1eda2d730ece9cdce5e3a209807"} Jul 09 11:22:18.515850 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:18.515823 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbbcd5bbb-nc79z"] Jul 09 11:22:18.517247 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:22:18.517220 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafc7c0d1_b5ec_4a34_a716_edee2413da41.slice/crio-6f5a385b73ff75cf68966d53dc7ebd947b5533f80038d460f3a37e483dd7624e WatchSource:0}: Error finding container 6f5a385b73ff75cf68966d53dc7ebd947b5533f80038d460f3a37e483dd7624e: Status 404 returned error can't find the container with id 6f5a385b73ff75cf68966d53dc7ebd947b5533f80038d460f3a37e483dd7624e Jul 09 11:22:19.389994 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:19.389957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" event={"ID":"2f20abb7-68ce-4381-b4c7-8a994fbd04b5","Type":"ContainerStarted","Data":"e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172"} Jul 09 11:22:19.390464 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:19.390051 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:19.391661 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:19.391634 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c" event={"ID":"b4bc416d-f5b2-44ba-8693-34b01cbe711f","Type":"ContainerStarted","Data":"6ec8d8caf87657ca5993b367fc473b292f0bbfd24a8ec667aeb36935851ab9ce"} Jul 09 11:22:19.391762 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:19.391690 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c" Jul 09 11:22:19.393118 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:19.393090 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbbcd5bbb-nc79z" event={"ID":"afc7c0d1-b5ec-4a34-a716-edee2413da41","Type":"ContainerStarted","Data":"b7295d653bce0d206648699e4eba8dffc73d8e4a44e9c099348a4b1ecb64ad90"} Jul 09 11:22:19.393209 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:19.393127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbbcd5bbb-nc79z" event={"ID":"afc7c0d1-b5ec-4a34-a716-edee2413da41","Type":"ContainerStarted","Data":"6f5a385b73ff75cf68966d53dc7ebd947b5533f80038d460f3a37e483dd7624e"} Jul 09 11:22:19.449864 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:19.449755 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" podStartSLOduration=2.071002314 podStartE2EDuration="8.449735298s" totalImagesPullingTime="6.378732984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:22:19.448393385 +0000 UTC m=+645.359237929" watchObservedRunningTime="2026-07-09 11:22:19.449735298 +0000 UTC m=+645.360579818" Jul 09 11:22:19.566926 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:19.566872 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c" podStartSLOduration=1.9464465020000001 podStartE2EDuration="5.566853992s" totalImagesPullingTime="3.62040749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:22:19.517521114 +0000 UTC m=+645.428365641" watchObservedRunningTime="2026-07-09 11:22:19.566853992 +0000 UTC m=+645.477698517" Jul 09 11:22:19.567162 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:19.567142 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dbbcd5bbb-nc79z" podStartSLOduration=3.567135147 podStartE2EDuration="3.567135147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:22:19.563246717 +0000 UTC m=+645.474091244" watchObservedRunningTime="2026-07-09 11:22:19.567135147 +0000 UTC m=+645.477979672" Jul 09 11:22:20.402908 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:20.402865 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" event={"ID":"907fd6c8-84fc-41f7-92d6-586e14b4baa0","Type":"ContainerStarted","Data":"aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10"} Jul 09 11:22:20.431346 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:20.431277 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" podStartSLOduration=2.578219782 podStartE2EDuration="4.431261172s" totalImagesPullingTime="1.85304139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:22:20.428544508 +0000 UTC m=+646.339389034" watchObservedRunningTime="2026-07-09 11:22:20.431261172 +0000 UTC m=+646.342105697" Jul 09 11:22:21.409079 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:21.409048 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:27.359266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:27.359229 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:27.359749 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:27.359424 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:27.364357 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:27.364331 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:27.446793 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:27.446765 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dbbcd5bbb-nc79z" Jul 09 11:22:27.517689 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:27.517654 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7979f66cc7-xjh5m"] Jul 09 11:22:30.405138 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:30.405110 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:30.405623 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:30.405188 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6g8c" Jul 09 11:22:32.416549 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.416519 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:32.827466 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.827425 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6"] Jul 09 11:22:32.827765 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.827710 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" containerName="manager" containerID="cri-o://e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172" gracePeriod=2 Jul 09 11:22:32.830992 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:32.830960 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:32.831261 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.831239 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6"] Jul 09 11:22:32.865336 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.865303 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl"] Jul 09 11:22:32.865557 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.865533 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" containerName="manager" containerID="cri-o://aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10" gracePeriod=2 Jul 09 11:22:32.868119 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:32.868082 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:32.870991 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.870969 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5"] Jul 09 11:22:32.871453 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.871438 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" containerName="manager" Jul 09 11:22:32.871539 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.871455 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" containerName="manager" Jul 09 11:22:32.871539 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.871526 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" containerName="manager" Jul 09 11:22:32.874668 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.874651 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:32.882930 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.882905 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl"] Jul 09 11:22:32.886766 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:32.886738 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:32.889240 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:32.889208 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:32.902126 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.902099 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5"] Jul 09 11:22:32.913702 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.913665 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb"] Jul 09 11:22:32.914398 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.914373 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" containerName="manager" Jul 09 11:22:32.914398 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.914399 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" containerName="manager" Jul 09 11:22:32.914556 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.914518 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" containerName="manager" Jul 09 11:22:32.917637 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.917623 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb" Jul 09 11:22:32.931350 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.931319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/741b9be2-5e53-404a-a817-de935d1acef5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m8m5\" (UID: \"741b9be2-5e53-404a-a817-de935d1acef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:32.931496 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.931361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln4qr\" (UniqueName: \"kubernetes.io/projected/741b9be2-5e53-404a-a817-de935d1acef5-kube-api-access-ln4qr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m8m5\" (UID: \"741b9be2-5e53-404a-a817-de935d1acef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:32.942242 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:32.942210 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb"] Jul 09 11:22:32.948977 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:32.948937 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:32.951537 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:32.951510 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:33.032261 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.032225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/741b9be2-5e53-404a-a817-de935d1acef5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m8m5\" (UID: \"741b9be2-5e53-404a-a817-de935d1acef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:33.032261 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.032263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln4qr\" (UniqueName: \"kubernetes.io/projected/741b9be2-5e53-404a-a817-de935d1acef5-kube-api-access-ln4qr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m8m5\" (UID: \"741b9be2-5e53-404a-a817-de935d1acef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:33.032514 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.032318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-699sf\" (UniqueName: \"kubernetes.io/projected/487a2494-2d2b-4338-96ea-bc619d8b30b1-kube-api-access-699sf\") pod \"limitador-operator-controller-manager-859d7b78bd-bdgjb\" (UID: \"487a2494-2d2b-4338-96ea-bc619d8b30b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb" Jul 09 11:22:33.032620 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.032599 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/741b9be2-5e53-404a-a817-de935d1acef5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m8m5\" (UID: \"741b9be2-5e53-404a-a817-de935d1acef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:33.045791 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.045735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln4qr\" (UniqueName: \"kubernetes.io/projected/741b9be2-5e53-404a-a817-de935d1acef5-kube-api-access-ln4qr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m8m5\" (UID: \"741b9be2-5e53-404a-a817-de935d1acef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:33.120346 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.120317 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:33.123420 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.123394 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:33.125223 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.125197 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:33.128344 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.128316 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:33.130904 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.130882 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:33.133338 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.133315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-699sf\" (UniqueName: \"kubernetes.io/projected/487a2494-2d2b-4338-96ea-bc619d8b30b1-kube-api-access-699sf\") pod \"limitador-operator-controller-manager-859d7b78bd-bdgjb\" (UID: \"487a2494-2d2b-4338-96ea-bc619d8b30b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb" Jul 09 11:22:33.136773 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.136750 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:33.150071 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.150047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-699sf\" (UniqueName: \"kubernetes.io/projected/487a2494-2d2b-4338-96ea-bc619d8b30b1-kube-api-access-699sf\") pod \"limitador-operator-controller-manager-859d7b78bd-bdgjb\" (UID: \"487a2494-2d2b-4338-96ea-bc619d8b30b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb" Jul 09 11:22:33.233852 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.233820 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk9b7\" (UniqueName: \"kubernetes.io/projected/907fd6c8-84fc-41f7-92d6-586e14b4baa0-kube-api-access-pk9b7\") pod \"907fd6c8-84fc-41f7-92d6-586e14b4baa0\" (UID: \"907fd6c8-84fc-41f7-92d6-586e14b4baa0\") " Jul 09 11:22:33.234061 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.233912 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-extensions-socket-volume\") pod \"2f20abb7-68ce-4381-b4c7-8a994fbd04b5\" (UID: \"2f20abb7-68ce-4381-b4c7-8a994fbd04b5\") " Jul 09 11:22:33.234061 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.234007 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kjvg\" (UniqueName: \"kubernetes.io/projected/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-kube-api-access-6kjvg\") pod \"2f20abb7-68ce-4381-b4c7-8a994fbd04b5\" (UID: \"2f20abb7-68ce-4381-b4c7-8a994fbd04b5\") " Jul 09 11:22:33.234357 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.234333 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2f20abb7-68ce-4381-b4c7-8a994fbd04b5" (UID: "2f20abb7-68ce-4381-b4c7-8a994fbd04b5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:22:33.235981 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.235965 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-kube-api-access-6kjvg" (OuterVolumeSpecName: "kube-api-access-6kjvg") pod "2f20abb7-68ce-4381-b4c7-8a994fbd04b5" (UID: "2f20abb7-68ce-4381-b4c7-8a994fbd04b5"). InnerVolumeSpecName "kube-api-access-6kjvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:22:33.236031 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.235982 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/907fd6c8-84fc-41f7-92d6-586e14b4baa0-kube-api-access-pk9b7" (OuterVolumeSpecName: "kube-api-access-pk9b7") pod "907fd6c8-84fc-41f7-92d6-586e14b4baa0" (UID: "907fd6c8-84fc-41f7-92d6-586e14b4baa0"). InnerVolumeSpecName "kube-api-access-pk9b7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:22:33.268383 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.268352 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:33.278682 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.278654 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb" Jul 09 11:22:33.335738 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.335701 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-extensions-socket-volume\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:33.335738 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.335739 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kjvg\" (UniqueName: \"kubernetes.io/projected/2f20abb7-68ce-4381-b4c7-8a994fbd04b5-kube-api-access-6kjvg\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:33.335953 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.335755 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk9b7\" (UniqueName: \"kubernetes.io/projected/907fd6c8-84fc-41f7-92d6-586e14b4baa0-kube-api-access-pk9b7\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:33.426962 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.426934 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5"] Jul 09 11:22:33.429246 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:22:33.429219 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741b9be2_5e53_404a_a817_de935d1acef5.slice/crio-eaa7259d323ea6089dc8e206d94e5312ee11dfd9f6ff77fd92137eaa191f2d01 WatchSource:0}: Error finding container eaa7259d323ea6089dc8e206d94e5312ee11dfd9f6ff77fd92137eaa191f2d01: Status 404 returned error can't find the container with id eaa7259d323ea6089dc8e206d94e5312ee11dfd9f6ff77fd92137eaa191f2d01 Jul 09 11:22:33.466912 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.466867 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb"] Jul 09 11:22:33.468159 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:22:33.468132 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487a2494_2d2b_4338_96ea_bc619d8b30b1.slice/crio-afce39b4e2246a2887ca875b8bcec763088eb2225b6db2469b2a278b143598c6 WatchSource:0}: Error finding container afce39b4e2246a2887ca875b8bcec763088eb2225b6db2469b2a278b143598c6: Status 404 returned error can't find the container with id afce39b4e2246a2887ca875b8bcec763088eb2225b6db2469b2a278b143598c6 Jul 09 11:22:33.479747 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.479721 2562 generic.go:356] "Generic (PLEG): container finished" podID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" containerID="aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10" exitCode=0 Jul 09 11:22:33.479853 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.479764 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:33.479853 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.479813 2562 scope.go:117] "RemoveContainer" containerID="aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10" Jul 09 11:22:33.481418 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.481395 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb" event={"ID":"487a2494-2d2b-4338-96ea-bc619d8b30b1","Type":"ContainerStarted","Data":"afce39b4e2246a2887ca875b8bcec763088eb2225b6db2469b2a278b143598c6"} Jul 09 11:22:33.483174 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.483148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" event={"ID":"741b9be2-5e53-404a-a817-de935d1acef5","Type":"ContainerStarted","Data":"eaa7259d323ea6089dc8e206d94e5312ee11dfd9f6ff77fd92137eaa191f2d01"} Jul 09 11:22:33.483294 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.483191 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:33.484820 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.484798 2562 generic.go:356] "Generic (PLEG): container finished" podID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" containerID="e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172" exitCode=0 Jul 09 11:22:33.484928 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.484853 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:33.485680 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.485490 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:33.487803 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.487775 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:33.490145 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.490118 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:33.491589 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.491566 2562 scope.go:117] "RemoveContainer" containerID="aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10" Jul 09 11:22:33.491905 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.491871 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10\": container with ID starting with aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10 not found: ID does not exist" containerID="aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10" Jul 09 11:22:33.492004 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.491901 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10"} err="failed to get container status \"aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10\": rpc error: code = NotFound desc = could not find container \"aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10\": container with ID starting with aecdb57b8dda993df185a9e2c52fc63d182e3f39935df783a58ba806a1a3fe10 not found: ID does not exist" Jul 09 11:22:33.492004 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.491920 2562 scope.go:117] "RemoveContainer" containerID="e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172" Jul 09 11:22:33.494275 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.494252 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:33.496544 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.496444 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:33.499498 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.499385 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:33.501626 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.501573 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:33.504624 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.504597 2562 scope.go:117] "RemoveContainer" containerID="e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172" Jul 09 11:22:33.504970 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:33.504942 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172\": container with ID starting with e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172 not found: ID does not exist" containerID="e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172" Jul 09 11:22:33.505056 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:33.504978 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172"} err="failed to get container status \"e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172\": rpc error: code = NotFound desc = could not find container \"e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172\": container with ID starting with e85a225a407c2892a56531d2ae078fd8881fa95e5c08e317550807ec8b70a172 not found: ID does not exist" Jul 09 11:22:34.167424 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.167330 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4"] Jul 09 11:22:34.171120 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.171102 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:22:34.174762 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:34.174531 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:34.177458 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:34.177422 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:34.193731 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.193698 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4"] Jul 09 11:22:34.244624 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.244591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9jlk\" (UniqueName: \"kubernetes.io/projected/ef3d52bc-0228-4674-8b81-dcfca48bb983-kube-api-access-b9jlk\") pod \"kuadrant-operator-controller-manager-86878c769f-9pmj4\" (UID: \"ef3d52bc-0228-4674-8b81-dcfca48bb983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:22:34.244804 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.244653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef3d52bc-0228-4674-8b81-dcfca48bb983-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9pmj4\" (UID: \"ef3d52bc-0228-4674-8b81-dcfca48bb983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:22:34.345420 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.345380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9jlk\" (UniqueName: \"kubernetes.io/projected/ef3d52bc-0228-4674-8b81-dcfca48bb983-kube-api-access-b9jlk\") pod \"kuadrant-operator-controller-manager-86878c769f-9pmj4\" (UID: \"ef3d52bc-0228-4674-8b81-dcfca48bb983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:22:34.345615 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.345444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef3d52bc-0228-4674-8b81-dcfca48bb983-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9pmj4\" (UID: \"ef3d52bc-0228-4674-8b81-dcfca48bb983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:22:34.345855 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.345833 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef3d52bc-0228-4674-8b81-dcfca48bb983-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9pmj4\" (UID: \"ef3d52bc-0228-4674-8b81-dcfca48bb983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:22:34.359324 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.359273 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9jlk\" (UniqueName: \"kubernetes.io/projected/ef3d52bc-0228-4674-8b81-dcfca48bb983-kube-api-access-b9jlk\") pod \"kuadrant-operator-controller-manager-86878c769f-9pmj4\" (UID: \"ef3d52bc-0228-4674-8b81-dcfca48bb983\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:22:34.483345 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.483238 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:22:34.495013 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.494967 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb" event={"ID":"487a2494-2d2b-4338-96ea-bc619d8b30b1","Type":"ContainerStarted","Data":"12c9ba739d990677d1cb54b11d587ccd19700439f98ba607935d2a8833dc9442"} Jul 09 11:22:34.495154 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.495055 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb" Jul 09 11:22:34.496899 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.496876 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" event={"ID":"741b9be2-5e53-404a-a817-de935d1acef5","Type":"ContainerStarted","Data":"4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b"} Jul 09 11:22:34.497025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.496992 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:34.501728 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:34.501615 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:34.504642 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:34.504611 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:34.549163 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.549075 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb" podStartSLOduration=2.5490560479999997 podStartE2EDuration="2.549056048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:22:34.548944881 +0000 UTC m=+660.459789411" watchObservedRunningTime="2026-07-09 11:22:34.549056048 +0000 UTC m=+660.459900576" Jul 09 11:22:34.552579 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:34.552539 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:34.555195 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:34.555159 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:34.602404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.602345 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" podStartSLOduration=2.602321264 podStartE2EDuration="2.602321264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:22:34.600261724 +0000 UTC m=+660.511106263" watchObservedRunningTime="2026-07-09 11:22:34.602321264 +0000 UTC m=+660.513165792" Jul 09 11:22:34.614263 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:34.614219 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cpdn6\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpdn6" Jul 09 11:22:34.615336 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.615304 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f20abb7-68ce-4381-b4c7-8a994fbd04b5" path="/var/lib/kubelet/pods/2f20abb7-68ce-4381-b4c7-8a994fbd04b5/volumes" Jul 09 11:22:34.615817 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.615780 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" path="/var/lib/kubelet/pods/907fd6c8-84fc-41f7-92d6-586e14b4baa0/volumes" Jul 09 11:22:34.616717 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:34.616693 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v8rsl\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="907fd6c8-84fc-41f7-92d6-586e14b4baa0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8rsl" Jul 09 11:22:34.652127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:34.652103 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4"] Jul 09 11:22:34.654399 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:22:34.654374 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3d52bc_0228_4674_8b81_dcfca48bb983.slice/crio-f1e8f5cb81cab62d6cb361bb866c43a09694d8cb7caeb91b687fb2a79fa59d23 WatchSource:0}: Error finding container f1e8f5cb81cab62d6cb361bb866c43a09694d8cb7caeb91b687fb2a79fa59d23: Status 404 returned error can't find the container with id f1e8f5cb81cab62d6cb361bb866c43a09694d8cb7caeb91b687fb2a79fa59d23 Jul 09 11:22:35.505350 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:35.505316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" event={"ID":"ef3d52bc-0228-4674-8b81-dcfca48bb983","Type":"ContainerStarted","Data":"050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9"} Jul 09 11:22:35.505730 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:35.505371 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" event={"ID":"ef3d52bc-0228-4674-8b81-dcfca48bb983","Type":"ContainerStarted","Data":"f1e8f5cb81cab62d6cb361bb866c43a09694d8cb7caeb91b687fb2a79fa59d23"} Jul 09 11:22:35.505730 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:35.505574 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:22:35.529167 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:35.529117 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" podStartSLOduration=1.529102635 podStartE2EDuration="1.529102635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:22:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:22:35.528791725 +0000 UTC m=+661.439636255" watchObservedRunningTime="2026-07-09 11:22:35.529102635 +0000 UTC m=+661.439947161" Jul 09 11:22:45.508052 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:45.508019 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdgjb" Jul 09 11:22:45.508479 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:45.508096 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:46.514023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:46.513988 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:22:46.583421 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:46.583366 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5"] Jul 09 11:22:46.583688 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:46.583662 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" podUID="741b9be2-5e53-404a-a817-de935d1acef5" containerName="manager" containerID="cri-o://4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b" gracePeriod=10 Jul 09 11:22:46.843880 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:46.843856 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:46.966202 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:46.966167 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/741b9be2-5e53-404a-a817-de935d1acef5-extensions-socket-volume\") pod \"741b9be2-5e53-404a-a817-de935d1acef5\" (UID: \"741b9be2-5e53-404a-a817-de935d1acef5\") " Jul 09 11:22:46.966202 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:46.966204 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln4qr\" (UniqueName: \"kubernetes.io/projected/741b9be2-5e53-404a-a817-de935d1acef5-kube-api-access-ln4qr\") pod \"741b9be2-5e53-404a-a817-de935d1acef5\" (UID: \"741b9be2-5e53-404a-a817-de935d1acef5\") " Jul 09 11:22:46.966601 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:46.966578 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/741b9be2-5e53-404a-a817-de935d1acef5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "741b9be2-5e53-404a-a817-de935d1acef5" (UID: "741b9be2-5e53-404a-a817-de935d1acef5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:22:46.968559 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:46.968535 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741b9be2-5e53-404a-a817-de935d1acef5-kube-api-access-ln4qr" (OuterVolumeSpecName: "kube-api-access-ln4qr") pod "741b9be2-5e53-404a-a817-de935d1acef5" (UID: "741b9be2-5e53-404a-a817-de935d1acef5"). InnerVolumeSpecName "kube-api-access-ln4qr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:22:47.067257 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:47.067176 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/741b9be2-5e53-404a-a817-de935d1acef5-extensions-socket-volume\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:47.067257 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:47.067206 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln4qr\" (UniqueName: \"kubernetes.io/projected/741b9be2-5e53-404a-a817-de935d1acef5-kube-api-access-ln4qr\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:47.579587 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:47.579554 2562 generic.go:356] "Generic (PLEG): container finished" podID="741b9be2-5e53-404a-a817-de935d1acef5" containerID="4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b" exitCode=0 Jul 09 11:22:47.579964 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:47.579602 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" Jul 09 11:22:47.579964 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:47.579643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" event={"ID":"741b9be2-5e53-404a-a817-de935d1acef5","Type":"ContainerDied","Data":"4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b"} Jul 09 11:22:47.579964 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:47.579696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5" event={"ID":"741b9be2-5e53-404a-a817-de935d1acef5","Type":"ContainerDied","Data":"eaa7259d323ea6089dc8e206d94e5312ee11dfd9f6ff77fd92137eaa191f2d01"} Jul 09 11:22:47.579964 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:47.579720 2562 scope.go:117] "RemoveContainer" containerID="4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b" Jul 09 11:22:47.589409 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:47.589214 2562 scope.go:117] "RemoveContainer" containerID="4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b" Jul 09 11:22:47.589525 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:47.589507 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b\": container with ID starting with 4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b not found: ID does not exist" containerID="4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b" Jul 09 11:22:47.589569 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:47.589535 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b"} err="failed to get container status \"4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b\": rpc error: code = NotFound desc = could not find container \"4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b\": container with ID starting with 4d6517cacd8e7f2e767d8d69f6328d4e33da0bf32d7227382637be899be0c39b not found: ID does not exist" Jul 09 11:22:47.602867 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:47.602840 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5"] Jul 09 11:22:47.605066 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:47.605049 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m8m5"] Jul 09 11:22:48.611456 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:48.611425 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="741b9be2-5e53-404a-a817-de935d1acef5" path="/var/lib/kubelet/pods/741b9be2-5e53-404a-a817-de935d1acef5/volumes" Jul 09 11:22:52.540121 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.540070 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7979f66cc7-xjh5m" podUID="5a7d903a-eed6-4080-8fbe-37160f8284c0" containerName="console" containerID="cri-o://a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0" gracePeriod=15 Jul 09 11:22:52.804272 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.804209 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:22:52.919750 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.919714 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-service-ca\") pod \"5a7d903a-eed6-4080-8fbe-37160f8284c0\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " Jul 09 11:22:52.919947 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.919765 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q889f\" (UniqueName: \"kubernetes.io/projected/5a7d903a-eed6-4080-8fbe-37160f8284c0-kube-api-access-q889f\") pod \"5a7d903a-eed6-4080-8fbe-37160f8284c0\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " Jul 09 11:22:52.919947 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.919788 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-serving-cert\") pod \"5a7d903a-eed6-4080-8fbe-37160f8284c0\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " Jul 09 11:22:52.919947 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.919813 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-trusted-ca-bundle\") pod \"5a7d903a-eed6-4080-8fbe-37160f8284c0\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " Jul 09 11:22:52.919947 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.919889 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-config\") pod \"5a7d903a-eed6-4080-8fbe-37160f8284c0\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " Jul 09 11:22:52.919947 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.919903 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-oauth-config\") pod \"5a7d903a-eed6-4080-8fbe-37160f8284c0\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " Jul 09 11:22:52.919947 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.919932 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-oauth-serving-cert\") pod \"5a7d903a-eed6-4080-8fbe-37160f8284c0\" (UID: \"5a7d903a-eed6-4080-8fbe-37160f8284c0\") " Jul 09 11:22:52.920322 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.920247 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "5a7d903a-eed6-4080-8fbe-37160f8284c0" (UID: "5a7d903a-eed6-4080-8fbe-37160f8284c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:22:52.920452 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.920416 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-config" (OuterVolumeSpecName: "console-config") pod "5a7d903a-eed6-4080-8fbe-37160f8284c0" (UID: "5a7d903a-eed6-4080-8fbe-37160f8284c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:22:52.920586 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.920550 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5a7d903a-eed6-4080-8fbe-37160f8284c0" (UID: "5a7d903a-eed6-4080-8fbe-37160f8284c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:22:52.920586 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.920567 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5a7d903a-eed6-4080-8fbe-37160f8284c0" (UID: "5a7d903a-eed6-4080-8fbe-37160f8284c0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 11:22:52.922100 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.922076 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5a7d903a-eed6-4080-8fbe-37160f8284c0" (UID: "5a7d903a-eed6-4080-8fbe-37160f8284c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:22:52.922186 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.922121 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5a7d903a-eed6-4080-8fbe-37160f8284c0" (UID: "5a7d903a-eed6-4080-8fbe-37160f8284c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 11:22:52.922186 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:52.922174 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a7d903a-eed6-4080-8fbe-37160f8284c0-kube-api-access-q889f" (OuterVolumeSpecName: "kube-api-access-q889f") pod "5a7d903a-eed6-4080-8fbe-37160f8284c0" (UID: "5a7d903a-eed6-4080-8fbe-37160f8284c0"). InnerVolumeSpecName "kube-api-access-q889f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:22:53.021256 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.021221 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-config\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:53.021256 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.021250 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-oauth-config\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:53.021256 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.021262 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-oauth-serving-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:53.021526 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.021273 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-service-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:53.021526 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.021297 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q889f\" (UniqueName: \"kubernetes.io/projected/5a7d903a-eed6-4080-8fbe-37160f8284c0-kube-api-access-q889f\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:53.021526 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.021306 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a7d903a-eed6-4080-8fbe-37160f8284c0-console-serving-cert\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:53.021526 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.021315 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7d903a-eed6-4080-8fbe-37160f8284c0-trusted-ca-bundle\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:22:53.617299 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.617255 2562 generic.go:356] "Generic (PLEG): container finished" podID="5a7d903a-eed6-4080-8fbe-37160f8284c0" containerID="a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0" exitCode=0 Jul 09 11:22:53.617733 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.617317 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7979f66cc7-xjh5m" Jul 09 11:22:53.617733 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.617321 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7979f66cc7-xjh5m" event={"ID":"5a7d903a-eed6-4080-8fbe-37160f8284c0","Type":"ContainerDied","Data":"a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0"} Jul 09 11:22:53.617733 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.617429 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7979f66cc7-xjh5m" event={"ID":"5a7d903a-eed6-4080-8fbe-37160f8284c0","Type":"ContainerDied","Data":"799071777f27b25461ff8aab668f1d73ab5aca6cd2673e189103e2e9646a171f"} Jul 09 11:22:53.617733 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.617449 2562 scope.go:117] "RemoveContainer" containerID="a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0" Jul 09 11:22:53.627750 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.627731 2562 scope.go:117] "RemoveContainer" containerID="a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0" Jul 09 11:22:53.628013 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:22:53.627995 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0\": container with ID starting with a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0 not found: ID does not exist" containerID="a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0" Jul 09 11:22:53.628064 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.628023 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0"} err="failed to get container status \"a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0\": rpc error: code = NotFound desc = could not find container \"a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0\": container with ID starting with a657137032575c193ffa7be4f67e975ca4f6fff50cedff16461ec059e32a9ae0 not found: ID does not exist" Jul 09 11:22:53.643273 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.643243 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7979f66cc7-xjh5m"] Jul 09 11:22:53.649864 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:53.649834 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7979f66cc7-xjh5m"] Jul 09 11:22:54.611579 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:22:54.611550 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a7d903a-eed6-4080-8fbe-37160f8284c0" path="/var/lib/kubelet/pods/5a7d903a-eed6-4080-8fbe-37160f8284c0/volumes" Jul 09 11:23:02.917007 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:02.916975 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq"] Jul 09 11:23:02.917481 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:02.917453 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a7d903a-eed6-4080-8fbe-37160f8284c0" containerName="console" Jul 09 11:23:02.917481 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:02.917467 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a7d903a-eed6-4080-8fbe-37160f8284c0" containerName="console" Jul 09 11:23:02.917481 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:02.917483 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741b9be2-5e53-404a-a817-de935d1acef5" containerName="manager" Jul 09 11:23:02.917590 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:02.917488 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="741b9be2-5e53-404a-a817-de935d1acef5" containerName="manager" Jul 09 11:23:02.917590 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:02.917568 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a7d903a-eed6-4080-8fbe-37160f8284c0" containerName="console" Jul 09 11:23:02.917590 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:02.917576 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="741b9be2-5e53-404a-a817-de935d1acef5" containerName="manager" Jul 09 11:23:02.920697 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:02.920676 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:02.923502 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:02.923478 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q6l6v\"" Jul 09 11:23:02.938512 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:02.938477 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq"] Jul 09 11:23:03.005435 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.005393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.005606 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.005448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.005606 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.005585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.005713 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.005621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz5xp\" (UniqueName: \"kubernetes.io/projected/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-kube-api-access-wz5xp\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.005713 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.005640 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.005814 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.005745 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.005871 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.005826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.005871 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.005863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.005975 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.005956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107128 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107090 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107128 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz5xp\" (UniqueName: \"kubernetes.io/projected/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-kube-api-access-wz5xp\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107445 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107445 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107445 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107257 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107445 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107445 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107445 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107445 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107418 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107799 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107597 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107799 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107619 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.107992 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.107974 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.108077 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.108061 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.108337 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.108317 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.109729 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.109710 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.110003 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.109984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.115755 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.115732 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.115857 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.115799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz5xp\" (UniqueName: \"kubernetes.io/projected/bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac-kube-api-access-wz5xp\") pod \"maas-default-gateway-openshift-default-56654dcf7-vczpq\" (UID: \"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.239626 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.239536 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:03.386587 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.386559 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq"] Jul 09 11:23:03.388610 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:23:03.388581 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfbf92ee_3ce9_4e2b_aed2_5a065166c1ac.slice/crio-a9bbed2deed4c25951c5c7ce41dec432cbb8841e69ddf0fbd3b9087bcf6dbe6c WatchSource:0}: Error finding container a9bbed2deed4c25951c5c7ce41dec432cbb8841e69ddf0fbd3b9087bcf6dbe6c: Status 404 returned error can't find the container with id a9bbed2deed4c25951c5c7ce41dec432cbb8841e69ddf0fbd3b9087bcf6dbe6c Jul 09 11:23:03.390790 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.390757 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 11:23:03.390890 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.390838 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 11:23:03.390890 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.390883 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 11:23:03.678458 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.678408 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" event={"ID":"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac","Type":"ContainerStarted","Data":"8b4dfc97e99b912215ff2464a0316a1308f713c987755900f09be728985dd102"} Jul 09 11:23:03.678684 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.678485 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" event={"ID":"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac","Type":"ContainerStarted","Data":"a9bbed2deed4c25951c5c7ce41dec432cbb8841e69ddf0fbd3b9087bcf6dbe6c"} Jul 09 11:23:03.699184 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:03.699132 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" podStartSLOduration=1.699113626 podStartE2EDuration="1.699113626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:23:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:23:03.698398415 +0000 UTC m=+689.609242953" watchObservedRunningTime="2026-07-09 11:23:03.699113626 +0000 UTC m=+689.609958152" Jul 09 11:23:04.240100 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:04.240067 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:04.244853 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:04.244827 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:04.684429 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:04.684392 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:04.685368 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:04.685346 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:23:05.067191 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.067107 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:23:05.072097 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.072068 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" Jul 09 11:23:05.075148 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.075121 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 11:23:05.075412 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.075396 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t7dgp\"" Jul 09 11:23:05.084100 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.084077 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:23:05.100744 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.100717 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:23:05.129106 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.129075 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/810acab9-d2ea-4861-ad44-531413f9330b-config-file\") pod \"limitador-limitador-54d6d988d5-t9j9m\" (UID: \"810acab9-d2ea-4861-ad44-531413f9330b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" Jul 09 11:23:05.129314 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.129123 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xztvh\" (UniqueName: \"kubernetes.io/projected/810acab9-d2ea-4861-ad44-531413f9330b-kube-api-access-xztvh\") pod \"limitador-limitador-54d6d988d5-t9j9m\" (UID: \"810acab9-d2ea-4861-ad44-531413f9330b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" Jul 09 11:23:05.230330 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.230268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/810acab9-d2ea-4861-ad44-531413f9330b-config-file\") pod \"limitador-limitador-54d6d988d5-t9j9m\" (UID: \"810acab9-d2ea-4861-ad44-531413f9330b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" Jul 09 11:23:05.230528 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.230360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xztvh\" (UniqueName: \"kubernetes.io/projected/810acab9-d2ea-4861-ad44-531413f9330b-kube-api-access-xztvh\") pod \"limitador-limitador-54d6d988d5-t9j9m\" (UID: \"810acab9-d2ea-4861-ad44-531413f9330b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" Jul 09 11:23:05.230886 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.230866 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/810acab9-d2ea-4861-ad44-531413f9330b-config-file\") pod \"limitador-limitador-54d6d988d5-t9j9m\" (UID: \"810acab9-d2ea-4861-ad44-531413f9330b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" Jul 09 11:23:05.240359 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.240332 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xztvh\" (UniqueName: \"kubernetes.io/projected/810acab9-d2ea-4861-ad44-531413f9330b-kube-api-access-xztvh\") pod \"limitador-limitador-54d6d988d5-t9j9m\" (UID: \"810acab9-d2ea-4861-ad44-531413f9330b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" Jul 09 11:23:05.383919 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.383885 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" Jul 09 11:23:05.520985 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.520957 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:23:05.523220 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:23:05.523193 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810acab9_d2ea_4861_ad44_531413f9330b.slice/crio-2a58c91e22b24f2cf3379bd22e987b12d47766a5a2339f398677b84aeb8e3a69 WatchSource:0}: Error finding container 2a58c91e22b24f2cf3379bd22e987b12d47766a5a2339f398677b84aeb8e3a69: Status 404 returned error can't find the container with id 2a58c91e22b24f2cf3379bd22e987b12d47766a5a2339f398677b84aeb8e3a69 Jul 09 11:23:05.664270 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.664191 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-w872k"] Jul 09 11:23:05.669001 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.668983 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w872k" Jul 09 11:23:05.671750 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.671730 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6nmlc\"" Jul 09 11:23:05.675452 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.675430 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w872k"] Jul 09 11:23:05.692376 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.692348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" event={"ID":"810acab9-d2ea-4861-ad44-531413f9330b","Type":"ContainerStarted","Data":"2a58c91e22b24f2cf3379bd22e987b12d47766a5a2339f398677b84aeb8e3a69"} Jul 09 11:23:05.735385 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.735346 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcr7v\" (UniqueName: \"kubernetes.io/projected/03a43c08-9609-4039-ac56-6acbe2271857-kube-api-access-fcr7v\") pod \"authorino-75d556bd77-w872k\" (UID: \"03a43c08-9609-4039-ac56-6acbe2271857\") " pod="kuadrant-system/authorino-75d556bd77-w872k" Jul 09 11:23:05.836243 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.836207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcr7v\" (UniqueName: \"kubernetes.io/projected/03a43c08-9609-4039-ac56-6acbe2271857-kube-api-access-fcr7v\") pod \"authorino-75d556bd77-w872k\" (UID: \"03a43c08-9609-4039-ac56-6acbe2271857\") " pod="kuadrant-system/authorino-75d556bd77-w872k" Jul 09 11:23:05.845382 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.845354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcr7v\" (UniqueName: \"kubernetes.io/projected/03a43c08-9609-4039-ac56-6acbe2271857-kube-api-access-fcr7v\") pod \"authorino-75d556bd77-w872k\" (UID: \"03a43c08-9609-4039-ac56-6acbe2271857\") " pod="kuadrant-system/authorino-75d556bd77-w872k" Jul 09 11:23:05.979434 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:05.979348 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w872k" Jul 09 11:23:06.166474 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:06.166441 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w872k"] Jul 09 11:23:06.168065 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:23:06.168035 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03a43c08_9609_4039_ac56_6acbe2271857.slice/crio-0ab738e2f47538d51304ff8fe1ebd82ca8c70674d08733bbe75b30efc95d8990 WatchSource:0}: Error finding container 0ab738e2f47538d51304ff8fe1ebd82ca8c70674d08733bbe75b30efc95d8990: Status 404 returned error can't find the container with id 0ab738e2f47538d51304ff8fe1ebd82ca8c70674d08733bbe75b30efc95d8990 Jul 09 11:23:06.702692 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:06.702648 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w872k" event={"ID":"03a43c08-9609-4039-ac56-6acbe2271857","Type":"ContainerStarted","Data":"0ab738e2f47538d51304ff8fe1ebd82ca8c70674d08733bbe75b30efc95d8990"} Jul 09 11:23:10.732547 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:10.732509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w872k" event={"ID":"03a43c08-9609-4039-ac56-6acbe2271857","Type":"ContainerStarted","Data":"e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e"} Jul 09 11:23:10.734107 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:10.734083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" event={"ID":"810acab9-d2ea-4861-ad44-531413f9330b","Type":"ContainerStarted","Data":"6c0d86560fc57e45c1c0a44060b87c7ec1edc8c5bcb66deff794bb887ed9c3b5"} Jul 09 11:23:10.734249 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:10.734139 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" Jul 09 11:23:10.756804 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:10.756760 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-w872k" podStartSLOduration=1.9453802100000002 podStartE2EDuration="5.756746018s" totalImagesPullingTime="3.811365808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:23:10.755408201 +0000 UTC m=+696.666252724" watchObservedRunningTime="2026-07-09 11:23:10.756746018 +0000 UTC m=+696.667590543" Jul 09 11:23:10.775933 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:10.775880 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" podStartSLOduration=1.367731364 podStartE2EDuration="5.77586491s" totalImagesPullingTime="4.408133546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:23:10.773362715 +0000 UTC m=+696.684207233" watchObservedRunningTime="2026-07-09 11:23:10.77586491 +0000 UTC m=+696.686709436" Jul 09 11:23:21.740509 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:21.740478 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9j9m" Jul 09 11:23:41.081792 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.081757 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w872k"] Jul 09 11:23:41.082248 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.081945 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-w872k" podUID="03a43c08-9609-4039-ac56-6acbe2271857" containerName="authorino" containerID="cri-o://e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e" gracePeriod=30 Jul 09 11:23:41.338276 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.338216 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w872k" Jul 09 11:23:41.366396 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.366370 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcr7v\" (UniqueName: \"kubernetes.io/projected/03a43c08-9609-4039-ac56-6acbe2271857-kube-api-access-fcr7v\") pod \"03a43c08-9609-4039-ac56-6acbe2271857\" (UID: \"03a43c08-9609-4039-ac56-6acbe2271857\") " Jul 09 11:23:41.368762 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.368722 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a43c08-9609-4039-ac56-6acbe2271857-kube-api-access-fcr7v" (OuterVolumeSpecName: "kube-api-access-fcr7v") pod "03a43c08-9609-4039-ac56-6acbe2271857" (UID: "03a43c08-9609-4039-ac56-6acbe2271857"). InnerVolumeSpecName "kube-api-access-fcr7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:23:41.467136 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.467105 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcr7v\" (UniqueName: \"kubernetes.io/projected/03a43c08-9609-4039-ac56-6acbe2271857-kube-api-access-fcr7v\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:23:41.912456 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.912421 2562 generic.go:356] "Generic (PLEG): container finished" podID="03a43c08-9609-4039-ac56-6acbe2271857" containerID="e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e" exitCode=0 Jul 09 11:23:41.912646 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.912465 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w872k" Jul 09 11:23:41.912646 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.912510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w872k" event={"ID":"03a43c08-9609-4039-ac56-6acbe2271857","Type":"ContainerDied","Data":"e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e"} Jul 09 11:23:41.912646 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.912555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w872k" event={"ID":"03a43c08-9609-4039-ac56-6acbe2271857","Type":"ContainerDied","Data":"0ab738e2f47538d51304ff8fe1ebd82ca8c70674d08733bbe75b30efc95d8990"} Jul 09 11:23:41.912646 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.912574 2562 scope.go:117] "RemoveContainer" containerID="e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e" Jul 09 11:23:41.922593 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.922571 2562 scope.go:117] "RemoveContainer" containerID="e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e" Jul 09 11:23:41.922844 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:23:41.922823 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e\": container with ID starting with e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e not found: ID does not exist" containerID="e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e" Jul 09 11:23:41.922920 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.922857 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e"} err="failed to get container status \"e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e\": rpc error: code = NotFound desc = could not find container \"e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e\": container with ID starting with e6d18297c23f244db3ebf898c79fee83ddd89d278b892f8c8160f18bb9d2c23e not found: ID does not exist" Jul 09 11:23:41.964218 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.964188 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w872k"] Jul 09 11:23:41.966399 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:41.966380 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w872k"] Jul 09 11:23:42.612747 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:23:42.612714 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a43c08-9609-4039-ac56-6acbe2271857" path="/var/lib/kubelet/pods/03a43c08-9609-4039-ac56-6acbe2271857/volumes" Jul 09 11:24:22.245029 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:22.244994 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:24:30.196353 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:30.196320 2562 generic.go:356] "Generic (PLEG): container finished" podID="bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac" containerID="8b4dfc97e99b912215ff2464a0316a1308f713c987755900f09be728985dd102" exitCode=0 Jul 09 11:24:30.196783 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:30.196389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" event={"ID":"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac","Type":"ContainerDied","Data":"8b4dfc97e99b912215ff2464a0316a1308f713c987755900f09be728985dd102"} Jul 09 11:24:30.196834 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:30.196816 2562 scope.go:117] "RemoveContainer" containerID="8b4dfc97e99b912215ff2464a0316a1308f713c987755900f09be728985dd102" Jul 09 11:24:30.197859 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:30.197826 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 11:24:30.197959 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:30.197913 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 11:24:30.198023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:30.197960 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 11:24:31.203619 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:31.203585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" event={"ID":"bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac","Type":"ContainerStarted","Data":"e248d3dd7145b444a34e186734eeab7ae32d9f29206d588d2f5e9e77b58cb7f8"} Jul 09 11:24:31.240651 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:31.240621 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:24:31.241682 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:31.241648 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vczpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 09 11:24:31.241795 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:31.241707 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" podUID="bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 09 11:24:32.240850 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:32.240814 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vczpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 09 11:24:32.241346 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:32.240888 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" podUID="bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 09 11:24:33.240540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:33.240509 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vczpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 09 11:24:33.240721 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:33.240563 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" podUID="bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 09 11:24:34.240589 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:34.240550 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vczpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 09 11:24:34.241054 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:34.240615 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" podUID="bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 09 11:24:34.689497 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:34.689426 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:24:35.240338 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:35.240305 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vczpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 09 11:24:35.240550 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:35.240412 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" podUID="bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 09 11:24:36.244983 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:36.244948 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:24:36.246148 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:36.246126 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vczpq" Jul 09 11:24:36.443075 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:36.443041 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:24:42.665225 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:42.665188 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:24:54.150394 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.150359 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt"] Jul 09 11:24:54.151112 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.151092 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a43c08-9609-4039-ac56-6acbe2271857" containerName="authorino" Jul 09 11:24:54.151188 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.151116 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a43c08-9609-4039-ac56-6acbe2271857" containerName="authorino" Jul 09 11:24:54.151262 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.151248 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a43c08-9609-4039-ac56-6acbe2271857" containerName="authorino" Jul 09 11:24:54.154716 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.154699 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.159101 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.159075 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 11:24:54.159227 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.159075 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 11:24:54.159227 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.159081 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 11:24:54.159227 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.159114 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t79pf\"" Jul 09 11:24:54.163753 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.163731 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt"] Jul 09 11:24:54.282508 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.282467 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.282681 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.282553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpjwr\" (UniqueName: \"kubernetes.io/projected/26158c0d-518e-4c19-8309-2099d81a7ebb-kube-api-access-mpjwr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.282681 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.282601 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26158c0d-518e-4c19-8309-2099d81a7ebb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.282681 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.282662 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.282793 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.282708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.282793 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.282746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.383680 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.383642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26158c0d-518e-4c19-8309-2099d81a7ebb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.383680 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.383681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.383955 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.383703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.383955 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.383730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.383955 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.383819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.383955 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.383867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpjwr\" (UniqueName: \"kubernetes.io/projected/26158c0d-518e-4c19-8309-2099d81a7ebb-kube-api-access-mpjwr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.384205 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.384180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.384312 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.384277 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.384384 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.384316 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.386140 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.386111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26158c0d-518e-4c19-8309-2099d81a7ebb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.386334 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.386319 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26158c0d-518e-4c19-8309-2099d81a7ebb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.392420 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.392396 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpjwr\" (UniqueName: \"kubernetes.io/projected/26158c0d-518e-4c19-8309-2099d81a7ebb-kube-api-access-mpjwr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nz9kt\" (UID: \"26158c0d-518e-4c19-8309-2099d81a7ebb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.467317 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.467217 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:24:54.613123 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:54.613095 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt"] Jul 09 11:24:54.613491 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:24:54.613470 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26158c0d_518e_4c19_8309_2099d81a7ebb.slice/crio-8dea1d234a00e8bfdde677c6b73074ab860a593e1122bed738c7b7df7e5f6d2e WatchSource:0}: Error finding container 8dea1d234a00e8bfdde677c6b73074ab860a593e1122bed738c7b7df7e5f6d2e: Status 404 returned error can't find the container with id 8dea1d234a00e8bfdde677c6b73074ab860a593e1122bed738c7b7df7e5f6d2e Jul 09 11:24:55.344375 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:55.344293 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" event={"ID":"26158c0d-518e-4c19-8309-2099d81a7ebb","Type":"ContainerStarted","Data":"8dea1d234a00e8bfdde677c6b73074ab860a593e1122bed738c7b7df7e5f6d2e"} Jul 09 11:24:55.538969 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:55.538934 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:24:56.351884 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:56.351850 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" event={"ID":"26158c0d-518e-4c19-8309-2099d81a7ebb","Type":"ContainerStarted","Data":"0b869b24965dc4081802e740f6b4ccb57027e48365c9ea8bfc257eec398f3981"} Jul 09 11:24:56.371420 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:24:56.371373 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" podStartSLOduration=1.324767579 podStartE2EDuration="2.37135779s" totalImagesPullingTime="1.046590211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:24:56.370315792 +0000 UTC m=+802.281160316" watchObservedRunningTime="2026-07-09 11:24:56.37135779 +0000 UTC m=+802.282202316" Jul 09 11:25:04.467789 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:25:04.467753 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:25:04.468205 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:25:04.467864 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:25:04.480734 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:25:04.480705 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:25:05.414997 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:25:05.414958 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nz9kt" Jul 09 11:25:06.840443 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:25:06.840405 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:25:15.139784 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:25:15.139749 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:25:35.241996 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:25:35.241960 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:26:30.930430 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:30.930336 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-844b64bb5f-wv7j7"] Jul 09 11:26:30.934241 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:30.934224 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-844b64bb5f-wv7j7" Jul 09 11:26:30.938228 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:30.938204 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 09 11:26:30.938228 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:30.938222 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6nmlc\"" Jul 09 11:26:30.943487 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:30.943463 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-844b64bb5f-wv7j7"] Jul 09 11:26:31.006418 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:31.006394 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bba5b764-2a4a-403b-8f7b-a5413a0bd076-tls-cert\") pod \"authorino-844b64bb5f-wv7j7\" (UID: \"bba5b764-2a4a-403b-8f7b-a5413a0bd076\") " pod="kuadrant-system/authorino-844b64bb5f-wv7j7" Jul 09 11:26:31.006539 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:31.006427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxbw7\" (UniqueName: \"kubernetes.io/projected/bba5b764-2a4a-403b-8f7b-a5413a0bd076-kube-api-access-zxbw7\") pod \"authorino-844b64bb5f-wv7j7\" (UID: \"bba5b764-2a4a-403b-8f7b-a5413a0bd076\") " pod="kuadrant-system/authorino-844b64bb5f-wv7j7" Jul 09 11:26:31.107488 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:31.107449 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bba5b764-2a4a-403b-8f7b-a5413a0bd076-tls-cert\") pod \"authorino-844b64bb5f-wv7j7\" (UID: \"bba5b764-2a4a-403b-8f7b-a5413a0bd076\") " pod="kuadrant-system/authorino-844b64bb5f-wv7j7" Jul 09 11:26:31.107696 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:31.107499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxbw7\" (UniqueName: \"kubernetes.io/projected/bba5b764-2a4a-403b-8f7b-a5413a0bd076-kube-api-access-zxbw7\") pod \"authorino-844b64bb5f-wv7j7\" (UID: \"bba5b764-2a4a-403b-8f7b-a5413a0bd076\") " pod="kuadrant-system/authorino-844b64bb5f-wv7j7" Jul 09 11:26:31.109971 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:31.109941 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bba5b764-2a4a-403b-8f7b-a5413a0bd076-tls-cert\") pod \"authorino-844b64bb5f-wv7j7\" (UID: \"bba5b764-2a4a-403b-8f7b-a5413a0bd076\") " pod="kuadrant-system/authorino-844b64bb5f-wv7j7" Jul 09 11:26:31.115723 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:31.115700 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxbw7\" (UniqueName: \"kubernetes.io/projected/bba5b764-2a4a-403b-8f7b-a5413a0bd076-kube-api-access-zxbw7\") pod \"authorino-844b64bb5f-wv7j7\" (UID: \"bba5b764-2a4a-403b-8f7b-a5413a0bd076\") " pod="kuadrant-system/authorino-844b64bb5f-wv7j7" Jul 09 11:26:31.266562 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:31.266470 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-844b64bb5f-wv7j7" Jul 09 11:26:31.406799 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:31.406775 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-844b64bb5f-wv7j7"] Jul 09 11:26:31.408068 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:26:31.408036 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbba5b764_2a4a_403b_8f7b_a5413a0bd076.slice/crio-faef7d476f08ed22fb1a23761fc8651bf89591b6ab4889c015120c26cbd2a118 WatchSource:0}: Error finding container faef7d476f08ed22fb1a23761fc8651bf89591b6ab4889c015120c26cbd2a118: Status 404 returned error can't find the container with id faef7d476f08ed22fb1a23761fc8651bf89591b6ab4889c015120c26cbd2a118 Jul 09 11:26:31.898425 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:31.898383 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-844b64bb5f-wv7j7" event={"ID":"bba5b764-2a4a-403b-8f7b-a5413a0bd076","Type":"ContainerStarted","Data":"faef7d476f08ed22fb1a23761fc8651bf89591b6ab4889c015120c26cbd2a118"} Jul 09 11:26:32.905936 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:32.905899 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-844b64bb5f-wv7j7" event={"ID":"bba5b764-2a4a-403b-8f7b-a5413a0bd076","Type":"ContainerStarted","Data":"f7674d22811786fdb8fd37f8befdc3434c93a7897c1ae5cd360cd66608cca072"} Jul 09 11:26:32.927620 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:32.927555 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-844b64bb5f-wv7j7" podStartSLOduration=2.347269532 podStartE2EDuration="2.927533602s" totalImagesPullingTime="580.26407ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:26:32.923526787 +0000 UTC m=+898.834371314" watchObservedRunningTime="2026-07-09 11:26:32.927533602 +0000 UTC m=+898.838378132" Jul 09 11:26:34.591205 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:34.591173 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:26:34.592068 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:34.592044 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:26:34.599458 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:34.599435 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:26:34.600132 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:26:34.600114 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:27:00.244024 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:27:00.243974 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:27:11.938133 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:27:11.938096 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:27:21.637266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:27:21.637234 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:27:30.356869 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:27:30.356834 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:27:41.369733 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:27:41.369697 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:28:06.539664 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:28:06.539634 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:28:18.435615 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:28:18.435578 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:28:55.458021 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:28:55.457981 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:29:05.039268 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:29:05.039228 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:29:15.760742 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:29:15.760706 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:29:24.839579 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:29:24.839543 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:29:36.748343 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:29:36.748301 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:29:46.944033 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:29:46.944000 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:29:59.045115 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:29:59.045078 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:30:08.542311 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:30:08.542263 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:30:30.932049 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:30:30.932017 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:30:41.637120 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:30:41.637088 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:31:06.638423 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:31:06.638385 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:31:20.456148 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:31:20.456111 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:31:32.545370 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:31:32.545330 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:31:34.651416 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:31:34.651381 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:31:34.652685 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:31:34.652662 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:31:34.660044 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:31:34.660022 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:31:34.661757 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:31:34.661738 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:31:42.334952 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:31:42.334915 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:31:52.137306 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:31:52.137234 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:32:04.732274 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:04.732225 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:32:35.400944 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:35.400844 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4"] Jul 09 11:32:35.401593 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:35.401072 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" podUID="ef3d52bc-0228-4674-8b81-dcfca48bb983" containerName="manager" containerID="cri-o://050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9" gracePeriod=10 Jul 09 11:32:38.562345 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:38.562319 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:32:38.629960 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:38.629883 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef3d52bc-0228-4674-8b81-dcfca48bb983-extensions-socket-volume\") pod \"ef3d52bc-0228-4674-8b81-dcfca48bb983\" (UID: \"ef3d52bc-0228-4674-8b81-dcfca48bb983\") " Jul 09 11:32:38.629960 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:38.629940 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9jlk\" (UniqueName: \"kubernetes.io/projected/ef3d52bc-0228-4674-8b81-dcfca48bb983-kube-api-access-b9jlk\") pod \"ef3d52bc-0228-4674-8b81-dcfca48bb983\" (UID: \"ef3d52bc-0228-4674-8b81-dcfca48bb983\") " Jul 09 11:32:38.630262 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:38.630234 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef3d52bc-0228-4674-8b81-dcfca48bb983-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ef3d52bc-0228-4674-8b81-dcfca48bb983" (UID: "ef3d52bc-0228-4674-8b81-dcfca48bb983"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 11:32:38.632083 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:38.632054 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef3d52bc-0228-4674-8b81-dcfca48bb983-kube-api-access-b9jlk" (OuterVolumeSpecName: "kube-api-access-b9jlk") pod "ef3d52bc-0228-4674-8b81-dcfca48bb983" (UID: "ef3d52bc-0228-4674-8b81-dcfca48bb983"). InnerVolumeSpecName "kube-api-access-b9jlk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 11:32:38.731627 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:38.731589 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9jlk\" (UniqueName: \"kubernetes.io/projected/ef3d52bc-0228-4674-8b81-dcfca48bb983-kube-api-access-b9jlk\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:32:38.731627 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:38.731619 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef3d52bc-0228-4674-8b81-dcfca48bb983-extensions-socket-volume\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 09 11:32:39.075255 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:39.075161 2562 generic.go:356] "Generic (PLEG): container finished" podID="ef3d52bc-0228-4674-8b81-dcfca48bb983" containerID="050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9" exitCode=0 Jul 09 11:32:39.075255 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:39.075203 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" Jul 09 11:32:39.075483 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:39.075256 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" event={"ID":"ef3d52bc-0228-4674-8b81-dcfca48bb983","Type":"ContainerDied","Data":"050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9"} Jul 09 11:32:39.075483 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:39.075325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4" event={"ID":"ef3d52bc-0228-4674-8b81-dcfca48bb983","Type":"ContainerDied","Data":"f1e8f5cb81cab62d6cb361bb866c43a09694d8cb7caeb91b687fb2a79fa59d23"} Jul 09 11:32:39.075483 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:39.075351 2562 scope.go:117] "RemoveContainer" containerID="050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9" Jul 09 11:32:39.087937 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:39.087904 2562 scope.go:117] "RemoveContainer" containerID="050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9" Jul 09 11:32:39.088634 ip-10-0-131-226 kubenswrapper[2562]: E0709 11:32:39.088612 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9\": container with ID starting with 050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9 not found: ID does not exist" containerID="050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9" Jul 09 11:32:39.088730 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:39.088638 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9"} err="failed to get container status \"050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9\": rpc error: code = NotFound desc = could not find container \"050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9\": container with ID starting with 050a8ac76b03daff286eb7af31e707662424016bf575c012433abe70066686c9 not found: ID does not exist" Jul 09 11:32:39.099186 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:39.099163 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4"] Jul 09 11:32:39.103019 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:39.102994 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pmj4"] Jul 09 11:32:40.612941 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:32:40.612905 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef3d52bc-0228-4674-8b81-dcfca48bb983" path="/var/lib/kubelet/pods/ef3d52bc-0228-4674-8b81-dcfca48bb983/volumes" Jul 09 11:33:36.543013 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.542977 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw"] Jul 09 11:33:36.543692 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.543671 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef3d52bc-0228-4674-8b81-dcfca48bb983" containerName="manager" Jul 09 11:33:36.543780 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.543695 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef3d52bc-0228-4674-8b81-dcfca48bb983" containerName="manager" Jul 09 11:33:36.543836 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.543812 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef3d52bc-0228-4674-8b81-dcfca48bb983" containerName="manager" Jul 09 11:33:36.548125 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.548106 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" Jul 09 11:33:36.550861 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.550839 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qt6jx\"" Jul 09 11:33:36.560419 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.560397 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw"] Jul 09 11:33:36.687997 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.687952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh4t7\" (UniqueName: \"kubernetes.io/projected/f8441443-5103-435c-bbd2-959f69132de1-kube-api-access-sh4t7\") pod \"kuadrant-operator-controller-manager-86878c769f-7s6cw\" (UID: \"f8441443-5103-435c-bbd2-959f69132de1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" Jul 09 11:33:36.688201 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.688078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8441443-5103-435c-bbd2-959f69132de1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7s6cw\" (UID: \"f8441443-5103-435c-bbd2-959f69132de1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" Jul 09 11:33:36.789495 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.789451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8441443-5103-435c-bbd2-959f69132de1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7s6cw\" (UID: \"f8441443-5103-435c-bbd2-959f69132de1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" Jul 09 11:33:36.789680 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.789516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh4t7\" (UniqueName: \"kubernetes.io/projected/f8441443-5103-435c-bbd2-959f69132de1-kube-api-access-sh4t7\") pod \"kuadrant-operator-controller-manager-86878c769f-7s6cw\" (UID: \"f8441443-5103-435c-bbd2-959f69132de1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" Jul 09 11:33:36.789977 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.789955 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8441443-5103-435c-bbd2-959f69132de1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7s6cw\" (UID: \"f8441443-5103-435c-bbd2-959f69132de1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" Jul 09 11:33:36.797979 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.797912 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh4t7\" (UniqueName: \"kubernetes.io/projected/f8441443-5103-435c-bbd2-959f69132de1-kube-api-access-sh4t7\") pod \"kuadrant-operator-controller-manager-86878c769f-7s6cw\" (UID: \"f8441443-5103-435c-bbd2-959f69132de1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" Jul 09 11:33:36.858167 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:36.858120 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" Jul 09 11:33:37.007060 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:37.007020 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw"] Jul 09 11:33:37.007412 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:33:37.007385 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8441443_5103_435c_bbd2_959f69132de1.slice/crio-92836d1e5e99e96c31bc1ed07363e3bc1245041a6cb2e1c23e1dfbf5545c78b6 WatchSource:0}: Error finding container 92836d1e5e99e96c31bc1ed07363e3bc1245041a6cb2e1c23e1dfbf5545c78b6: Status 404 returned error can't find the container with id 92836d1e5e99e96c31bc1ed07363e3bc1245041a6cb2e1c23e1dfbf5545c78b6 Jul 09 11:33:37.406561 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:37.406524 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" event={"ID":"f8441443-5103-435c-bbd2-959f69132de1","Type":"ContainerStarted","Data":"666944f5103ff96521f286a81fad39f9c6e7ec6b9f001a7f91fd500bd893898d"} Jul 09 11:33:37.406760 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:37.406585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" event={"ID":"f8441443-5103-435c-bbd2-959f69132de1","Type":"ContainerStarted","Data":"92836d1e5e99e96c31bc1ed07363e3bc1245041a6cb2e1c23e1dfbf5545c78b6"} Jul 09 11:33:37.406760 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:37.406685 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" Jul 09 11:33:37.427537 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:37.427489 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" podStartSLOduration=1.427474921 podStartE2EDuration="1.427474921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:33:37.424783636 +0000 UTC m=+1323.335628164" watchObservedRunningTime="2026-07-09 11:33:37.427474921 +0000 UTC m=+1323.338319446" Jul 09 11:33:48.415963 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:48.415928 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7s6cw" Jul 09 11:33:57.343025 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:33:57.342938 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:34:06.538239 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:34:06.538190 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:34:19.832038 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:34:19.832001 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:34:31.429372 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:34:31.429330 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:34:43.735033 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:34:43.734997 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:34:52.933327 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:34:52.933291 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:35:02.345440 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:35:02.345399 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:35:13.230827 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:35:13.230789 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:35:24.433677 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:35:24.433634 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:35:32.435265 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:35:32.435171 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:35:43.226403 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:35:43.226370 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:36:07.836493 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:36:07.836457 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:36:15.354090 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:36:15.354056 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:36:25.944937 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:36:25.944908 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:36:34.697918 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:36:34.697888 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:36:34.698369 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:36:34.698347 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:36:34.705557 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:36:34.705533 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:36:34.706178 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:36:34.706162 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:36:35.544260 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:36:35.544224 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:36:42.270221 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:36:42.270187 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:36:59.394029 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:36:59.393934 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:37:15.172021 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:37:15.171983 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:37:24.324088 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:37:24.324052 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:37:37.479823 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:37:37.479790 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:37:46.970472 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:37:46.970435 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:38:00.047094 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:38:00.047059 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:38:09.361765 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:38:09.361729 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:38:19.038536 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:38:19.038499 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:38:30.738202 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:38:30.738122 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:38:42.537729 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:38:42.537692 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:38:51.341424 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:38:51.341386 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:39:02.849936 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:39:02.849903 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:39:14.845431 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:39:14.845394 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:39:27.341104 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:39:27.341066 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:39:56.636404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:39:56.636368 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:40:07.656951 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:40:07.656916 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:40:16.837495 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:40:16.837447 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:40:27.639415 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:40:27.639382 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:41:34.751273 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:41:34.751243 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:41:34.755260 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:41:34.755235 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:41:34.758968 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:41:34.758944 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:41:34.763023 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:41:34.763006 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:41:46.544033 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:41:46.543993 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:41:54.467127 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:41:54.467088 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:42:03.232670 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:42:03.232632 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:42:12.937260 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:42:12.937226 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:42:20.640540 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:42:20.640500 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:42:53.536660 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:42:53.536622 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:43:02.437670 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:43:02.437576 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:43:28.153122 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:43:28.153085 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:43:38.844002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:43:38.843964 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:43:48.834802 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:43:48.834764 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:44:24.943439 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:44:24.943393 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:44:39.445744 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:44:39.445710 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:44:47.274430 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:44:47.274391 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:45:35.246709 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:45:35.246672 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:45:46.537932 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:45:46.537893 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:45:59.341214 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:45:59.341126 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:46:21.339131 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:46:21.339090 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:46:34.801253 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:46:34.801226 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:46:34.804313 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:46:34.804269 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:46:34.808852 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:46:34.808834 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:46:34.812404 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:46:34.812387 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:46:53.642029 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:46:53.641996 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:47:06.636537 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:47:06.636502 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:47:37.342658 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:47:37.342576 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:47:51.344158 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:47:51.344115 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:48:08.648497 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:48:08.648465 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:48:21.561416 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:48:21.561383 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:48:31.846347 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:48:31.846307 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:48:41.044247 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:48:41.044206 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:51:34.839891 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:51:34.839855 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:51:34.846374 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:51:34.846346 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:51:34.847644 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:51:34.847623 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:51:34.857010 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:51:34.856979 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f672m_e9af17ff-b25e-4c3b-b943-b44ad500bf65/ovn-acl-logging/0.log" Jul 09 11:51:44.033628 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:51:44.033592 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:51:54.761053 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:51:54.761021 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-844b64bb5f-wv7j7_bba5b764-2a4a-403b-8f7b-a5413a0bd076/authorino/0.log" Jul 09 11:51:56.247481 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:51:56.247396 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9j9m"] Jul 09 11:51:59.669380 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:51:59.669325 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-t9z4x_d30530dc-4c11-4edf-9490-2eb5b58cc145/manager/0.log" Jul 09 11:51:59.793465 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:51:59.793437 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7s5jh_6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b/manager/0.log" Jul 09 11:52:00.040475 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:00.040402 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-w9nj5_5fb77719-e64a-48ab-97bb-b90c1f897101/server/0.log" Jul 09 11:52:00.173738 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:00.173708 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wb2nj_09e8aa95-9326-470a-89e0-d0b5b37ab1b8/manager/0.log" Jul 09 11:52:00.563053 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:00.563025 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b4d55d4c-mhkpf_0a991007-3efa-45bb-8dbe-c2741e31d47b/copy-manifests/0.log" Jul 09 11:52:00.576377 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:00.576330 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b4d55d4c-mhkpf_0a991007-3efa-45bb-8dbe-c2741e31d47b/manager/0.log" Jul 09 11:52:01.396237 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.396211 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc_644b80ca-4889-498c-b4f7-e4ffdb8e8cce/util/0.log" Jul 09 11:52:01.402830 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.402806 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc_644b80ca-4889-498c-b4f7-e4ffdb8e8cce/pull/0.log" Jul 09 11:52:01.408845 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.408826 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc_644b80ca-4889-498c-b4f7-e4ffdb8e8cce/extract/0.log" Jul 09 11:52:01.526838 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.526806 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd_f1eaa168-abbb-4db8-9830-0d5a761c7465/util/0.log" Jul 09 11:52:01.533093 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.533071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd_f1eaa168-abbb-4db8-9830-0d5a761c7465/pull/0.log" Jul 09 11:52:01.539177 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.539158 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd_f1eaa168-abbb-4db8-9830-0d5a761c7465/extract/0.log" Jul 09 11:52:01.670778 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.670701 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr_50a5fad3-65b0-4029-a5a6-8c6fb3179ed5/util/0.log" Jul 09 11:52:01.676852 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.676827 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr_50a5fad3-65b0-4029-a5a6-8c6fb3179ed5/pull/0.log" Jul 09 11:52:01.683375 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.683351 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr_50a5fad3-65b0-4029-a5a6-8c6fb3179ed5/extract/0.log" Jul 09 11:52:01.800333 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.800302 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz_9cea9c5c-e721-475e-ba4c-a6756160fd37/util/0.log" Jul 09 11:52:01.806919 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.806898 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz_9cea9c5c-e721-475e-ba4c-a6756160fd37/pull/0.log" Jul 09 11:52:01.813060 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.813038 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz_9cea9c5c-e721-475e-ba4c-a6756160fd37/extract/0.log" Jul 09 11:52:01.937452 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:01.937368 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-844b64bb5f-wv7j7_bba5b764-2a4a-403b-8f7b-a5413a0bd076/authorino/0.log" Jul 09 11:52:02.070775 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:02.070743 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s6g8c_b4bc416d-f5b2-44ba-8693-34b01cbe711f/manager/0.log" Jul 09 11:52:02.438082 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:02.438050 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-q6kw5_4c147415-80fa-4cc7-b17a-097c543e26f1/registry-server/0.log" Jul 09 11:52:02.562411 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:02.562385 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7s6cw_f8441443-5103-435c-bbd2-959f69132de1/manager/0.log" Jul 09 11:52:02.680202 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:02.680168 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t9j9m_810acab9-d2ea-4861-ad44-531413f9330b/limitador/0.log" Jul 09 11:52:02.812183 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:02.812104 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bdgjb_487a2494-2d2b-4338-96ea-bc619d8b30b1/manager/0.log" Jul 09 11:52:03.178085 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:03.178050 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hmxrx_e48ac04e-fab5-4774-8b97-843aaf592827/istio-proxy/0.log" Jul 09 11:52:03.550135 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:03.550064 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6579588b8b-xts5c_e036c346-c78a-433b-96ff-df2ba44e6ffd/kube-auth-proxy/0.log" Jul 09 11:52:03.679528 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:03.679497 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vczpq_bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac/istio-proxy/1.log" Jul 09 11:52:04.038027 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:04.038001 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc99479f9-lmlq5_a06ae9b5-a700-4c5c-a1aa-dbb20e981958/router/0.log" Jul 09 11:52:04.640876 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:04.640846 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nz9kt_26158c0d-518e-4c19-8309-2099d81a7ebb/main/0.log" Jul 09 11:52:09.728102 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.728070 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8tktg/must-gather-mkt4k"] Jul 09 11:52:09.732002 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.731982 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8tktg/must-gather-mkt4k" Jul 09 11:52:09.735368 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.735344 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8tktg\"/\"openshift-service-ca.crt\"" Jul 09 11:52:09.735513 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.735378 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8tktg\"/\"default-dockercfg-rl825\"" Jul 09 11:52:09.736568 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.736549 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8tktg\"/\"kube-root-ca.crt\"" Jul 09 11:52:09.745484 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.745459 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8tktg/must-gather-mkt4k"] Jul 09 11:52:09.816269 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.816236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f4827630-6804-4aae-8107-7c4060713d62-must-gather-output\") pod \"must-gather-mkt4k\" (UID: \"f4827630-6804-4aae-8107-7c4060713d62\") " pod="openshift-must-gather-8tktg/must-gather-mkt4k" Jul 09 11:52:09.816466 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.816396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfwvv\" (UniqueName: \"kubernetes.io/projected/f4827630-6804-4aae-8107-7c4060713d62-kube-api-access-zfwvv\") pod \"must-gather-mkt4k\" (UID: \"f4827630-6804-4aae-8107-7c4060713d62\") " pod="openshift-must-gather-8tktg/must-gather-mkt4k" Jul 09 11:52:09.917228 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.917187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f4827630-6804-4aae-8107-7c4060713d62-must-gather-output\") pod \"must-gather-mkt4k\" (UID: \"f4827630-6804-4aae-8107-7c4060713d62\") " pod="openshift-must-gather-8tktg/must-gather-mkt4k" Jul 09 11:52:09.917419 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.917307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfwvv\" (UniqueName: \"kubernetes.io/projected/f4827630-6804-4aae-8107-7c4060713d62-kube-api-access-zfwvv\") pod \"must-gather-mkt4k\" (UID: \"f4827630-6804-4aae-8107-7c4060713d62\") " pod="openshift-must-gather-8tktg/must-gather-mkt4k" Jul 09 11:52:09.917593 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.917575 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f4827630-6804-4aae-8107-7c4060713d62-must-gather-output\") pod \"must-gather-mkt4k\" (UID: \"f4827630-6804-4aae-8107-7c4060713d62\") " pod="openshift-must-gather-8tktg/must-gather-mkt4k" Jul 09 11:52:09.938747 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:09.938716 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfwvv\" (UniqueName: \"kubernetes.io/projected/f4827630-6804-4aae-8107-7c4060713d62-kube-api-access-zfwvv\") pod \"must-gather-mkt4k\" (UID: \"f4827630-6804-4aae-8107-7c4060713d62\") " pod="openshift-must-gather-8tktg/must-gather-mkt4k" Jul 09 11:52:10.041462 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:10.041376 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8tktg/must-gather-mkt4k" Jul 09 11:52:10.187514 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:10.187485 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8tktg/must-gather-mkt4k"] Jul 09 11:52:10.188094 ip-10-0-131-226 kubenswrapper[2562]: W0709 11:52:10.188065 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4827630_6804_4aae_8107_7c4060713d62.slice/crio-31bcc873c4c3104e5607e8080d3da7a269cac844eb00ecb69396ceb727240c9c WatchSource:0}: Error finding container 31bcc873c4c3104e5607e8080d3da7a269cac844eb00ecb69396ceb727240c9c: Status 404 returned error can't find the container with id 31bcc873c4c3104e5607e8080d3da7a269cac844eb00ecb69396ceb727240c9c Jul 09 11:52:10.190097 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:10.190082 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 11:52:10.870760 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:10.870727 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8tktg/must-gather-mkt4k" event={"ID":"f4827630-6804-4aae-8107-7c4060713d62","Type":"ContainerStarted","Data":"31bcc873c4c3104e5607e8080d3da7a269cac844eb00ecb69396ceb727240c9c"} Jul 09 11:52:11.881702 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:11.881650 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8tktg/must-gather-mkt4k" event={"ID":"f4827630-6804-4aae-8107-7c4060713d62","Type":"ContainerStarted","Data":"8702ccf844a7b7eb4e29b5514476731092fd51a80ee627c802e15eba897cdeff"} Jul 09 11:52:11.882327 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:11.882255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8tktg/must-gather-mkt4k" event={"ID":"f4827630-6804-4aae-8107-7c4060713d62","Type":"ContainerStarted","Data":"e7dbe405a7653174d99a77145766f7879d16a34df4dffafe91bd6ef48f245eec"} Jul 09 11:52:11.899921 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:11.899870 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8tktg/must-gather-mkt4k" podStartSLOduration=1.933553984 podStartE2EDuration="2.89985136s" totalImagesPullingTime="966.297376ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 11:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:52:11.899239284 +0000 UTC m=+2437.810083810" watchObservedRunningTime="2026-07-09 11:52:11.89985136 +0000 UTC m=+2437.810695891" Jul 09 11:52:12.723832 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:12.723800 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4tp6c_3e079363-7a35-4ffd-a0e0-9763e5e6e0a6/global-pull-secret-syncer/0.log" Jul 09 11:52:12.918008 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:12.917980 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cfllx_b99c44de-f215-4688-b81e-9e4cdee6a0b0/konnectivity-agent/0.log" Jul 09 11:52:12.980471 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:12.980392 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-226.ec2.internal_5f2626d80cf6adaad426dfc2322e4da8/haproxy/0.log" Jul 09 11:52:17.268214 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.268179 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc_644b80ca-4889-498c-b4f7-e4ffdb8e8cce/extract/0.log" Jul 09 11:52:17.292509 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.292473 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc_644b80ca-4889-498c-b4f7-e4ffdb8e8cce/util/0.log" Jul 09 11:52:17.323143 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.323109 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t8cdc_644b80ca-4889-498c-b4f7-e4ffdb8e8cce/pull/0.log" Jul 09 11:52:17.353402 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.353367 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd_f1eaa168-abbb-4db8-9830-0d5a761c7465/extract/0.log" Jul 09 11:52:17.391823 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.391782 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd_f1eaa168-abbb-4db8-9830-0d5a761c7465/util/0.log" Jul 09 11:52:17.417762 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.417733 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09kjkd_f1eaa168-abbb-4db8-9830-0d5a761c7465/pull/0.log" Jul 09 11:52:17.454324 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.454275 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr_50a5fad3-65b0-4029-a5a6-8c6fb3179ed5/extract/0.log" Jul 09 11:52:17.479195 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.477984 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr_50a5fad3-65b0-4029-a5a6-8c6fb3179ed5/util/0.log" Jul 09 11:52:17.510835 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.510807 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g8wzr_50a5fad3-65b0-4029-a5a6-8c6fb3179ed5/pull/0.log" Jul 09 11:52:17.551386 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.551247 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz_9cea9c5c-e721-475e-ba4c-a6756160fd37/extract/0.log" Jul 09 11:52:17.580299 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.580251 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz_9cea9c5c-e721-475e-ba4c-a6756160fd37/util/0.log" Jul 09 11:52:17.603298 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.603247 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1578lz_9cea9c5c-e721-475e-ba4c-a6756160fd37/pull/0.log" Jul 09 11:52:17.982567 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:17.982097 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-844b64bb5f-wv7j7_bba5b764-2a4a-403b-8f7b-a5413a0bd076/authorino/0.log" Jul 09 11:52:18.040861 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:18.040729 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s6g8c_b4bc416d-f5b2-44ba-8693-34b01cbe711f/manager/0.log" Jul 09 11:52:18.150253 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:18.150200 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-q6kw5_4c147415-80fa-4cc7-b17a-097c543e26f1/registry-server/0.log" Jul 09 11:52:18.301143 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:18.301037 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7s6cw_f8441443-5103-435c-bbd2-959f69132de1/manager/0.log" Jul 09 11:52:18.327422 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:18.327389 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t9j9m_810acab9-d2ea-4861-ad44-531413f9330b/limitador/0.log" Jul 09 11:52:18.397761 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:18.397704 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bdgjb_487a2494-2d2b-4338-96ea-bc619d8b30b1/manager/0.log" Jul 09 11:52:20.058319 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.058264 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_543ff77a-1021-4476-9c7d-b7d95582942f/alertmanager/0.log" Jul 09 11:52:20.089257 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.089223 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_543ff77a-1021-4476-9c7d-b7d95582942f/config-reloader/0.log" Jul 09 11:52:20.117199 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.117166 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_543ff77a-1021-4476-9c7d-b7d95582942f/kube-rbac-proxy-web/0.log" Jul 09 11:52:20.147563 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.147527 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_543ff77a-1021-4476-9c7d-b7d95582942f/kube-rbac-proxy/0.log" Jul 09 11:52:20.171265 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.171235 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_543ff77a-1021-4476-9c7d-b7d95582942f/kube-rbac-proxy-metric/0.log" Jul 09 11:52:20.199118 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.199091 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_543ff77a-1021-4476-9c7d-b7d95582942f/prom-label-proxy/0.log" Jul 09 11:52:20.233183 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.233155 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_543ff77a-1021-4476-9c7d-b7d95582942f/init-config-reloader/0.log" Jul 09 11:52:20.293043 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.293008 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/1.log" Jul 09 11:52:20.398106 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.398071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-d6b5s_40a02d4a-5ffa-4d0f-8642-dd281fe6ee5b/cluster-monitoring-operator/0.log" Jul 09 11:52:20.552552 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.552519 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-5lvhv_a271cf57-6633-4660-8675-22986461c23a/monitoring-plugin/0.log" Jul 09 11:52:20.755106 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.755012 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lrqdr_412646ab-ae7a-43b8-8b27-f58d4ad6414f/node-exporter/0.log" Jul 09 11:52:20.778562 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.778530 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lrqdr_412646ab-ae7a-43b8-8b27-f58d4ad6414f/kube-rbac-proxy/0.log" Jul 09 11:52:20.804049 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.804013 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lrqdr_412646ab-ae7a-43b8-8b27-f58d4ad6414f/init-textfile/0.log" Jul 09 11:52:20.839208 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.839167 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-99b22_a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2/kube-rbac-proxy-main/0.log" Jul 09 11:52:20.863475 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.863443 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-99b22_a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2/kube-rbac-proxy-self/0.log" Jul 09 11:52:20.886741 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:20.886712 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-99b22_a2cf7bcc-b090-4dd0-b6f4-8a46e24d1da2/openshift-state-metrics/0.log" Jul 09 11:52:21.099934 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:21.099901 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-dqcqm_d674c831-9ebc-4aed-94b5-af904a6bb2b6/prometheus-operator/0.log" Jul 09 11:52:21.121637 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:21.121609 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-dqcqm_d674c831-9ebc-4aed-94b5-af904a6bb2b6/kube-rbac-proxy/0.log" Jul 09 11:52:21.149242 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:21.149210 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-6s5pg_078eb3e4-fcff-4176-a5d8-fa26cd880f56/prometheus-operator-admission-webhook/0.log" Jul 09 11:52:21.276409 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:21.276382 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89575b84c-zrqrg_5d1f1329-673b-4b2e-a001-66f005392970/thanos-query/0.log" Jul 09 11:52:21.301179 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:21.301152 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89575b84c-zrqrg_5d1f1329-673b-4b2e-a001-66f005392970/kube-rbac-proxy-web/0.log" Jul 09 11:52:21.323227 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:21.323187 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89575b84c-zrqrg_5d1f1329-673b-4b2e-a001-66f005392970/kube-rbac-proxy/0.log" Jul 09 11:52:21.351270 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:21.351188 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89575b84c-zrqrg_5d1f1329-673b-4b2e-a001-66f005392970/prom-label-proxy/0.log" Jul 09 11:52:21.380800 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:21.380749 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89575b84c-zrqrg_5d1f1329-673b-4b2e-a001-66f005392970/kube-rbac-proxy-rules/0.log" Jul 09 11:52:21.402916 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:21.402887 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89575b84c-zrqrg_5d1f1329-673b-4b2e-a001-66f005392970/kube-rbac-proxy-metrics/0.log" Jul 09 11:52:22.609189 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:22.609163 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-ws6jc_c73e118a-de16-4c50-95f8-3b96314365b8/networking-console-plugin/0.log" Jul 09 11:52:23.119539 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.119501 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw"] Jul 09 11:52:23.127737 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.127709 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.134891 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.134815 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw"] Jul 09 11:52:23.183407 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.183372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-podres\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.183616 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.183602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qh2k\" (UniqueName: \"kubernetes.io/projected/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-kube-api-access-2qh2k\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.183702 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.183693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-lib-modules\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.183828 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.183809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-sys\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.184019 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.184003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-proc\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.284806 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.284769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-proc\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.284999 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.284816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-podres\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.284999 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.284839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qh2k\" (UniqueName: \"kubernetes.io/projected/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-kube-api-access-2qh2k\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.284999 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.284947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-lib-modules\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.285226 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.285045 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-lib-modules\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.285226 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.284972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-podres\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.285226 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.284972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-proc\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.285226 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.285080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-sys\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.285226 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.285191 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-sys\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.294089 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.294060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qh2k\" (UniqueName: \"kubernetes.io/projected/a3d9f1a9-5878-45f1-8b53-976f99cb4d00-kube-api-access-2qh2k\") pod \"perf-node-gather-daemonset-sx4vw\" (UID: \"a3d9f1a9-5878-45f1-8b53-976f99cb4d00\") " pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.444314 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.444199 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:23.641001 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.640958 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw"] Jul 09 11:52:23.889944 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.889917 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dbbcd5bbb-nc79z_afc7c0d1-b5ec-4a34-a716-edee2413da41/console/0.log" Jul 09 11:52:23.929510 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:23.929462 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-74q7t_cd59919e-b9a1-4052-b7fb-bb4f5df4fe55/download-server/0.log" Jul 09 11:52:24.030994 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:24.030892 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" event={"ID":"a3d9f1a9-5878-45f1-8b53-976f99cb4d00","Type":"ContainerStarted","Data":"b5cb76e12ce5db4949dcbedbf9c476575215308912bcc454669dbbc0e62e15af"} Jul 09 11:52:24.030994 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:24.030965 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" event={"ID":"a3d9f1a9-5878-45f1-8b53-976f99cb4d00","Type":"ContainerStarted","Data":"6a2318742d66c62c999340da92c6b53c7e97dda7a4dc28946fc4afdbe072bc2e"} Jul 09 11:52:24.031383 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:24.031359 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:24.049333 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:24.049243 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" podStartSLOduration=1.049221385 podStartE2EDuration="1.049221385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 11:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 11:52:24.047163689 +0000 UTC m=+2449.958008247" watchObservedRunningTime="2026-07-09 11:52:24.049221385 +0000 UTC m=+2449.960065912" Jul 09 11:52:25.815585 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:25.815549 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x7qvq_4a3acf38-52b2-4368-834a-35ec650fa955/dns/0.log" Jul 09 11:52:25.841698 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:25.841671 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x7qvq_4a3acf38-52b2-4368-834a-35ec650fa955/kube-rbac-proxy/0.log" Jul 09 11:52:25.868813 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:25.868775 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btfhm_0b0a1137-bae7-4ffe-867c-51ad32e22c15/dns-node-resolver/0.log" Jul 09 11:52:26.494908 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:26.494868 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t5l5s_2de16fdd-03a8-47ac-a739-71a61b51bf59/node-ca/0.log" Jul 09 11:52:27.483528 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:27.483500 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hmxrx_e48ac04e-fab5-4774-8b97-843aaf592827/istio-proxy/0.log" Jul 09 11:52:27.631266 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:27.631243 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6579588b8b-xts5c_e036c346-c78a-433b-96ff-df2ba44e6ffd/kube-auth-proxy/0.log" Jul 09 11:52:27.661143 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:27.661095 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vczpq_bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac/istio-proxy/0.log" Jul 09 11:52:27.699595 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:27.699562 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vczpq_bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac/istio-proxy/1.log" Jul 09 11:52:27.818123 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:27.818026 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc99479f9-lmlq5_a06ae9b5-a700-4c5c-a1aa-dbb20e981958/router/0.log" Jul 09 11:52:28.596717 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:28.596689 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l9dl7_7c5ca9ec-f699-4051-a7ec-24010d1bd331/serve-healthcheck-canary/0.log" Jul 09 11:52:29.101538 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:29.101509 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-smdjf_7f777ccc-4045-4847-bab9-9119e307a233/insights-operator/0.log" Jul 09 11:52:29.103340 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:29.103315 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-smdjf_7f777ccc-4045-4847-bab9-9119e307a233/insights-operator/1.log" Jul 09 11:52:29.198133 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:29.198107 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rnkdd_e3790962-44af-4405-be62-112f125ebc4c/kube-rbac-proxy/0.log" Jul 09 11:52:29.224119 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:29.224093 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rnkdd_e3790962-44af-4405-be62-112f125ebc4c/exporter/0.log" Jul 09 11:52:29.247681 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:29.247649 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rnkdd_e3790962-44af-4405-be62-112f125ebc4c/extractor/0.log" Jul 09 11:52:30.051512 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:30.051486 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8tktg/perf-node-gather-daemonset-sx4vw" Jul 09 11:52:31.726926 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:31.726877 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-t9z4x_d30530dc-4c11-4edf-9490-2eb5b58cc145/manager/0.log" Jul 09 11:52:31.861773 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:31.861737 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7s5jh_6d47fa9b-1258-4d8f-8b4b-f9ec475fb77b/manager/0.log" Jul 09 11:52:31.962454 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:31.962424 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-w9nj5_5fb77719-e64a-48ab-97bb-b90c1f897101/server/0.log" Jul 09 11:52:32.045314 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:32.045217 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wb2nj_09e8aa95-9326-470a-89e0-d0b5b37ab1b8/manager/0.log" Jul 09 11:52:32.251113 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:32.251078 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b4d55d4c-mhkpf_0a991007-3efa-45bb-8dbe-c2741e31d47b/manager/0.log" Jul 09 11:52:32.275102 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:32.275074 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b4d55d4c-mhkpf_0a991007-3efa-45bb-8dbe-c2741e31d47b/copy-manifests/0.log" Jul 09 11:52:34.047801 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:34.047754 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hmxrx_e48ac04e-fab5-4774-8b97-843aaf592827/istio-proxy/0.log" Jul 09 11:52:34.170666 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:34.170611 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6579588b8b-xts5c_e036c346-c78a-433b-96ff-df2ba44e6ffd/kube-auth-proxy/0.log" Jul 09 11:52:34.198709 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:34.198680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vczpq_bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac/istio-proxy/0.log" Jul 09 11:52:34.235321 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:34.235265 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vczpq_bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac/istio-proxy/1.log" Jul 09 11:52:34.337725 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:34.337696 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc99479f9-lmlq5_a06ae9b5-a700-4c5c-a1aa-dbb20e981958/router/0.log" Jul 09 11:52:35.552333 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:35.552270 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hmxrx_e48ac04e-fab5-4774-8b97-843aaf592827/istio-proxy/0.log" Jul 09 11:52:35.672715 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:35.672686 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6579588b8b-xts5c_e036c346-c78a-433b-96ff-df2ba44e6ffd/kube-auth-proxy/0.log" Jul 09 11:52:35.699371 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:35.699300 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vczpq_bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac/istio-proxy/0.log" Jul 09 11:52:35.738896 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:35.738862 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vczpq_bfbf92ee-3ce9-4e2b-aed2-5a065166c1ac/istio-proxy/1.log" Jul 09 11:52:35.815620 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:35.815593 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc99479f9-lmlq5_a06ae9b5-a700-4c5c-a1aa-dbb20e981958/router/0.log" Jul 09 11:52:39.790986 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:39.790936 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-7jjnv_d6979d57-ba97-430b-8da4-12fb9e425387/kube-storage-version-migrator-operator/1.log" Jul 09 11:52:39.791804 ip-10-0-131-226 kubenswrapper[2562]: I0709 11:52:39.791783 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-7jjnv_d6979d57-ba97-430b-8da4-12fb9e425387/kube-storage-version-migrator-operator/0.log"