Jul 31 21:23:37.413175 ip-10-0-135-32 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 31 21:23:37.413193 ip-10-0-135-32 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 31 21:23:37.413203 ip-10-0-135-32 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 31 21:23:37.413552 ip-10-0-135-32 systemd[1]: Failed to start Kubernetes Kubelet. Jul 31 21:23:47.522018 ip-10-0-135-32 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 31 21:23:47.522038 ip-10-0-135-32 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 780cc1b237244e21b15a8a7b494cc576 -- Jul 31 21:25:37.877580 ip-10-0-135-32 systemd[1]: Starting Kubernetes Kubelet... Jul 31 21:25:38.183887 ip-10-0-135-32 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 21:25:38.183887 ip-10-0-135-32 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 31 21:25:38.183887 ip-10-0-135-32 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 21:25:38.183887 ip-10-0-135-32 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 31 21:25:38.183887 ip-10-0-135-32 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 21:25:38.184578 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.183976 2548 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 31 21:25:38.187465 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187450 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:38.187465 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187466 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187470 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187473 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187475 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187478 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187482 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187484 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187487 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187489 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187492 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187494 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187497 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187501 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187505 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187508 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187516 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187519 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187521 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187524 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:38.187539 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187526 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187529 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187531 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187534 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187536 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187539 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187541 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187544 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187547 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187550 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187552 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187555 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187558 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187560 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187562 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187565 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187567 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187570 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187572 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187575 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:38.188043 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187578 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187580 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187583 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187585 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187587 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187590 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187592 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187595 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187597 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187600 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187602 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187604 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187606 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187609 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187614 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187618 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187621 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187623 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187625 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187628 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:38.188562 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187630 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187633 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187635 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187638 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187641 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187643 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187646 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187648 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187651 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187654 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187656 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187658 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187661 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187663 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187666 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187668 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187670 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187673 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187675 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187677 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:38.189070 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187680 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187682 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187685 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187689 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187693 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187696 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187699 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187702 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187705 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187707 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187710 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187712 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187715 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187717 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187720 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187722 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187725 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187727 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.187730 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:38.189599 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188454 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188461 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188464 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188467 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188470 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188473 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188475 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188478 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188481 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188483 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188486 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188489 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188491 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188494 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188497 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188499 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188502 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188504 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188508 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188511 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:38.190097 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188514 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188516 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188519 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188521 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188524 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188526 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188528 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188531 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188533 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188536 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188538 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188541 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188544 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188546 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188548 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188551 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188553 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188555 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188558 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188562 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:38.190727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188565 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188568 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188570 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188573 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188576 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188578 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188581 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188584 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188586 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188588 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188591 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188594 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188597 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188600 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188604 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188606 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188609 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188612 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188616 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188619 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:38.191237 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188621 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188624 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188626 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188629 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188631 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188633 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188636 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188638 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188641 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188644 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188647 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188650 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188653 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188656 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188659 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188675 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188678 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188681 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188685 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:38.191752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188688 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188691 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188694 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188697 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188701 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188704 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188707 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188709 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188712 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188715 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188717 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188720 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188722 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188725 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188727 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188730 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188732 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188734 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188737 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:38.192248 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.188739 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189081 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189086 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189089 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189091 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189094 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189097 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189099 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189102 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189104 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189107 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189110 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189114 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189117 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189121 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189123 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189127 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189130 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189134 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189137 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:38.192752 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189140 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189143 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189145 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189148 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189150 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189153 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189155 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189158 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189160 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189162 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189165 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189167 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189169 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189171 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189174 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189177 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189179 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189181 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189184 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:38.193251 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189186 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189188 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189191 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189193 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189195 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189199 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189201 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189204 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189207 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189211 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189214 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189217 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189219 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189222 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189224 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189227 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189229 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189231 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189234 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189237 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:38.193791 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189239 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189241 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189244 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189246 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189248 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189250 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189253 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189255 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189258 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189260 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189263 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189266 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189268 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189271 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189273 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189275 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189278 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189281 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189302 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:38.194304 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189307 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189311 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189318 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189321 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189324 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189327 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189330 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189332 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189335 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189337 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189340 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189342 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189345 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189348 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189350 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189353 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189355 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189358 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189360 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189363 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:38.194761 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189365 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.189367 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189434 2548 flags.go:64] FLAG: --address="0.0.0.0" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189447 2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189457 2548 flags.go:64] FLAG: --anonymous-auth="true" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189463 2548 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189472 2548 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189476 2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189480 2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189484 2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189487 2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189490 2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189493 2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189496 2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189501 2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189506 2548 flags.go:64] FLAG: --cgroup-root="" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189509 2548 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189512 2548 flags.go:64] FLAG: --client-ca-file="" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189514 2548 flags.go:64] FLAG: --cloud-provider="external" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189517 2548 flags.go:64] FLAG: --cluster-dns="[]" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189522 2548 flags.go:64] FLAG: --cluster-domain="" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189525 2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189527 2548 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189530 2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 31 21:25:38.195308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189533 2548 flags.go:64] FLAG: --container-log-max-files="5" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189537 2548 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189540 2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189543 2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189546 2548 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189548 2548 flags.go:64] FLAG: --contention-profiling="false" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189551 2548 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189554 2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189557 2548 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189560 2548 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189564 2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189567 2548 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189570 2548 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189572 2548 flags.go:64] FLAG: --enable-load-reader="false" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189575 2548 flags.go:64] FLAG: --enable-server="true" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189578 2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189595 2548 flags.go:64] FLAG: --event-burst="100" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189599 2548 flags.go:64] FLAG: --event-qps="50" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189602 2548 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189605 2548 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189608 2548 flags.go:64] FLAG: --eviction-hard="" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189612 2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189616 2548 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189619 2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189623 2548 flags.go:64] FLAG: --eviction-soft="" Jul 31 21:25:38.195914 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189626 2548 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189629 2548 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189632 2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189634 2548 flags.go:64] FLAG: --experimental-mounter-path="" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189637 2548 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189639 2548 flags.go:64] FLAG: --fail-swap-on="true" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189642 2548 flags.go:64] FLAG: --feature-gates="" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189646 2548 flags.go:64] FLAG: --file-check-frequency="20s" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189648 2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189651 2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189654 2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189657 2548 flags.go:64] FLAG: --healthz-port="10248" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189660 2548 flags.go:64] FLAG: --help="false" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189663 2548 flags.go:64] FLAG: --hostname-override="ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189666 2548 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189669 2548 flags.go:64] FLAG: --http-check-frequency="20s" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189671 2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189675 2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189678 2548 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189680 2548 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189684 2548 flags.go:64] FLAG: --image-service-endpoint="" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189687 2548 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189690 2548 flags.go:64] FLAG: --kube-api-burst="100" Jul 31 21:25:38.196547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189692 2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189695 2548 flags.go:64] FLAG: --kube-api-qps="50" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189698 2548 flags.go:64] FLAG: --kube-reserved="" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189701 2548 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189703 2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189706 2548 flags.go:64] FLAG: --kubelet-cgroups="" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189709 2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189712 2548 flags.go:64] FLAG: --lock-file="" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189715 2548 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189718 2548 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189721 2548 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189726 2548 flags.go:64] FLAG: --log-json-split-stream="false" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189729 2548 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189731 2548 flags.go:64] FLAG: --log-text-split-stream="false" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189734 2548 flags.go:64] FLAG: --logging-format="text" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189737 2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189740 2548 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189742 2548 flags.go:64] FLAG: --manifest-url="" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189745 2548 flags.go:64] FLAG: --manifest-url-header="" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189749 2548 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189752 2548 flags.go:64] FLAG: --max-open-files="1000000" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189756 2548 flags.go:64] FLAG: --max-pods="110" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189758 2548 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189762 2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189764 2548 flags.go:64] FLAG: --memory-manager-policy="None" Jul 31 21:25:38.197139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189767 2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189770 2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189772 2548 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189775 2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189783 2548 flags.go:64] FLAG: --node-status-max-images="50" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189785 2548 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189788 2548 flags.go:64] FLAG: --oom-score-adj="-999" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189791 2548 flags.go:64] FLAG: --pod-cidr="" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189794 2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189799 2548 flags.go:64] FLAG: --pod-manifest-path="" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189802 2548 flags.go:64] FLAG: --pod-max-pids="-1" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189805 2548 flags.go:64] FLAG: --pods-per-core="0" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189807 2548 flags.go:64] FLAG: --port="10250" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189810 2548 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189813 2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fd50adfb7b1654d3" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189816 2548 flags.go:64] FLAG: --qos-reserved="" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189819 2548 flags.go:64] FLAG: --read-only-port="10255" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189822 2548 flags.go:64] FLAG: --register-node="true" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189825 2548 flags.go:64] FLAG: --register-with-taints="" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189829 2548 flags.go:64] FLAG: --registry-burst="10" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189831 2548 flags.go:64] FLAG: --registry-qps="5" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189834 2548 flags.go:64] FLAG: --reserved-cpus="" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189837 2548 flags.go:64] FLAG: --reserved-memory="" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189840 2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189843 2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 31 21:25:38.197825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189846 2548 flags.go:64] FLAG: --rotate-certificates="false" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189848 2548 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189851 2548 flags.go:64] FLAG: --runonce="false" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189854 2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189857 2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189859 2548 flags.go:64] FLAG: --seccomp-default="false" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189862 2548 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189865 2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189868 2548 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189870 2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189873 2548 flags.go:64] FLAG: --storage-driver-password="root" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189876 2548 flags.go:64] FLAG: --storage-driver-secure="false" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189880 2548 flags.go:64] FLAG: --storage-driver-table="stats" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189883 2548 flags.go:64] FLAG: --storage-driver-user="root" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189886 2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189888 2548 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189891 2548 flags.go:64] FLAG: --system-cgroups="" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189894 2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189899 2548 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189901 2548 flags.go:64] FLAG: --tls-cert-file="" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189904 2548 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189908 2548 flags.go:64] FLAG: --tls-min-version="" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189911 2548 flags.go:64] FLAG: --tls-private-key-file="" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189913 2548 flags.go:64] FLAG: --topology-manager-policy="none" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189916 2548 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 31 21:25:38.198519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189919 2548 flags.go:64] FLAG: --topology-manager-scope="container" Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189922 2548 flags.go:64] FLAG: --v="2" Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189925 2548 flags.go:64] FLAG: --version="false" Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189929 2548 flags.go:64] FLAG: --vmodule="" Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189932 2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.189935 2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190067 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190072 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190075 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190078 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190081 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190084 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190086 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190089 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190091 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190094 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190096 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190099 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190101 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190105 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190108 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:38.199154 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190111 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190113 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190116 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190118 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190121 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190125 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190128 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190131 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190133 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190136 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190139 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190141 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190144 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190146 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190149 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190151 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190154 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190156 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190159 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190161 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:38.199707 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190163 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190166 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190168 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190170 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190172 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190175 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190177 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190180 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190182 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190184 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190188 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190191 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190193 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190196 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190199 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190202 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190205 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190209 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190211 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:38.200205 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190214 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190216 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190218 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190221 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190224 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190226 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190229 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190232 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190235 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190237 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190239 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190242 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190244 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190246 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190249 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190251 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190253 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190256 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190258 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190260 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:38.200700 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190263 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190265 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190268 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190271 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190274 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190276 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190279 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190281 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190283 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190298 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190303 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190305 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190308 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190310 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190313 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190316 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190318 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190321 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190323 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190326 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:38.201201 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190329 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190331 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190335 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190339 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.190342 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.190936 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.197396 2548 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.197411 2548 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.197424 2548 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.197430 2548 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197485 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197491 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197494 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197497 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:38.201727 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197500 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197503 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197507 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197509 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197512 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197515 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197518 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197520 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197523 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197526 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197529 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197531 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197534 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197536 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197539 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197541 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197544 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197546 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197549 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197551 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:38.202113 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197554 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197556 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197559 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197561 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197565 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197571 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197574 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197577 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197579 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197582 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197584 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197586 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197588 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197591 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197593 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197596 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197598 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197600 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197603 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:38.202695 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197605 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197608 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197610 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197612 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197614 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197618 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197621 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197624 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197627 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197630 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197633 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197635 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197637 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197640 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197642 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197645 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197647 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197650 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197653 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197656 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:38.203162 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197658 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197661 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197663 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197666 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197668 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197670 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197673 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197675 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197678 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197680 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197682 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197685 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197687 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197689 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197692 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197694 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197697 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197699 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197701 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197704 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:38.203692 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197706 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197708 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197710 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197713 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197715 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197717 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197720 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197722 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197725 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197729 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197732 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197735 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197738 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197740 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197743 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:38.204198 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197745 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.197750 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197860 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197865 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197868 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197871 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197874 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197878 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197881 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197884 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197887 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197889 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197892 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197894 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:38.204582 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197897 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197899 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197902 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197905 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197908 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197912 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197914 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197917 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197919 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197922 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197924 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197927 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197929 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197932 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197934 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197937 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197940 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197943 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197945 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:38.204940 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197948 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197950 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197952 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197955 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197957 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197959 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197962 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197964 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197967 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197969 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197971 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197974 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197976 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197978 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197981 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197984 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197987 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197989 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197992 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197994 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:38.205507 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197996 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.197999 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198010 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198012 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198015 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198017 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198020 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198023 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198026 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198028 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198031 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198034 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198037 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198039 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198041 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198044 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198046 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198048 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198051 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198053 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:38.206024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198055 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198058 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198060 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198062 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198065 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198067 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198069 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198072 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198074 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198076 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198079 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198081 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198083 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198085 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198088 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198090 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198092 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198095 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198097 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198100 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:38.206541 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198102 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198104 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198107 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198110 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198112 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198115 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198117 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:38.198119 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.198124 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.198238 2548 server.go:962] "Client rotation is on, will bootstrap in background" Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.200196 2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.201408 2548 server.go:1019] "Starting client certificate rotation" Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.201508 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 21:25:38.207090 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.202120 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 21:25:38.207440 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.203558 2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 21:25:38.207886 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.207871 2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 21:25:38.218140 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.218117 2548 log.go:25] "Validated CRI v1 runtime API" Jul 31 21:25:38.220156 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.220141 2548 log.go:25] "Validated CRI v1 image API" Jul 31 21:25:38.220898 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.220881 2548 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 31 21:25:38.222940 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.222912 2548 fs.go:135] Filesystem UUIDs: map[31488945-ded4-4905-9afa-ede64ea4c667:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 aedf1337-81de-455b-b03e-69d28c4ba414:/dev/nvme0n1p4] Jul 31 21:25:38.223015 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.222938 2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 31 21:25:38.228505 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.228393 2548 manager.go:216] Machine: {Timestamp:2026-07-31 21:25:38.227241777 +0000 UTC m=+0.258093488 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3145495 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ccbdf9953aeb5fe6d7c0fe510049a SystemUUID:ec2ccbdf-9953-aeb5-fe6d-7c0fe510049a BootID:780cc1b2-3724-4e21-b15a-8a7b494cc576 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:de:d9:ec:1a:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:de:d9:ec:1a:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:a3:d2:1f:b0:e1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 31 21:25:38.228505 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.228494 2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 31 21:25:38.228638 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.228566 2548 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 31 21:25:38.229862 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.229846 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 21:25:38.231091 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.231063 2548 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 31 21:25:38.231268 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.231096 2548 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-32.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 31 21:25:38.231757 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.231745 2548 topology_manager.go:138] "Creating topology manager with none policy" Jul 31 21:25:38.231809 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.231763 2548 container_manager_linux.go:309] "Creating device plugin manager" Jul 31 21:25:38.231809 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.231773 2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 21:25:38.231809 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.231795 2548 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 21:25:38.232998 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.232985 2548 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 31 21:25:38.237122 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.237108 2548 state_mem.go:36] "Initialized new in-memory state store" Jul 31 21:25:38.237250 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.237239 2548 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 31 21:25:38.237324 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.237276 2548 kubelet.go:486] "Attempting to sync node with API server" Jul 31 21:25:38.237324 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.237308 2548 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 31 21:25:38.237324 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.237325 2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 31 21:25:38.237441 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.237336 2548 kubelet.go:398] "Adding apiserver pod source" Jul 31 21:25:38.237441 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.237349 2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 31 21:25:38.237714 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.237700 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 21:25:38.237823 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.237723 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 21:25:38.239558 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.239533 2548 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 31 21:25:38.240842 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.240829 2548 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 31 21:25:38.240902 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.240867 2548 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 31 21:25:38.241507 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241494 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 31 21:25:38.241560 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241513 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 31 21:25:38.241560 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241520 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 31 21:25:38.241560 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241525 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 31 21:25:38.241560 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241533 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 31 21:25:38.241560 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241539 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 31 21:25:38.241560 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241547 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 31 21:25:38.241560 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241556 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 31 21:25:38.241743 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241565 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 31 21:25:38.241743 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241578 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 31 21:25:38.241743 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241586 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 31 21:25:38.241743 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.241591 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 31 21:25:38.242226 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.242216 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 31 21:25:38.242257 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.242226 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 31 21:25:38.245037 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.245018 2548 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-32.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 31 21:25:38.245123 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.245096 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 31 21:25:38.245201 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.245181 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 31 21:25:38.245374 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.245362 2548 server.go:1268] "Started kubelet" Jul 31 21:25:38.245471 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.245426 2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 31 21:25:38.246053 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.245744 2548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 31 21:25:38.246262 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.246248 2548 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 31 21:25:38.246387 ip-10-0-135-32 systemd[1]: Started Kubernetes Kubelet. Jul 31 21:25:38.249255 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.249231 2548 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 31 21:25:38.250427 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.250405 2548 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 31 21:25:38.251080 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.251064 2548 server.go:310] "Adding debug handlers to kubelet server" Jul 31 21:25:38.252139 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.251476 2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-32.ec2.internal.18c77cedd7cd4730 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-32.ec2.internal,UID:ip-10-0-135-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-32.ec2.internal,},FirstTimestamp:2026-07-31 21:25:38.245338928 +0000 UTC m=+0.276190640,LastTimestamp:2026-07-31 21:25:38.245338928 +0000 UTC m=+0.276190640,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-32.ec2.internal,}" Jul 31 21:25:38.255122 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.255096 2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 31 21:25:38.255122 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.255108 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 31 21:25:38.255250 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.255186 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:38.255615 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.255600 2548 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 31 21:25:38.255615 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.255617 2548 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 31 21:25:38.255732 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.255600 2548 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 31 21:25:38.255732 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.255689 2548 reconstruct.go:97] "Volume reconstruction finished" Jul 31 21:25:38.255732 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.255697 2548 reconciler.go:29] "Reconciler: start to sync state" Jul 31 21:25:38.255852 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.255771 2548 factory.go:55] Registering systemd factory Jul 31 21:25:38.255852 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.255786 2548 factory.go:223] Registration of the systemd container factory successfully Jul 31 21:25:38.256095 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.256016 2548 factory.go:153] Registering CRI-O factory Jul 31 21:25:38.256095 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.256027 2548 factory.go:223] Registration of the crio container factory successfully Jul 31 21:25:38.256095 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.256074 2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 31 21:25:38.256095 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.256092 2548 factory.go:103] Registering Raw factory Jul 31 21:25:38.256267 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.256102 2548 manager.go:1196] Started watching for new ooms in manager Jul 31 21:25:38.256531 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.256516 2548 manager.go:349] Starting recovery of all containers Jul 31 21:25:38.257190 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.257163 2548 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 31 21:25:38.257357 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.257332 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 31 21:25:38.268475 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.268252 2548 manager.go:354] Recovery completed Jul 31 21:25:38.269916 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.269900 2548 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 31 21:25:38.272648 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.272637 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:38.274300 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.274265 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:38.274370 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.274310 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:38.274370 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.274321 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:38.274678 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.274663 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxllg" Jul 31 21:25:38.274892 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.274877 2548 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 31 21:25:38.274892 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.274892 2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 31 21:25:38.274980 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.274906 2548 state_mem.go:36] "Initialized new in-memory state store" Jul 31 21:25:38.274980 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.274908 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:38.275491 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.275479 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:38.275538 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.275503 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:38.275538 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.275514 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:38.276956 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.276945 2548 policy_none.go:49] "None policy: Start" Jul 31 21:25:38.276996 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.276961 2548 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 31 21:25:38.276996 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.276971 2548 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 31 21:25:38.278894 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.278884 2548 policy_none.go:47] "Start" Jul 31 21:25:38.281956 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.281936 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxllg" Jul 31 21:25:38.282562 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.282485 2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-32.ec2.internal.18c77cedd986e7b6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-32.ec2.internal,UID:ip-10-0-135-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-32.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-32.ec2.internal,},FirstTimestamp:2026-07-31 21:25:38.274281398 +0000 UTC m=+0.305133117,LastTimestamp:2026-07-31 21:25:38.274281398 +0000 UTC m=+0.305133117,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-32.ec2.internal,}" Jul 31 21:25:38.287498 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.287061 2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-32.ec2.internal.18c77cedd9876e87 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-32.ec2.internal,UID:ip-10-0-135-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-32.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-32.ec2.internal,},FirstTimestamp:2026-07-31 21:25:38.274315911 +0000 UTC m=+0.305167626,LastTimestamp:2026-07-31 21:25:38.274315911 +0000 UTC m=+0.305167626,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-32.ec2.internal,}" Jul 31 21:25:38.308819 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.308801 2548 manager.go:337] "Starting Device Plugin manager" Jul 31 21:25:38.308877 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.308826 2548 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 31 21:25:38.308877 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.308835 2548 server.go:87] "Starting device plugin registration server" Jul 31 21:25:38.309050 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.309037 2548 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 31 21:25:38.309099 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.309054 2548 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 31 21:25:38.309174 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.309150 2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 31 21:25:38.309262 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.309227 2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 31 21:25:38.309262 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.309236 2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 31 21:25:38.310391 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.310368 2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 31 21:25:38.310440 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.310416 2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:38.370757 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.370714 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 31 21:25:38.372900 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.371956 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 31 21:25:38.372900 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.371990 2548 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 31 21:25:38.372900 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.372012 2548 kubelet.go:2448] "Starting kubelet main sync loop" Jul 31 21:25:38.372900 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.372046 2548 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 31 21:25:38.374473 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.374455 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 21:25:38.409504 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.409479 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:38.410258 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.410244 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:38.410346 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.410272 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:38.410346 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.410284 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:38.410346 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.410321 2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.419383 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.419369 2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.419426 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.419391 2548 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-32.ec2.internal\": node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:38.450377 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.450330 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:38.472109 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.472086 2548 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal"] Jul 31 21:25:38.472159 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.472147 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:38.473445 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.473432 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:38.473499 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.473459 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:38.473499 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.473471 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:38.475872 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.475860 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:38.476001 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.475988 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.476040 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.476018 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:38.476528 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.476513 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:38.476585 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.476543 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:38.476585 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.476555 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:38.476649 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.476513 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:38.476649 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.476614 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:38.476649 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.476629 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:38.478889 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.478876 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.478936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.478899 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:38.479489 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.479475 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:38.479545 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.479507 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:38.479545 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.479522 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:38.515049 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.515026 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-32.ec2.internal\" not found" node="ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.518371 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.518356 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-32.ec2.internal\" not found" node="ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.550434 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.550415 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:38.557758 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.557741 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf037baff33e107bd6b6137eaa0bdb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-32.ec2.internal\" (UID: \"bf037baff33e107bd6b6137eaa0bdb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.557842 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.557771 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/943fee120611b8344761cc8b938b1537-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"943fee120611b8344761cc8b938b1537\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.557842 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.557795 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/943fee120611b8344761cc8b938b1537-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"943fee120611b8344761cc8b938b1537\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.650922 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.650895 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:38.658224 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.658205 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/943fee120611b8344761cc8b938b1537-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"943fee120611b8344761cc8b938b1537\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.658284 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.658233 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/943fee120611b8344761cc8b938b1537-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"943fee120611b8344761cc8b938b1537\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.658284 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.658248 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf037baff33e107bd6b6137eaa0bdb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-32.ec2.internal\" (UID: \"bf037baff33e107bd6b6137eaa0bdb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.658375 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.658312 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf037baff33e107bd6b6137eaa0bdb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-32.ec2.internal\" (UID: \"bf037baff33e107bd6b6137eaa0bdb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.658375 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.658321 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/943fee120611b8344761cc8b938b1537-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"943fee120611b8344761cc8b938b1537\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.658375 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.658331 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/943fee120611b8344761cc8b938b1537-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"943fee120611b8344761cc8b938b1537\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.751608 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.751561 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:38.818034 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.818015 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.821164 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:38.821147 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 31 21:25:38.852304 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.852270 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:38.952783 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:38.952763 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:39.053323 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:39.053242 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:39.153708 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:39.153690 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:39.201138 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:39.201115 2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 31 21:25:39.201608 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:39.201260 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 21:25:39.253773 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:39.253748 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:39.286907 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:39.286877 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 21:20:40 +0000 UTC" deadline="2028-01-05 09:15:51.912781204 +0000 UTC" Jul 31 21:25:39.286907 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:39.286903 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12539h50m12.625882243s" Jul 31 21:25:39.321237 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:39.321187 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:39.322497 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:39.322479 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:39.322590 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:39.322513 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:39.322590 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:39.322529 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:39.354781 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:39.354751 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:39.394409 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:39.394393 2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 21:25:41.213180 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:41.213158 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943fee120611b8344761cc8b938b1537.slice/crio-bf4431ae712258bae7f03508c61d5425576e2a421a80dca5e5bcfe803deeae92 WatchSource:0}: Error finding container bf4431ae712258bae7f03508c61d5425576e2a421a80dca5e5bcfe803deeae92: Status 404 returned error can't find the container with id bf4431ae712258bae7f03508c61d5425576e2a421a80dca5e5bcfe803deeae92 Jul 31 21:25:41.214155 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:41.214131 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf037baff33e107bd6b6137eaa0bdb4e.slice/crio-dad467770c530e2f83d51cc1f737e7a35d9372ddd2abf427b12df6ac40af14c3 WatchSource:0}: Error finding container dad467770c530e2f83d51cc1f737e7a35d9372ddd2abf427b12df6ac40af14c3: Status 404 returned error can't find the container with id dad467770c530e2f83d51cc1f737e7a35d9372ddd2abf427b12df6ac40af14c3 Jul 31 21:25:41.218584 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:41.218570 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 21:25:41.251991 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:41.251973 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 31 21:25:41.307940 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:41.307923 2548 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 21:25:41.352098 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:41.352078 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 31 21:25:41.364329 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:41.364310 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 21:25:41.365183 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:41.365171 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 31 21:25:41.373409 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:41.373378 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 21:25:41.510943 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:41.510923 2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 21:25:42.035588 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.035558 2548 apiserver.go:52] "Watching apiserver" Jul 31 21:25:42.044597 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.044571 2548 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 31 21:25:42.045449 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.045422 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-ctskt","openshift-network-diagnostics/network-check-target-gtfwf","openshift-network-operator/iptables-alerter-hxgl5","openshift-ovn-kubernetes/ovnkube-node-gkjfh","kube-system/global-pull-secret-syncer-fvtj7","kube-system/konnectivity-agent-gx76h","kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8ww2z","openshift-dns/node-resolver-t7rln","openshift-image-registry/node-ca-gtjxs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal","openshift-multus/network-metrics-daemon-brfzt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77","openshift-multus/multus-additional-cni-plugins-4ns8z"] Jul 31 21:25:42.048153 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.048128 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gtjxs" Jul 31 21:25:42.050562 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.050544 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.051872 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.051846 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 31 21:25:42.052111 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.052098 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 31 21:25:42.052996 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.052965 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 31 21:25:42.053709 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.053693 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxgl5" Jul 31 21:25:42.054847 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.054830 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.055106 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.055087 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fkrbs\"" Jul 31 21:25:42.055338 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.055312 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 31 21:25:42.055529 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.055511 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 31 21:25:42.056127 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.055811 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 31 21:25:42.056127 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.055827 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2q58q\"" Jul 31 21:25:42.056127 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.055873 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 31 21:25:42.056310 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.056136 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 31 21:25:42.056950 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.056934 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 31 21:25:42.058422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.057193 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9mhnf\"" Jul 31 21:25:42.058422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.057406 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 31 21:25:42.058422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.057487 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:42.058422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.057653 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-65f5s\"" Jul 31 21:25:42.058422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.057728 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 31 21:25:42.058422 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.057800 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:25:42.058422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.058036 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 31 21:25:42.058422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.058054 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 31 21:25:42.058422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.058217 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 31 21:25:42.058422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.058263 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 31 21:25:42.059781 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.059715 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:25:42.061996 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.061980 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t7rln" Jul 31 21:25:42.064492 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.064458 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.066411 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.066393 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 31 21:25:42.066860 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.066843 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:42.066994 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.066975 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:25:42.067066 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067029 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-62nnq\"" Jul 31 21:25:42.067197 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067180 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 31 21:25:42.067257 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067243 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067422 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r8t46\"" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067597 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067761 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db9123c3-9566-4387-8b31-f4284932e130-ovnkube-script-lib\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067790 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067813 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-etc-openvswitch\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067834 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-kubelet\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067858 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5ee371d3-576a-413b-b19f-4849899c2559-serviceca\") pod \"node-ca-gtjxs\" (UID: \"5ee371d3-576a-413b-b19f-4849899c2559\") " pod="openshift-image-registry/node-ca-gtjxs" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067879 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc3a4cc9-865d-4454-ba46-211314e2ff66-host-slash\") pod \"iptables-alerter-hxgl5\" (UID: \"dc3a4cc9-865d-4454-ba46-211314e2ff66\") " pod="openshift-network-operator/iptables-alerter-hxgl5" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067897 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t82hk\" (UniqueName: \"kubernetes.io/projected/dc3a4cc9-865d-4454-ba46-211314e2ff66-kube-api-access-t82hk\") pod \"iptables-alerter-hxgl5\" (UID: \"dc3a4cc9-865d-4454-ba46-211314e2ff66\") " pod="openshift-network-operator/iptables-alerter-hxgl5" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067932 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-log-socket\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067950 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-cni-netd\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067874 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.067970 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db9123c3-9566-4387-8b31-f4284932e130-ovnkube-config\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068096 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db9123c3-9566-4387-8b31-f4284932e130-env-overrides\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068123 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ee371d3-576a-413b-b19f-4849899c2559-host\") pod \"node-ca-gtjxs\" (UID: \"5ee371d3-576a-413b-b19f-4849899c2559\") " pod="openshift-image-registry/node-ca-gtjxs" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068142 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pzhk\" (UniqueName: \"kubernetes.io/projected/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-kube-api-access-4pzhk\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068165 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-run-openvswitch\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.068532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068182 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-run-ovn\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068200 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-node-log\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068222 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068236 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-systemd-units\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068249 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-slash\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068267 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-run-systemd\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068285 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-var-lib-openvswitch\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068300 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068333 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-registration-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068370 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068398 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc3a4cc9-865d-4454-ba46-211314e2ff66-iptables-alerter-script\") pod \"iptables-alerter-hxgl5\" (UID: \"dc3a4cc9-865d-4454-ba46-211314e2ff66\") " pod="openshift-network-operator/iptables-alerter-hxgl5" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068429 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-cni-bin\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068452 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn84m\" (UniqueName: \"kubernetes.io/projected/db9123c3-9566-4387-8b31-f4284932e130-kube-api-access-zn84m\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068473 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-socket-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068495 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-device-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068537 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-sys-fs\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.069322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068565 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsd6b\" (UniqueName: \"kubernetes.io/projected/5ee371d3-576a-413b-b19f-4849899c2559-kube-api-access-rsd6b\") pod \"node-ca-gtjxs\" (UID: \"5ee371d3-576a-413b-b19f-4849899c2559\") " pod="openshift-image-registry/node-ca-gtjxs" Jul 31 21:25:42.069860 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068592 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-run-netns\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069860 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.068620 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db9123c3-9566-4387-8b31-f4284932e130-ovn-node-metrics-cert\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.069860 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.069362 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.070548 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.070531 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 31 21:25:42.070846 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.070829 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sjxls\"" Jul 31 21:25:42.072450 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.071056 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 31 21:25:42.072450 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.071235 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 31 21:25:42.072450 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.071389 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 31 21:25:42.072450 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.071599 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 31 21:25:42.072450 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.072039 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 31 21:25:42.072703 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.072553 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.072756 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.072738 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gb9sx\"" Jul 31 21:25:42.074362 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.074346 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:42.074444 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.074403 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:25:42.075114 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.075081 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qp955\"" Jul 31 21:25:42.075209 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.075151 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 31 21:25:42.075209 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.075166 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 31 21:25:42.075857 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.075842 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 21:25:42.089927 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.089682 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-26qqb" Jul 31 21:25:42.100786 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.100238 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-26qqb" Jul 31 21:25:42.154315 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.154293 2548 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 31 21:25:42.169660 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169630 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-systemd-units\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.169778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169669 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.169778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169699 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-cni-dir\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.169778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169723 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.169778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169746 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-cni-bin\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.169778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169756 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-systemd-units\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.169778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169768 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn84m\" (UniqueName: \"kubernetes.io/projected/db9123c3-9566-4387-8b31-f4284932e130-kube-api-access-zn84m\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169790 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169813 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-run-multus-certs\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169833 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-sysconfig\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169857 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-socket-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169879 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-device-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169880 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-etc-selinux\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169902 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-sys-fs\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169975 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsd6b\" (UniqueName: \"kubernetes.io/projected/5ee371d3-576a-413b-b19f-4849899c2559-kube-api-access-rsd6b\") pod \"node-ca-gtjxs\" (UID: \"5ee371d3-576a-413b-b19f-4849899c2559\") " pod="openshift-image-registry/node-ca-gtjxs" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.169985 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170023 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-cni-bin\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170032 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-device-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170132 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlk7r\" (UniqueName: \"kubernetes.io/projected/a359de99-657c-4c35-bf34-31ef06ddfbc6-kube-api-access-xlk7r\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170188 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzx2t\" (UniqueName: \"kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t\") pod \"network-check-target-gtfwf\" (UID: \"9d995d78-dace-4279-862a-662597743d1c\") " pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170195 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-socket-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170216 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-hostroot\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.170244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170250 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-sys-fs\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170260 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-host\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170292 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-run-netns\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170320 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db9123c3-9566-4387-8b31-f4284932e130-ovn-node-metrics-cert\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170345 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db9123c3-9566-4387-8b31-f4284932e130-ovnkube-script-lib\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170368 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1031a481-42de-4ba5-9e2f-bdd966129034-etc-tuned\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170389 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170400 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-run-netns\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170474 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170406 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-socket-dir-parent\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170502 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-var-lib-kubelet\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170520 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-run\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170534 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1031a481-42de-4ba5-9e2f-bdd966129034-tmp\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170556 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxslw\" (UniqueName: \"kubernetes.io/projected/1031a481-42de-4ba5-9e2f-bdd966129034-kube-api-access-mxslw\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170599 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-kubelet\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170628 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-kubelet-config\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170645 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d66c8d3-47f5-4b6f-bc26-61372efd4add-agent-certs\") pod \"konnectivity-agent-gx76h\" (UID: \"5d66c8d3-47f5-4b6f-bc26-61372efd4add\") " pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:25:42.170936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170670 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-cnibin\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170693 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-var-lib-cni-bin\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170699 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-kubelet\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170714 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc3a4cc9-865d-4454-ba46-211314e2ff66-host-slash\") pod \"iptables-alerter-hxgl5\" (UID: \"dc3a4cc9-865d-4454-ba46-211314e2ff66\") " pod="openshift-network-operator/iptables-alerter-hxgl5" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170742 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t82hk\" (UniqueName: \"kubernetes.io/projected/dc3a4cc9-865d-4454-ba46-211314e2ff66-kube-api-access-t82hk\") pod \"iptables-alerter-hxgl5\" (UID: \"dc3a4cc9-865d-4454-ba46-211314e2ff66\") " pod="openshift-network-operator/iptables-alerter-hxgl5" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170763 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-log-socket\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170783 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc3a4cc9-865d-4454-ba46-211314e2ff66-host-slash\") pod \"iptables-alerter-hxgl5\" (UID: \"dc3a4cc9-865d-4454-ba46-211314e2ff66\") " pod="openshift-network-operator/iptables-alerter-hxgl5" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170791 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db9123c3-9566-4387-8b31-f4284932e130-env-overrides\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170816 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a782591-1f18-4512-b13c-8e1e8f522b75-hosts-file\") pod \"node-resolver-t7rln\" (UID: \"7a782591-1f18-4512-b13c-8e1e8f522b75\") " pod="openshift-dns/node-resolver-t7rln" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170842 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-conf-dir\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170846 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-log-socket\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170864 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-systemd\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170884 2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170928 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/768ae4f9-da78-48e2-bbea-ec89315b45b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170958 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-run-openvswitch\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.170992 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-run-ovn\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171009 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-run-openvswitch\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.171535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171019 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-node-log\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171042 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171046 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-run-ovn\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171070 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171083 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-node-log\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171096 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-os-release\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171117 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171120 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-etc-kubernetes\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171151 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc9ql\" (UniqueName: \"kubernetes.io/projected/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-kube-api-access-fc9ql\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171176 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-slash\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171215 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-slash\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171246 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-run-systemd\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171270 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-var-lib-openvswitch\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171291 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-run-k8s-cni-cncf-io\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171330 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-run-systemd\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171339 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-var-lib-openvswitch\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171357 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-daemon-config\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.172295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171383 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-sysctl-d\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171407 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171443 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-registration-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171466 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc3a4cc9-865d-4454-ba46-211314e2ff66-iptables-alerter-script\") pod \"iptables-alerter-hxgl5\" (UID: \"dc3a4cc9-865d-4454-ba46-211314e2ff66\") " pod="openshift-network-operator/iptables-alerter-hxgl5" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171486 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-cnibin\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171508 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-os-release\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171531 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-registration-dir\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171532 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlsvp\" (UniqueName: \"kubernetes.io/projected/768ae4f9-da78-48e2-bbea-ec89315b45b3-kube-api-access-xlsvp\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171649 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db9123c3-9566-4387-8b31-f4284932e130-env-overrides\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171653 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a782591-1f18-4512-b13c-8e1e8f522b75-tmp-dir\") pod \"node-resolver-t7rln\" (UID: \"7a782591-1f18-4512-b13c-8e1e8f522b75\") " pod="openshift-dns/node-resolver-t7rln" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171703 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db9123c3-9566-4387-8b31-f4284932e130-ovnkube-script-lib\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171725 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbhft\" (UniqueName: \"kubernetes.io/projected/7a782591-1f18-4512-b13c-8e1e8f522b75-kube-api-access-xbhft\") pod \"node-resolver-t7rln\" (UID: \"7a782591-1f18-4512-b13c-8e1e8f522b75\") " pod="openshift-dns/node-resolver-t7rln" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171775 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-cni-binary-copy\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171808 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-modprobe-d\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171832 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-kubernetes\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171856 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-sysctl-conf\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.173181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171881 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-var-lib-kubelet\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171936 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-etc-openvswitch\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171962 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-system-cni-dir\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.171990 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-system-cni-dir\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172029 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-etc-openvswitch\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172043 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc3a4cc9-865d-4454-ba46-211314e2ff66-iptables-alerter-script\") pod \"iptables-alerter-hxgl5\" (UID: \"dc3a4cc9-865d-4454-ba46-211314e2ff66\") " pod="openshift-network-operator/iptables-alerter-hxgl5" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172062 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/768ae4f9-da78-48e2-bbea-ec89315b45b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172083 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5ee371d3-576a-413b-b19f-4849899c2559-serviceca\") pod \"node-ca-gtjxs\" (UID: \"5ee371d3-576a-413b-b19f-4849899c2559\") " pod="openshift-image-registry/node-ca-gtjxs" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172103 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-var-lib-cni-multus\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172122 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-sys\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172137 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-cni-netd\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172175 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db9123c3-9566-4387-8b31-f4284932e130-host-cni-netd\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172257 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db9123c3-9566-4387-8b31-f4284932e130-ovnkube-config\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172281 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ee371d3-576a-413b-b19f-4849899c2559-host\") pod \"node-ca-gtjxs\" (UID: \"5ee371d3-576a-413b-b19f-4849899c2559\") " pod="openshift-image-registry/node-ca-gtjxs" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172300 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-lib-modules\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172324 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pzhk\" (UniqueName: \"kubernetes.io/projected/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-kube-api-access-4pzhk\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172513 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5ee371d3-576a-413b-b19f-4849899c2559-serviceca\") pod \"node-ca-gtjxs\" (UID: \"5ee371d3-576a-413b-b19f-4849899c2559\") " pod="openshift-image-registry/node-ca-gtjxs" Jul 31 21:25:42.173848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172564 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ee371d3-576a-413b-b19f-4849899c2559-host\") pod \"node-ca-gtjxs\" (UID: \"5ee371d3-576a-413b-b19f-4849899c2559\") " pod="openshift-image-registry/node-ca-gtjxs" Jul 31 21:25:42.174591 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172650 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-dbus\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:42.174591 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172679 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d66c8d3-47f5-4b6f-bc26-61372efd4add-konnectivity-ca\") pod \"konnectivity-agent-gx76h\" (UID: \"5d66c8d3-47f5-4b6f-bc26-61372efd4add\") " pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:25:42.174591 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172701 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-run-netns\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.174591 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172724 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/768ae4f9-da78-48e2-bbea-ec89315b45b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.174591 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.172778 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db9123c3-9566-4387-8b31-f4284932e130-ovnkube-config\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.174591 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.174572 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" event={"ID":"943fee120611b8344761cc8b938b1537","Type":"ContainerStarted","Data":"bf4431ae712258bae7f03508c61d5425576e2a421a80dca5e5bcfe803deeae92"} Jul 31 21:25:42.175877 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.175852 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" event={"ID":"bf037baff33e107bd6b6137eaa0bdb4e","Type":"ContainerStarted","Data":"dad467770c530e2f83d51cc1f737e7a35d9372ddd2abf427b12df6ac40af14c3"} Jul 31 21:25:42.176453 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.176231 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db9123c3-9566-4387-8b31-f4284932e130-ovn-node-metrics-cert\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.182145 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.182119 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn84m\" (UniqueName: \"kubernetes.io/projected/db9123c3-9566-4387-8b31-f4284932e130-kube-api-access-zn84m\") pod \"ovnkube-node-gkjfh\" (UID: \"db9123c3-9566-4387-8b31-f4284932e130\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.182231 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.182201 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t82hk\" (UniqueName: \"kubernetes.io/projected/dc3a4cc9-865d-4454-ba46-211314e2ff66-kube-api-access-t82hk\") pod \"iptables-alerter-hxgl5\" (UID: \"dc3a4cc9-865d-4454-ba46-211314e2ff66\") " pod="openshift-network-operator/iptables-alerter-hxgl5" Jul 31 21:25:42.183793 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.183774 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsd6b\" (UniqueName: \"kubernetes.io/projected/5ee371d3-576a-413b-b19f-4849899c2559-kube-api-access-rsd6b\") pod \"node-ca-gtjxs\" (UID: \"5ee371d3-576a-413b-b19f-4849899c2559\") " pod="openshift-image-registry/node-ca-gtjxs" Jul 31 21:25:42.184415 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.184398 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pzhk\" (UniqueName: \"kubernetes.io/projected/55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4-kube-api-access-4pzhk\") pod \"aws-ebs-csi-driver-node-7dk77\" (UID: \"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.273661 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273629 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-host\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.273794 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273669 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1031a481-42de-4ba5-9e2f-bdd966129034-etc-tuned\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.273794 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273694 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-socket-dir-parent\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.273794 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273719 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-var-lib-kubelet\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.273794 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273741 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-run\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.273794 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273747 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-host\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.273794 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273763 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1031a481-42de-4ba5-9e2f-bdd966129034-tmp\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.273794 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273786 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxslw\" (UniqueName: \"kubernetes.io/projected/1031a481-42de-4ba5-9e2f-bdd966129034-kube-api-access-mxslw\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273803 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-var-lib-kubelet\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273826 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-kubelet-config\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273851 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d66c8d3-47f5-4b6f-bc26-61372efd4add-agent-certs\") pod \"konnectivity-agent-gx76h\" (UID: \"5d66c8d3-47f5-4b6f-bc26-61372efd4add\") " pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273856 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-socket-dir-parent\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273876 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-cnibin\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273899 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-var-lib-cni-bin\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273902 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-run\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273944 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a782591-1f18-4512-b13c-8e1e8f522b75-hosts-file\") pod \"node-resolver-t7rln\" (UID: \"7a782591-1f18-4512-b13c-8e1e8f522b75\") " pod="openshift-dns/node-resolver-t7rln" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273970 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-conf-dir\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273983 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-cnibin\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.273992 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-systemd\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274016 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/768ae4f9-da78-48e2-bbea-ec89315b45b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274044 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274073 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-os-release\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274095 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-etc-kubernetes\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274144 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274129 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc9ql\" (UniqueName: \"kubernetes.io/projected/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-kube-api-access-fc9ql\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274147 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-kubelet-config\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274159 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-run-k8s-cni-cncf-io\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274171 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-var-lib-cni-bin\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274200 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-daemon-config\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274130 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a782591-1f18-4512-b13c-8e1e8f522b75-hosts-file\") pod \"node-resolver-t7rln\" (UID: \"7a782591-1f18-4512-b13c-8e1e8f522b75\") " pod="openshift-dns/node-resolver-t7rln" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274298 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-os-release\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274306 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-run-k8s-cni-cncf-io\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274324 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-etc-kubernetes\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274334 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-conf-dir\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274416 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-systemd\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274449 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-sysctl-d\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274612 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.274667 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:42.274824 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.274778 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret podName:fe28664a-22c1-4e57-aac2-08f4b0cc7d14 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:42.774756066 +0000 UTC m=+3.008988096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret") pod "global-pull-secret-syncer-fvtj7" (UID: "fe28664a-22c1-4e57-aac2-08f4b0cc7d14") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:42.275359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274840 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-sysctl-d\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.275359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274869 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/768ae4f9-da78-48e2-bbea-ec89315b45b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.275359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.274967 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-cnibin\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.275359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.275010 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-os-release\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.275359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.275037 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlsvp\" (UniqueName: \"kubernetes.io/projected/768ae4f9-da78-48e2-bbea-ec89315b45b3-kube-api-access-xlsvp\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.275359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.275070 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.275359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.275102 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-os-release\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.275359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.275174 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-daemon-config\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.275359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.275237 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-cnibin\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.275359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.275203 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a782591-1f18-4512-b13c-8e1e8f522b75-tmp-dir\") pod \"node-resolver-t7rln\" (UID: \"7a782591-1f18-4512-b13c-8e1e8f522b75\") " pod="openshift-dns/node-resolver-t7rln" Jul 31 21:25:42.275359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.275315 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbhft\" (UniqueName: \"kubernetes.io/projected/7a782591-1f18-4512-b13c-8e1e8f522b75-kube-api-access-xbhft\") pod \"node-resolver-t7rln\" (UID: \"7a782591-1f18-4512-b13c-8e1e8f522b75\") " pod="openshift-dns/node-resolver-t7rln" Jul 31 21:25:42.275778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.275368 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-cni-binary-copy\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.275437 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-modprobe-d\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277200 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-kubernetes\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277250 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-sysctl-conf\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277286 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-var-lib-kubelet\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277320 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-system-cni-dir\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277348 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-system-cni-dir\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277403 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/768ae4f9-da78-48e2-bbea-ec89315b45b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277461 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-var-lib-cni-multus\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277471 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a782591-1f18-4512-b13c-8e1e8f522b75-tmp-dir\") pod \"node-resolver-t7rln\" (UID: \"7a782591-1f18-4512-b13c-8e1e8f522b75\") " pod="openshift-dns/node-resolver-t7rln" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277506 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-sys\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277561 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-lib-modules\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277572 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-sys\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277596 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-dbus\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277653 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-modprobe-d\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277810 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-kubernetes\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.277932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277900 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-sysctl-conf\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.278791 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.277996 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-var-lib-kubelet\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.278791 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.278072 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-system-cni-dir\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.278791 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.278173 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/768ae4f9-da78-48e2-bbea-ec89315b45b3-system-cni-dir\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.278791 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.278409 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1031a481-42de-4ba5-9e2f-bdd966129034-tmp\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.278791 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.278643 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1031a481-42de-4ba5-9e2f-bdd966129034-etc-tuned\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.279070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.278839 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/768ae4f9-da78-48e2-bbea-ec89315b45b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.279070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.278939 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-dbus\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:42.279070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.278936 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-var-lib-cni-multus\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.279237 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279110 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-cni-binary-copy\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.279237 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279212 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-lib-modules\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.279237 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279229 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d66c8d3-47f5-4b6f-bc26-61372efd4add-konnectivity-ca\") pod \"konnectivity-agent-gx76h\" (UID: \"5d66c8d3-47f5-4b6f-bc26-61372efd4add\") " pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:25:42.279406 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279383 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-run-netns\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.279510 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279426 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/768ae4f9-da78-48e2-bbea-ec89315b45b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.279510 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279458 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-cni-dir\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.279510 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279486 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:42.279715 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279514 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-run-multus-certs\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.279715 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279544 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-sysconfig\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.279715 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279575 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlk7r\" (UniqueName: \"kubernetes.io/projected/a359de99-657c-4c35-bf34-31ef06ddfbc6-kube-api-access-xlk7r\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:42.279715 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279601 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzx2t\" (UniqueName: \"kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t\") pod \"network-check-target-gtfwf\" (UID: \"9d995d78-dace-4279-862a-662597743d1c\") " pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:42.279715 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279632 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-hostroot\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.279971 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279711 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-hostroot\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.279971 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279741 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d66c8d3-47f5-4b6f-bc26-61372efd4add-agent-certs\") pod \"konnectivity-agent-gx76h\" (UID: \"5d66c8d3-47f5-4b6f-bc26-61372efd4add\") " pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:25:42.279971 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279760 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-run-netns\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.279971 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.279831 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1031a481-42de-4ba5-9e2f-bdd966129034-etc-sysconfig\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.280193 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.280173 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-multus-cni-dir\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.280314 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.280298 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:42.280367 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.280332 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/768ae4f9-da78-48e2-bbea-ec89315b45b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.280453 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.280407 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-host-run-multus-certs\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.280649 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.280635 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs podName:a359de99-657c-4c35-bf34-31ef06ddfbc6 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:42.780615465 +0000 UTC m=+3.014847494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs") pod "network-metrics-daemon-brfzt" (UID: "a359de99-657c-4c35-bf34-31ef06ddfbc6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:42.282192 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.282153 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d66c8d3-47f5-4b6f-bc26-61372efd4add-konnectivity-ca\") pod \"konnectivity-agent-gx76h\" (UID: \"5d66c8d3-47f5-4b6f-bc26-61372efd4add\") " pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:25:42.283511 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.283494 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc9ql\" (UniqueName: \"kubernetes.io/projected/ed93ff1d-8caf-444e-a7b9-70bd146a7f59-kube-api-access-fc9ql\") pod \"multus-ctskt\" (UID: \"ed93ff1d-8caf-444e-a7b9-70bd146a7f59\") " pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.284126 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.284100 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxslw\" (UniqueName: \"kubernetes.io/projected/1031a481-42de-4ba5-9e2f-bdd966129034-kube-api-access-mxslw\") pod \"tuned-8ww2z\" (UID: \"1031a481-42de-4ba5-9e2f-bdd966129034\") " pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.290740 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.290691 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:25:42.290740 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.290713 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:25:42.290740 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.290722 2548 projected.go:196] Error preparing data for projected volume kube-api-access-lzx2t for pod openshift-network-diagnostics/network-check-target-gtfwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:42.290938 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.290767 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t podName:9d995d78-dace-4279-862a-662597743d1c nodeName:}" failed. No retries permitted until 2026-07-31 21:25:42.790753319 +0000 UTC m=+3.024985356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lzx2t" (UniqueName: "kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t") pod "network-check-target-gtfwf" (UID: "9d995d78-dace-4279-862a-662597743d1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:42.292251 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.292226 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlsvp\" (UniqueName: \"kubernetes.io/projected/768ae4f9-da78-48e2-bbea-ec89315b45b3-kube-api-access-xlsvp\") pod \"multus-additional-cni-plugins-4ns8z\" (UID: \"768ae4f9-da78-48e2-bbea-ec89315b45b3\") " pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.293673 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.293652 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbhft\" (UniqueName: \"kubernetes.io/projected/7a782591-1f18-4512-b13c-8e1e8f522b75-kube-api-access-xbhft\") pod \"node-resolver-t7rln\" (UID: \"7a782591-1f18-4512-b13c-8e1e8f522b75\") " pod="openshift-dns/node-resolver-t7rln" Jul 31 21:25:42.293779 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.293764 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlk7r\" (UniqueName: \"kubernetes.io/projected/a359de99-657c-4c35-bf34-31ef06ddfbc6-kube-api-access-xlk7r\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:42.356786 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.356759 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 21:25:42.376024 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.376002 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gtjxs" Jul 31 21:25:42.385104 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.385085 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" Jul 31 21:25:42.394654 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.394638 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxgl5" Jul 31 21:25:42.403455 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.403428 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:25:42.414182 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.414159 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:25:42.423188 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.423166 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t7rln" Jul 31 21:25:42.431653 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.431636 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4ns8z" Jul 31 21:25:42.439388 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.439372 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ctskt" Jul 31 21:25:42.445975 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.445956 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" Jul 31 21:25:42.782462 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.782378 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:42.782462 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.782447 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:42.782666 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.782525 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:42.782666 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.782551 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:42.782666 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.782596 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs podName:a359de99-657c-4c35-bf34-31ef06ddfbc6 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:43.782577692 +0000 UTC m=+4.016809724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs") pod "network-metrics-daemon-brfzt" (UID: "a359de99-657c-4c35-bf34-31ef06ddfbc6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:42.782666 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.782614 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret podName:fe28664a-22c1-4e57-aac2-08f4b0cc7d14 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:43.782605424 +0000 UTC m=+4.016837441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret") pod "global-pull-secret-syncer-fvtj7" (UID: "fe28664a-22c1-4e57-aac2-08f4b0cc7d14") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:42.883229 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:42.883192 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzx2t\" (UniqueName: \"kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t\") pod \"network-check-target-gtfwf\" (UID: \"9d995d78-dace-4279-862a-662597743d1c\") " pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:42.883409 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.883395 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:25:42.883471 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.883420 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:25:42.883471 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.883434 2548 projected.go:196] Error preparing data for projected volume kube-api-access-lzx2t for pod openshift-network-diagnostics/network-check-target-gtfwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:42.883567 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:42.883499 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t podName:9d995d78-dace-4279-862a-662597743d1c nodeName:}" failed. No retries permitted until 2026-07-31 21:25:43.883486542 +0000 UTC m=+4.117718559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzx2t" (UniqueName: "kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t") pod "network-check-target-gtfwf" (UID: "9d995d78-dace-4279-862a-662597743d1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:43.105357 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:43.105275 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:20:42 +0000 UTC" deadline="2028-03-22 04:55:06.121445206 +0000 UTC" Jul 31 21:25:43.105357 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:43.105303 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14383h29m23.01614549s" Jul 31 21:25:43.264017 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:43.263987 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee371d3_576a_413b_b19f_4849899c2559.slice/crio-1c758ef50c77cb0c285808c4a0a83578444a7e272c45e14cd9714f84846aba56 WatchSource:0}: Error finding container 1c758ef50c77cb0c285808c4a0a83578444a7e272c45e14cd9714f84846aba56: Status 404 returned error can't find the container with id 1c758ef50c77cb0c285808c4a0a83578444a7e272c45e14cd9714f84846aba56 Jul 31 21:25:43.270024 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:43.269996 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d66c8d3_47f5_4b6f_bc26_61372efd4add.slice/crio-5804b6b291b4a6fb69d881e60236eecaeb46c6f35d50c70e72ea0773da75c313 WatchSource:0}: Error finding container 5804b6b291b4a6fb69d881e60236eecaeb46c6f35d50c70e72ea0773da75c313: Status 404 returned error can't find the container with id 5804b6b291b4a6fb69d881e60236eecaeb46c6f35d50c70e72ea0773da75c313 Jul 31 21:25:43.272405 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:43.272380 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9123c3_9566_4387_8b31_f4284932e130.slice/crio-75e20a73e6e23fff78ec77b5bb8784d668eec0089fe7f8dab10cec4fd3cf9bea WatchSource:0}: Error finding container 75e20a73e6e23fff78ec77b5bb8784d668eec0089fe7f8dab10cec4fd3cf9bea: Status 404 returned error can't find the container with id 75e20a73e6e23fff78ec77b5bb8784d668eec0089fe7f8dab10cec4fd3cf9bea Jul 31 21:25:43.276338 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:43.276322 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55142aa0_6141_4e5a_b76c_d2fb6dfcfcf4.slice/crio-c4fd8c53f8aaead54d6ab4cd91d6ad91c8e6dc55564f011cbd3b618300ca7fec WatchSource:0}: Error finding container c4fd8c53f8aaead54d6ab4cd91d6ad91c8e6dc55564f011cbd3b618300ca7fec: Status 404 returned error can't find the container with id c4fd8c53f8aaead54d6ab4cd91d6ad91c8e6dc55564f011cbd3b618300ca7fec Jul 31 21:25:43.296231 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:43.296203 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a782591_1f18_4512_b13c_8e1e8f522b75.slice/crio-fb27c6015440e27fc4749ff1cd09f60eab559d9867e52e7273a25bdb9185be90 WatchSource:0}: Error finding container fb27c6015440e27fc4749ff1cd09f60eab559d9867e52e7273a25bdb9185be90: Status 404 returned error can't find the container with id fb27c6015440e27fc4749ff1cd09f60eab559d9867e52e7273a25bdb9185be90 Jul 31 21:25:43.296748 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:43.296705 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768ae4f9_da78_48e2_bbea_ec89315b45b3.slice/crio-ed52df0aa8630556e07dc8c06276ac28c8d8812ebb295e7cb6ee766862a0a951 WatchSource:0}: Error finding container ed52df0aa8630556e07dc8c06276ac28c8d8812ebb295e7cb6ee766862a0a951: Status 404 returned error can't find the container with id ed52df0aa8630556e07dc8c06276ac28c8d8812ebb295e7cb6ee766862a0a951 Jul 31 21:25:43.297728 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:43.297699 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3a4cc9_865d_4454_ba46_211314e2ff66.slice/crio-cd3b20b294e77029fbf28baaaca9f449084a095c505304253c326945324d68e3 WatchSource:0}: Error finding container cd3b20b294e77029fbf28baaaca9f449084a095c505304253c326945324d68e3: Status 404 returned error can't find the container with id cd3b20b294e77029fbf28baaaca9f449084a095c505304253c326945324d68e3 Jul 31 21:25:43.298740 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:43.298612 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1031a481_42de_4ba5_9e2f_bdd966129034.slice/crio-070f561969259afd0b8649b62b2e674025668b0cb4b631395bb9ef51a40d9278 WatchSource:0}: Error finding container 070f561969259afd0b8649b62b2e674025668b0cb4b631395bb9ef51a40d9278: Status 404 returned error can't find the container with id 070f561969259afd0b8649b62b2e674025668b0cb4b631395bb9ef51a40d9278 Jul 31 21:25:43.304676 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:25:43.304649 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded93ff1d_8caf_444e_a7b9_70bd146a7f59.slice/crio-143deb432f439c06a0502782bd98f857112ebb2802e25c4f0f608fd2c7ee2e61 WatchSource:0}: Error finding container 143deb432f439c06a0502782bd98f857112ebb2802e25c4f0f608fd2c7ee2e61: Status 404 returned error can't find the container with id 143deb432f439c06a0502782bd98f857112ebb2802e25c4f0f608fd2c7ee2e61 Jul 31 21:25:43.791119 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:43.790418 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:43.791119 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:43.790476 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:43.791119 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:43.790590 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:43.791119 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:43.790655 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs podName:a359de99-657c-4c35-bf34-31ef06ddfbc6 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:45.790635698 +0000 UTC m=+6.024867735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs") pod "network-metrics-daemon-brfzt" (UID: "a359de99-657c-4c35-bf34-31ef06ddfbc6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:43.791119 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:43.791005 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:43.791119 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:43.791055 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret podName:fe28664a-22c1-4e57-aac2-08f4b0cc7d14 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:45.791040662 +0000 UTC m=+6.025272683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret") pod "global-pull-secret-syncer-fvtj7" (UID: "fe28664a-22c1-4e57-aac2-08f4b0cc7d14") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:43.892686 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:43.892649 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzx2t\" (UniqueName: \"kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t\") pod \"network-check-target-gtfwf\" (UID: \"9d995d78-dace-4279-862a-662597743d1c\") " pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:43.892869 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:43.892851 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:25:43.892951 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:43.892879 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:25:43.892951 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:43.892892 2548 projected.go:196] Error preparing data for projected volume kube-api-access-lzx2t for pod openshift-network-diagnostics/network-check-target-gtfwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:43.893063 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:43.892966 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t podName:9d995d78-dace-4279-862a-662597743d1c nodeName:}" failed. No retries permitted until 2026-07-31 21:25:45.89294789 +0000 UTC m=+6.127179924 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzx2t" (UniqueName: "kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t") pod "network-check-target-gtfwf" (UID: "9d995d78-dace-4279-862a-662597743d1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:44.105511 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.105403 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:20:42 +0000 UTC" deadline="2028-01-01 21:55:07.063588239 +0000 UTC" Jul 31 21:25:44.105511 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.105440 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12456h29m22.958153101s" Jul 31 21:25:44.173117 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.173091 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:44.173269 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:44.173216 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:25:44.173618 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.173587 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:44.173708 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:44.173689 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:25:44.173769 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.173750 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:44.173835 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:44.173818 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:25:44.197105 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.196691 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" event={"ID":"bf037baff33e107bd6b6137eaa0bdb4e","Type":"ContainerStarted","Data":"fd3c96f25b1f0f6db0552daa6b3a6d6afa55b50d3905b55b1021d01bbe34df68"} Jul 31 21:25:44.203614 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.203587 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ctskt" event={"ID":"ed93ff1d-8caf-444e-a7b9-70bd146a7f59","Type":"ContainerStarted","Data":"143deb432f439c06a0502782bd98f857112ebb2802e25c4f0f608fd2c7ee2e61"} Jul 31 21:25:44.206716 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.206694 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" event={"ID":"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4","Type":"ContainerStarted","Data":"c4fd8c53f8aaead54d6ab4cd91d6ad91c8e6dc55564f011cbd3b618300ca7fec"} Jul 31 21:25:44.211705 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.211684 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gtjxs" event={"ID":"5ee371d3-576a-413b-b19f-4849899c2559","Type":"ContainerStarted","Data":"1c758ef50c77cb0c285808c4a0a83578444a7e272c45e14cd9714f84846aba56"} Jul 31 21:25:44.211804 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.211673 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" podStartSLOduration=3.211653358 podStartE2EDuration="3.211653358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:25:44.211109115 +0000 UTC m=+4.445341154" watchObservedRunningTime="2026-07-31 21:25:44.211653358 +0000 UTC m=+4.445885399" Jul 31 21:25:44.236332 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.236303 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t7rln" event={"ID":"7a782591-1f18-4512-b13c-8e1e8f522b75","Type":"ContainerStarted","Data":"fb27c6015440e27fc4749ff1cd09f60eab559d9867e52e7273a25bdb9185be90"} Jul 31 21:25:44.240431 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.240403 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" event={"ID":"1031a481-42de-4ba5-9e2f-bdd966129034","Type":"ContainerStarted","Data":"070f561969259afd0b8649b62b2e674025668b0cb4b631395bb9ef51a40d9278"} Jul 31 21:25:44.243421 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.243396 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxgl5" event={"ID":"dc3a4cc9-865d-4454-ba46-211314e2ff66","Type":"ContainerStarted","Data":"cd3b20b294e77029fbf28baaaca9f449084a095c505304253c326945324d68e3"} Jul 31 21:25:44.250260 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.250223 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ns8z" event={"ID":"768ae4f9-da78-48e2-bbea-ec89315b45b3","Type":"ContainerStarted","Data":"ed52df0aa8630556e07dc8c06276ac28c8d8812ebb295e7cb6ee766862a0a951"} Jul 31 21:25:44.267432 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.267401 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" event={"ID":"db9123c3-9566-4387-8b31-f4284932e130","Type":"ContainerStarted","Data":"75e20a73e6e23fff78ec77b5bb8784d668eec0089fe7f8dab10cec4fd3cf9bea"} Jul 31 21:25:44.276231 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.276206 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gx76h" event={"ID":"5d66c8d3-47f5-4b6f-bc26-61372efd4add","Type":"ContainerStarted","Data":"5804b6b291b4a6fb69d881e60236eecaeb46c6f35d50c70e72ea0773da75c313"} Jul 31 21:25:44.283410 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.283385 2548 generic.go:356] "Generic (PLEG): container finished" podID="943fee120611b8344761cc8b938b1537" containerID="d876ec42af096730d0c29e634ac8659e7e6176d5b9f8cf0d7ba17e046464da82" exitCode=0 Jul 31 21:25:44.283502 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:44.283422 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" event={"ID":"943fee120611b8344761cc8b938b1537","Type":"ContainerDied","Data":"d876ec42af096730d0c29e634ac8659e7e6176d5b9f8cf0d7ba17e046464da82"} Jul 31 21:25:45.309875 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:45.309836 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" event={"ID":"943fee120611b8344761cc8b938b1537","Type":"ContainerStarted","Data":"31bace2e88f7cf6de6e8ed964cf2668d30fdd0d40aed7e46b267e581805866f8"} Jul 31 21:25:45.324429 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:45.323854 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" podStartSLOduration=4.3238385919999995 podStartE2EDuration="4.323838592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:25:45.323588171 +0000 UTC m=+5.557820211" watchObservedRunningTime="2026-07-31 21:25:45.323838592 +0000 UTC m=+5.558070632" Jul 31 21:25:45.808462 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:45.808385 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:45.808608 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:45.808463 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:45.808608 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:45.808585 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:45.808693 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:45.808643 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret podName:fe28664a-22c1-4e57-aac2-08f4b0cc7d14 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:49.808626136 +0000 UTC m=+10.042858161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret") pod "global-pull-secret-syncer-fvtj7" (UID: "fe28664a-22c1-4e57-aac2-08f4b0cc7d14") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:45.808848 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:45.808746 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:45.808848 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:45.808795 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs podName:a359de99-657c-4c35-bf34-31ef06ddfbc6 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:49.808781189 +0000 UTC m=+10.043013207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs") pod "network-metrics-daemon-brfzt" (UID: "a359de99-657c-4c35-bf34-31ef06ddfbc6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:45.909502 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:45.909465 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzx2t\" (UniqueName: \"kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t\") pod \"network-check-target-gtfwf\" (UID: \"9d995d78-dace-4279-862a-662597743d1c\") " pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:45.909668 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:45.909650 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:25:45.909712 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:45.909704 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:25:45.909751 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:45.909718 2548 projected.go:196] Error preparing data for projected volume kube-api-access-lzx2t for pod openshift-network-diagnostics/network-check-target-gtfwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:45.909801 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:45.909775 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t podName:9d995d78-dace-4279-862a-662597743d1c nodeName:}" failed. No retries permitted until 2026-07-31 21:25:49.909757356 +0000 UTC m=+10.143989389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzx2t" (UniqueName: "kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t") pod "network-check-target-gtfwf" (UID: "9d995d78-dace-4279-862a-662597743d1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:46.171186 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:46.171107 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:46.171334 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:46.171251 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:25:46.171666 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:46.171645 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:46.171812 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:46.171765 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:25:46.171892 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:46.171823 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:46.171962 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:46.171888 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:25:48.169498 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:48.169470 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:48.169900 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:48.169598 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:48.169900 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:48.169604 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:25:48.169900 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:48.169704 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:25:48.169900 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:48.169478 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:48.169900 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:48.169814 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:25:49.841239 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:49.841201 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:49.841691 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:49.841275 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:49.841691 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:49.841380 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:49.841691 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:49.841432 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:49.841691 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:49.841454 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs podName:a359de99-657c-4c35-bf34-31ef06ddfbc6 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:57.841432417 +0000 UTC m=+18.075664448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs") pod "network-metrics-daemon-brfzt" (UID: "a359de99-657c-4c35-bf34-31ef06ddfbc6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:49.841691 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:49.841487 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret podName:fe28664a-22c1-4e57-aac2-08f4b0cc7d14 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:57.841472402 +0000 UTC m=+18.075704423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret") pod "global-pull-secret-syncer-fvtj7" (UID: "fe28664a-22c1-4e57-aac2-08f4b0cc7d14") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:49.942520 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:49.941954 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzx2t\" (UniqueName: \"kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t\") pod \"network-check-target-gtfwf\" (UID: \"9d995d78-dace-4279-862a-662597743d1c\") " pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:49.942520 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:49.942143 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:25:49.942520 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:49.942162 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:25:49.942520 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:49.942173 2548 projected.go:196] Error preparing data for projected volume kube-api-access-lzx2t for pod openshift-network-diagnostics/network-check-target-gtfwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:49.942520 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:49.942222 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t podName:9d995d78-dace-4279-862a-662597743d1c nodeName:}" failed. No retries permitted until 2026-07-31 21:25:57.942205562 +0000 UTC m=+18.176437585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzx2t" (UniqueName: "kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t") pod "network-check-target-gtfwf" (UID: "9d995d78-dace-4279-862a-662597743d1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:50.170625 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:50.169900 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:50.170625 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:50.170043 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:25:50.170625 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:50.170432 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:50.170625 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:50.170519 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:25:50.170938 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:50.170663 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:50.170938 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:50.170748 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:25:52.170394 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:52.169735 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:52.170394 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:52.169864 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:25:52.170394 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:52.170167 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:52.170394 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:52.170259 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:25:52.170394 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:52.170300 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:52.170394 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:52.170362 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:25:54.169508 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:54.169423 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:54.169850 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:54.169422 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:54.169850 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:54.169561 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:54.169850 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:54.169558 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:25:54.169850 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:54.169670 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:25:54.169850 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:54.169730 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:25:56.169287 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:56.169256 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:56.169674 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:56.169259 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:56.169674 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:56.169391 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:25:56.169674 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:56.169462 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:25:56.169674 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:56.169259 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:56.169674 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:56.169551 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:25:57.907140 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:57.907108 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:57.907575 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:57.907169 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:57.907575 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:57.907248 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:57.907575 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:57.907264 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:57.907575 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:57.907315 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret podName:fe28664a-22c1-4e57-aac2-08f4b0cc7d14 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:13.907302557 +0000 UTC m=+34.141534586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret") pod "global-pull-secret-syncer-fvtj7" (UID: "fe28664a-22c1-4e57-aac2-08f4b0cc7d14") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:57.907575 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:57.907330 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs podName:a359de99-657c-4c35-bf34-31ef06ddfbc6 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:13.907323606 +0000 UTC m=+34.141555627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs") pod "network-metrics-daemon-brfzt" (UID: "a359de99-657c-4c35-bf34-31ef06ddfbc6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:58.008068 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:58.008033 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzx2t\" (UniqueName: \"kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t\") pod \"network-check-target-gtfwf\" (UID: \"9d995d78-dace-4279-862a-662597743d1c\") " pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:58.008236 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:58.008183 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:25:58.008236 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:58.008210 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:25:58.008236 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:58.008222 2548 projected.go:196] Error preparing data for projected volume kube-api-access-lzx2t for pod openshift-network-diagnostics/network-check-target-gtfwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:58.008364 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:58.008279 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t podName:9d995d78-dace-4279-862a-662597743d1c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:14.008265694 +0000 UTC m=+34.242497712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzx2t" (UniqueName: "kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t") pod "network-check-target-gtfwf" (UID: "9d995d78-dace-4279-862a-662597743d1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:58.176255 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:58.176183 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:25:58.176255 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:58.176219 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:25:58.176454 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:58.176295 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:25:58.176454 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:25:58.176355 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:25:58.176547 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:58.176480 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:25:58.176604 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:25:58.176572 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:26:00.169528 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:00.169499 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:26:00.169873 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:00.169576 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:26:00.169873 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:00.169587 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:00.169873 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:00.169694 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:26:00.169873 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:00.169738 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:00.169873 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:00.169811 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:26:02.169320 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.169013 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:26:02.169933 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.169042 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:02.169933 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:02.169421 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:26:02.169933 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.169063 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:02.169933 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:02.169486 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:26:02.169933 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:02.169542 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:26:02.344610 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.344538 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ctskt" event={"ID":"ed93ff1d-8caf-444e-a7b9-70bd146a7f59","Type":"ContainerStarted","Data":"e7d4d1573b985e45986139fcb2d800edc3da070b536bf8d21ce956a0f3a956c7"} Jul 31 21:26:02.346293 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.346264 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" event={"ID":"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4","Type":"ContainerStarted","Data":"74083e7c2441f401b8eb86e3752f0a39bc3b1cee9ae33aa1d56ab86b2788e91e"} Jul 31 21:26:02.347988 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.347961 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gtjxs" event={"ID":"5ee371d3-576a-413b-b19f-4849899c2559","Type":"ContainerStarted","Data":"0e8dd0c8e4d3c2db04269290e15ff258a4daabb69cedaa5105c08f515cf9770d"} Jul 31 21:26:02.349637 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.349607 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t7rln" event={"ID":"7a782591-1f18-4512-b13c-8e1e8f522b75","Type":"ContainerStarted","Data":"08db84b1bc759ee5d2ba365120f0371458e75dab1f621a98465b17605d84cd95"} Jul 31 21:26:02.351028 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.350998 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" event={"ID":"1031a481-42de-4ba5-9e2f-bdd966129034","Type":"ContainerStarted","Data":"45066940b02f6e9f31811fa515713efa3ba667535c1018b956f995aa0d0e5dd4"} Jul 31 21:26:02.352705 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.352614 2548 generic.go:356] "Generic (PLEG): container finished" podID="768ae4f9-da78-48e2-bbea-ec89315b45b3" containerID="e1294c9f0ebda606d375e53f1fb312c2a4433e2fb96e442c93d980a33842b7b7" exitCode=0 Jul 31 21:26:02.352705 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.352694 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ns8z" event={"ID":"768ae4f9-da78-48e2-bbea-ec89315b45b3","Type":"ContainerDied","Data":"e1294c9f0ebda606d375e53f1fb312c2a4433e2fb96e442c93d980a33842b7b7"} Jul 31 21:26:02.357023 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.356986 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" event={"ID":"db9123c3-9566-4387-8b31-f4284932e130","Type":"ContainerStarted","Data":"a5a57a16e48c0bff7dbc59b7fb6526bcdd8d375578eb90226cde3932fb49f454"} Jul 31 21:26:02.357116 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.357053 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" event={"ID":"db9123c3-9566-4387-8b31-f4284932e130","Type":"ContainerStarted","Data":"775c87dfcde5243ef385ec38cb5f55f231061e25966cdfa164d713510198cb7b"} Jul 31 21:26:02.357116 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.357095 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" event={"ID":"db9123c3-9566-4387-8b31-f4284932e130","Type":"ContainerStarted","Data":"f9f9dce029f136a25f0c89a528f939e6ceca8c7095931643026d22e267b27d46"} Jul 31 21:26:02.357204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.357137 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" event={"ID":"db9123c3-9566-4387-8b31-f4284932e130","Type":"ContainerStarted","Data":"6cdf1b3311ec327ee4b004cccda9ba6d34ec59934b3b5303530f695e2be31b4c"} Jul 31 21:26:02.357204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.357178 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" event={"ID":"db9123c3-9566-4387-8b31-f4284932e130","Type":"ContainerStarted","Data":"efec5d1fbc5f75b9b7a497ce749b62c71a305571a72f1d847398bc1bd94cb151"} Jul 31 21:26:02.357293 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.357216 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" event={"ID":"db9123c3-9566-4387-8b31-f4284932e130","Type":"ContainerStarted","Data":"c4987d4bc49494cd10a3a2837bc6ba58276ab1f9fad70fe869fe9681d6cfebbb"} Jul 31 21:26:02.358924 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.358886 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gx76h" event={"ID":"5d66c8d3-47f5-4b6f-bc26-61372efd4add","Type":"ContainerStarted","Data":"193f2d7becc33f4064e54f651742128e978b555dc448544c9e54387eac75060c"} Jul 31 21:26:02.362139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.362098 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ctskt" podStartSLOduration=4.11178773 podStartE2EDuration="22.362084855s" totalImagesPullingTime="18.250297125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:02.361487726 +0000 UTC m=+22.595719766" watchObservedRunningTime="2026-07-31 21:26:02.362084855 +0000 UTC m=+22.596316894" Jul 31 21:26:02.379123 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.379085 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t7rln" podStartSLOduration=4.172728736 podStartE2EDuration="22.379073305s" totalImagesPullingTime="18.206344569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:02.378664405 +0000 UTC m=+22.612896437" watchObservedRunningTime="2026-07-31 21:26:02.379073305 +0000 UTC m=+22.613305335" Jul 31 21:26:02.417770 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.417721 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8ww2z" podStartSLOduration=4.21962972 podStartE2EDuration="22.417704604s" totalImagesPullingTime="18.198074884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:02.417015924 +0000 UTC m=+22.651247955" watchObservedRunningTime="2026-07-31 21:26:02.417704604 +0000 UTC m=+22.651936644" Jul 31 21:26:02.432998 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.432960 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gtjxs" podStartSLOduration=4.199297435 podStartE2EDuration="22.432948514s" totalImagesPullingTime="18.233651079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:02.432668173 +0000 UTC m=+22.666900222" watchObservedRunningTime="2026-07-31 21:26:02.432948514 +0000 UTC m=+22.667180552" Jul 31 21:26:02.917949 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:02.917927 2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 31 21:26:03.120181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:03.120061 2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T21:26:02.917944693Z","UUID":"7e685ea1-3ea4-470b-8be8-ace692a2b5d6","Handler":null,"Name":"","Endpoint":""} Jul 31 21:26:03.121588 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:03.121567 2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 31 21:26:03.121697 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:03.121612 2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 31 21:26:03.362808 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:03.362733 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxgl5" event={"ID":"dc3a4cc9-865d-4454-ba46-211314e2ff66","Type":"ContainerStarted","Data":"912b1e2ccc6da69feb342e2e98dd37c5512330698e12f9ca4f099d97a0cc2afb"} Jul 31 21:26:03.364566 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:03.364539 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" event={"ID":"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4","Type":"ContainerStarted","Data":"8721c07c24740d3a1350eda989a625a466e080e681a842669a58a51beff753a8"} Jul 31 21:26:03.378237 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:03.378199 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gx76h" podStartSLOduration=9.281503984 podStartE2EDuration="23.378187158s" totalImagesPullingTime="14.096683174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:02.454109556 +0000 UTC m=+22.688341605" watchObservedRunningTime="2026-07-31 21:26:03.378187158 +0000 UTC m=+23.612419190" Jul 31 21:26:03.378645 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:03.378624 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hxgl5" podStartSLOduration=9.317575477 podStartE2EDuration="23.378618794s" totalImagesPullingTime="14.061043317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:03.37816855 +0000 UTC m=+23.612400580" watchObservedRunningTime="2026-07-31 21:26:03.378618794 +0000 UTC m=+23.612850811" Jul 31 21:26:04.132004 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:04.131973 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:26:04.132663 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:04.132641 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:26:04.169666 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:04.169631 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:26:04.169666 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:04.169646 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:04.169666 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:04.169658 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:04.169828 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:04.169759 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:26:04.169828 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:04.169791 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:26:04.169893 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:04.169854 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:26:04.366851 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:04.366831 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:26:04.367199 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:04.367127 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gx76h" Jul 31 21:26:05.372755 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:05.372719 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" event={"ID":"db9123c3-9566-4387-8b31-f4284932e130","Type":"ContainerStarted","Data":"e0e531f486a48d8b95d259262b6a1fe3a3490224eb59e29b9a5cfa9413cdb109"} Jul 31 21:26:05.374853 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:05.374819 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" event={"ID":"55142aa0-6141-4e5a-b76c-d2fb6dfcfcf4","Type":"ContainerStarted","Data":"afa0385ed4077c01b22047c44606215da3c431a3daa9a209041711315727906b"} Jul 31 21:26:05.392226 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:05.392182 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7dk77" podStartSLOduration=8.746119365 podStartE2EDuration="25.392165333s" totalImagesPullingTime="16.646045968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:05.391010723 +0000 UTC m=+25.625242770" watchObservedRunningTime="2026-07-31 21:26:05.392165333 +0000 UTC m=+25.626397370" Jul 31 21:26:06.169001 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:06.168808 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:26:06.169172 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:06.169109 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:26:06.169172 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:06.168808 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:06.169284 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:06.168808 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:06.169334 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:06.169300 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:26:06.169334 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:06.169198 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:26:08.169476 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.169391 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:08.170134 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.169397 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:26:08.170134 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.169397 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:08.170134 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:08.169491 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:26:08.170134 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:08.169576 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:26:08.170134 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:08.169673 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:26:08.381661 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.381640 2548 generic.go:356] "Generic (PLEG): container finished" podID="768ae4f9-da78-48e2-bbea-ec89315b45b3" containerID="c3495b25b2049f498cf922597767ecd9130e73d8b1bf3864f274cf995ca8bf16" exitCode=0 Jul 31 21:26:08.381760 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.381709 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ns8z" event={"ID":"768ae4f9-da78-48e2-bbea-ec89315b45b3","Type":"ContainerDied","Data":"c3495b25b2049f498cf922597767ecd9130e73d8b1bf3864f274cf995ca8bf16"} Jul 31 21:26:08.385420 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.385398 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" event={"ID":"db9123c3-9566-4387-8b31-f4284932e130","Type":"ContainerStarted","Data":"29f92db27dbcc21425bc6b328d9585c15c26168f7ca634ace853782a633824d6"} Jul 31 21:26:08.385667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.385643 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:26:08.385762 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.385717 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:26:08.385762 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.385753 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:26:08.400958 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.400937 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:26:08.401120 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.401105 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:26:08.426376 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:08.426315 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" podStartSLOduration=10.155463075 podStartE2EDuration="28.426303921s" totalImagesPullingTime="18.270840846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:08.425756987 +0000 UTC m=+28.659989027" watchObservedRunningTime="2026-07-31 21:26:08.426303921 +0000 UTC m=+28.660535959" Jul 31 21:26:09.646113 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:09.646047 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-brfzt"] Jul 31 21:26:09.646547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:09.646141 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:26:09.646547 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:09.646237 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:26:09.649190 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:09.649148 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fvtj7"] Jul 31 21:26:09.649304 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:09.649242 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:09.649362 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:09.649324 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:26:09.649890 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:09.649870 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gtfwf"] Jul 31 21:26:09.650004 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:09.649955 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:09.650057 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:09.650041 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:26:10.395182 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:10.395103 2548 generic.go:356] "Generic (PLEG): container finished" podID="768ae4f9-da78-48e2-bbea-ec89315b45b3" containerID="1d753090312967da9f1a4517cb9209c1d42fda6413cd0a15a7bc017fa307e2f9" exitCode=0 Jul 31 21:26:10.395327 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:10.395190 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ns8z" event={"ID":"768ae4f9-da78-48e2-bbea-ec89315b45b3","Type":"ContainerDied","Data":"1d753090312967da9f1a4517cb9209c1d42fda6413cd0a15a7bc017fa307e2f9"} Jul 31 21:26:11.168982 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:11.168954 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:11.168982 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:11.168971 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:11.168982 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:11.168976 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:26:11.169428 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:11.169076 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:26:11.169428 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:11.169144 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:26:11.169428 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:11.169261 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:26:12.402064 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:12.401864 2548 generic.go:356] "Generic (PLEG): container finished" podID="768ae4f9-da78-48e2-bbea-ec89315b45b3" containerID="4f2da08133136d4e3311f88534d3f43af38d7b288f0f9894fc10cbf754ecc588" exitCode=0 Jul 31 21:26:12.402474 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:12.401943 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ns8z" event={"ID":"768ae4f9-da78-48e2-bbea-ec89315b45b3","Type":"ContainerDied","Data":"4f2da08133136d4e3311f88534d3f43af38d7b288f0f9894fc10cbf754ecc588"} Jul 31 21:26:13.169550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:13.169517 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:13.169716 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:13.169516 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:13.169716 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:13.169632 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtj7" podUID="fe28664a-22c1-4e57-aac2-08f4b0cc7d14" Jul 31 21:26:13.169716 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:13.169516 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:26:13.169817 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:13.169715 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gtfwf" podUID="9d995d78-dace-4279-862a-662597743d1c" Jul 31 21:26:13.169817 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:13.169798 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:26:13.928364 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:13.928333 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:26:13.928703 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:13.928383 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:13.928703 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:13.928472 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:26:13.928703 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:13.928525 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs podName:a359de99-657c-4c35-bf34-31ef06ddfbc6 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:45.928510162 +0000 UTC m=+66.162742179 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs") pod "network-metrics-daemon-brfzt" (UID: "a359de99-657c-4c35-bf34-31ef06ddfbc6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:26:13.928703 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:13.928476 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:26:13.928703 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:13.928605 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret podName:fe28664a-22c1-4e57-aac2-08f4b0cc7d14 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:45.92859075 +0000 UTC m=+66.162822781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret") pod "global-pull-secret-syncer-fvtj7" (UID: "fe28664a-22c1-4e57-aac2-08f4b0cc7d14") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:26:14.028876 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:14.028850 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzx2t\" (UniqueName: \"kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t\") pod \"network-check-target-gtfwf\" (UID: \"9d995d78-dace-4279-862a-662597743d1c\") " pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:14.029056 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:14.028981 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:26:14.029056 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:14.029004 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:26:14.029056 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:14.029018 2548 projected.go:196] Error preparing data for projected volume kube-api-access-lzx2t for pod openshift-network-diagnostics/network-check-target-gtfwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:26:14.029205 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:14.029069 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t podName:9d995d78-dace-4279-862a-662597743d1c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:46.02905209 +0000 UTC m=+66.263284119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzx2t" (UniqueName: "kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t") pod "network-check-target-gtfwf" (UID: "9d995d78-dace-4279-862a-662597743d1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:26:15.102770 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.102741 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeReady" Jul 31 21:26:15.103183 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.102855 2548 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 31 21:26:15.135437 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.135411 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-nz24j"] Jul 31 21:26:15.139676 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.139651 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cfb6fbf86-vtsps"] Jul 31 21:26:15.139812 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.139793 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:15.142421 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.142400 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pzhm8\"" Jul 31 21:26:15.142546 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.142470 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 31 21:26:15.142546 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.142493 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 31 21:26:15.143306 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.143288 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.146314 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.146280 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtvng\"" Jul 31 21:26:15.146430 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.146409 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 31 21:26:15.146828 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.146619 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 31 21:26:15.146828 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.146712 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 31 21:26:15.150379 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.150339 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-nz24j"] Jul 31 21:26:15.160361 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.159246 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dgz6v"] Jul 31 21:26:15.161802 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.161779 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 31 21:26:15.164825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.164802 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vpn9n"] Jul 31 21:26:15.165320 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.165298 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.168473 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.168455 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cfb6fbf86-vtsps"] Jul 31 21:26:15.168553 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.168540 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vpn9n" Jul 31 21:26:15.169049 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.168731 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:15.169049 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.168831 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jxlqr\"" Jul 31 21:26:15.169049 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.169038 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 31 21:26:15.169265 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.169248 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 31 21:26:15.170036 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.169430 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:26:15.170036 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.169801 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:15.170036 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.169872 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vpn9n"] Jul 31 21:26:15.170540 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.170519 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dgz6v"] Jul 31 21:26:15.171835 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.171820 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 21:26:15.172204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.172186 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtsm8\"" Jul 31 21:26:15.172706 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.172687 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 31 21:26:15.173082 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.172989 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 21:26:15.173269 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.173172 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 21:26:15.173377 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.173358 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 31 21:26:15.173763 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.173745 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 31 21:26:15.173951 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.173898 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 21:26:15.174059 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.173976 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2p6df\"" Jul 31 21:26:15.174257 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.174239 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nppbx\"" Jul 31 21:26:15.237261 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237234 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785c1568-84cc-45f0-8393-faabbd22658e-ca-trust-extracted\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.237261 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237260 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rx5m\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-kube-api-access-5rx5m\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.237426 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237288 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-image-registry-private-configuration\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.237426 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237304 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-trusted-ca\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.237426 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237345 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-installation-pull-secrets\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.237426 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237368 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.237426 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237402 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-bound-sa-token\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.237650 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237438 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.237650 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237478 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-tmp-dir\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.237650 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237504 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77b984c-43b1-4cf6-b5d1-359e19752c35-cert\") pod \"ingress-canary-vpn9n\" (UID: \"a77b984c-43b1-4cf6-b5d1-359e19752c35\") " pod="openshift-ingress-canary/ingress-canary-vpn9n" Jul 31 21:26:15.237650 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237532 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-config-volume\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.237650 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237557 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkdfm\" (UniqueName: \"kubernetes.io/projected/a77b984c-43b1-4cf6-b5d1-359e19752c35-kube-api-access-rkdfm\") pod \"ingress-canary-vpn9n\" (UID: \"a77b984c-43b1-4cf6-b5d1-359e19752c35\") " pod="openshift-ingress-canary/ingress-canary-vpn9n" Jul 31 21:26:15.237650 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237597 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:15.237650 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237620 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-registry-certificates\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.237650 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237641 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:15.237881 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.237660 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9wqd\" (UniqueName: \"kubernetes.io/projected/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-kube-api-access-c9wqd\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.338485 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338427 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785c1568-84cc-45f0-8393-faabbd22658e-ca-trust-extracted\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.338485 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338462 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rx5m\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-kube-api-access-5rx5m\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.338643 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338502 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-image-registry-private-configuration\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.338643 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338520 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-trusted-ca\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.338643 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338545 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-installation-pull-secrets\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.338788 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338689 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.338788 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338733 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785c1568-84cc-45f0-8393-faabbd22658e-ca-trust-extracted\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.338788 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338762 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-bound-sa-token\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.338958 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338787 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.338958 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338813 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-tmp-dir\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.338958 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.338816 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 21:26:15.338958 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.338838 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfb6fbf86-vtsps: secret "image-registry-tls" not found Jul 31 21:26:15.338958 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.338868 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:15.338958 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.338886 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls podName:785c1568-84cc-45f0-8393-faabbd22658e nodeName:}" failed. No retries permitted until 2026-07-31 21:26:15.838870674 +0000 UTC m=+36.073102691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls") pod "image-registry-cfb6fbf86-vtsps" (UID: "785c1568-84cc-45f0-8393-faabbd22658e") : secret "image-registry-tls" not found Jul 31 21:26:15.338958 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.338933 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls podName:ef50ba85-4e8d-4793-bc88-a4cedb14bb0c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:15.838898826 +0000 UTC m=+36.073130844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls") pod "dns-default-dgz6v" (UID: "ef50ba85-4e8d-4793-bc88-a4cedb14bb0c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:15.338958 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338950 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77b984c-43b1-4cf6-b5d1-359e19752c35-cert\") pod \"ingress-canary-vpn9n\" (UID: \"a77b984c-43b1-4cf6-b5d1-359e19752c35\") " pod="openshift-ingress-canary/ingress-canary-vpn9n" Jul 31 21:26:15.339346 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.338977 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-config-volume\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.339346 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.339001 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkdfm\" (UniqueName: \"kubernetes.io/projected/a77b984c-43b1-4cf6-b5d1-359e19752c35-kube-api-access-rkdfm\") pod \"ingress-canary-vpn9n\" (UID: \"a77b984c-43b1-4cf6-b5d1-359e19752c35\") " pod="openshift-ingress-canary/ingress-canary-vpn9n" Jul 31 21:26:15.339346 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.339030 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:15.339346 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.339054 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-registry-certificates\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.339346 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.339078 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:15.339346 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.339102 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9wqd\" (UniqueName: \"kubernetes.io/projected/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-kube-api-access-c9wqd\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.339346 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.339162 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 21:26:15.339346 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.339260 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert podName:c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef nodeName:}" failed. No retries permitted until 2026-07-31 21:26:15.839244731 +0000 UTC m=+36.073476764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-nz24j" (UID: "c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef") : secret "networking-console-plugin-cert" not found Jul 31 21:26:15.339346 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.339289 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-tmp-dir\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.339768 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.339536 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-trusted-ca\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.339768 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.339551 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-config-volume\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.339876 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.339862 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:15.339960 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.339942 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-registry-certificates\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.342723 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.342704 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-installation-pull-secrets\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.342816 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.342743 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-image-registry-private-configuration\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.342816 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.342806 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77b984c-43b1-4cf6-b5d1-359e19752c35-cert\") pod \"ingress-canary-vpn9n\" (UID: \"a77b984c-43b1-4cf6-b5d1-359e19752c35\") " pod="openshift-ingress-canary/ingress-canary-vpn9n" Jul 31 21:26:15.347205 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.347179 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9wqd\" (UniqueName: \"kubernetes.io/projected/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-kube-api-access-c9wqd\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.347284 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.347210 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-bound-sa-token\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.347284 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.347244 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rx5m\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-kube-api-access-5rx5m\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.347980 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.347960 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkdfm\" (UniqueName: \"kubernetes.io/projected/a77b984c-43b1-4cf6-b5d1-359e19752c35-kube-api-access-rkdfm\") pod \"ingress-canary-vpn9n\" (UID: \"a77b984c-43b1-4cf6-b5d1-359e19752c35\") " pod="openshift-ingress-canary/ingress-canary-vpn9n" Jul 31 21:26:15.485029 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.484996 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vpn9n" Jul 31 21:26:15.621548 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.621482 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vpn9n"] Jul 31 21:26:15.625430 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:26:15.625401 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77b984c_43b1_4cf6_b5d1_359e19752c35.slice/crio-2674e7b9801cb1b79475c19cfe1108f227f0303ac6fdb238b0689baef2a0f507 WatchSource:0}: Error finding container 2674e7b9801cb1b79475c19cfe1108f227f0303ac6fdb238b0689baef2a0f507: Status 404 returned error can't find the container with id 2674e7b9801cb1b79475c19cfe1108f227f0303ac6fdb238b0689baef2a0f507 Jul 31 21:26:15.842797 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.842755 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:15.842984 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.842816 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:15.842984 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:15.842885 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:15.842984 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.842949 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:15.843155 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.843015 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 21:26:15.843155 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.843024 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls podName:ef50ba85-4e8d-4793-bc88-a4cedb14bb0c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:16.843003015 +0000 UTC m=+37.077235047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls") pod "dns-default-dgz6v" (UID: "ef50ba85-4e8d-4793-bc88-a4cedb14bb0c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:15.843155 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.843033 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfb6fbf86-vtsps: secret "image-registry-tls" not found Jul 31 21:26:15.843155 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.843043 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 21:26:15.843155 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.843084 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls podName:785c1568-84cc-45f0-8393-faabbd22658e nodeName:}" failed. No retries permitted until 2026-07-31 21:26:16.843069202 +0000 UTC m=+37.077301221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls") pod "image-registry-cfb6fbf86-vtsps" (UID: "785c1568-84cc-45f0-8393-faabbd22658e") : secret "image-registry-tls" not found Jul 31 21:26:15.843155 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:15.843110 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert podName:c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef nodeName:}" failed. No retries permitted until 2026-07-31 21:26:16.843093621 +0000 UTC m=+37.077325643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-nz24j" (UID: "c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef") : secret "networking-console-plugin-cert" not found Jul 31 21:26:16.412693 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:16.412653 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vpn9n" event={"ID":"a77b984c-43b1-4cf6-b5d1-359e19752c35","Type":"ContainerStarted","Data":"2674e7b9801cb1b79475c19cfe1108f227f0303ac6fdb238b0689baef2a0f507"} Jul 31 21:26:16.851861 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:16.851632 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:16.851861 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:16.851803 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:16.851861 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:16.851843 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:16.852133 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:16.851876 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls podName:ef50ba85-4e8d-4793-bc88-a4cedb14bb0c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:18.851855187 +0000 UTC m=+39.086087218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls") pod "dns-default-dgz6v" (UID: "ef50ba85-4e8d-4793-bc88-a4cedb14bb0c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:16.852133 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:16.851945 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 21:26:16.852133 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:16.851978 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:16.852133 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:16.851987 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert podName:c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef nodeName:}" failed. No retries permitted until 2026-07-31 21:26:18.851976579 +0000 UTC m=+39.086208600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-nz24j" (UID: "c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef") : secret "networking-console-plugin-cert" not found Jul 31 21:26:16.852133 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:16.852047 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 21:26:16.852133 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:16.852059 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfb6fbf86-vtsps: secret "image-registry-tls" not found Jul 31 21:26:16.852133 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:16.852092 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls podName:785c1568-84cc-45f0-8393-faabbd22658e nodeName:}" failed. No retries permitted until 2026-07-31 21:26:18.852080423 +0000 UTC m=+39.086312446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls") pod "image-registry-cfb6fbf86-vtsps" (UID: "785c1568-84cc-45f0-8393-faabbd22658e") : secret "image-registry-tls" not found Jul 31 21:26:18.870732 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:18.870706 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:18.871101 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:18.870750 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:18.871101 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:18.870844 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 21:26:18.871101 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:18.870880 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:18.871101 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:18.870888 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert podName:c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef nodeName:}" failed. No retries permitted until 2026-07-31 21:26:22.87087662 +0000 UTC m=+43.105108637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-nz24j" (UID: "c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef") : secret "networking-console-plugin-cert" not found Jul 31 21:26:18.871101 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:18.870982 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:18.871101 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:18.871042 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 21:26:18.871101 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:18.871050 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls podName:ef50ba85-4e8d-4793-bc88-a4cedb14bb0c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:22.87103717 +0000 UTC m=+43.105269191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls") pod "dns-default-dgz6v" (UID: "ef50ba85-4e8d-4793-bc88-a4cedb14bb0c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:18.871101 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:18.871055 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfb6fbf86-vtsps: secret "image-registry-tls" not found Jul 31 21:26:18.871101 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:18.871093 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls podName:785c1568-84cc-45f0-8393-faabbd22658e nodeName:}" failed. No retries permitted until 2026-07-31 21:26:22.871081612 +0000 UTC m=+43.105313630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls") pod "image-registry-cfb6fbf86-vtsps" (UID: "785c1568-84cc-45f0-8393-faabbd22658e") : secret "image-registry-tls" not found Jul 31 21:26:19.421390 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:19.421311 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vpn9n" event={"ID":"a77b984c-43b1-4cf6-b5d1-359e19752c35","Type":"ContainerStarted","Data":"318a5b2ee26d3d648e12272f98e95330eb148fd89dde5ad4d3dcb1444be56d76"} Jul 31 21:26:19.423814 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:19.423779 2548 generic.go:356] "Generic (PLEG): container finished" podID="768ae4f9-da78-48e2-bbea-ec89315b45b3" containerID="73b7088f918bb585b7d5ffd4ea62c3a99be17d943f3a677eca87b7be90c8c6ea" exitCode=0 Jul 31 21:26:19.424015 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:19.423831 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ns8z" event={"ID":"768ae4f9-da78-48e2-bbea-ec89315b45b3","Type":"ContainerDied","Data":"73b7088f918bb585b7d5ffd4ea62c3a99be17d943f3a677eca87b7be90c8c6ea"} Jul 31 21:26:19.437274 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:19.437235 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vpn9n" podStartSLOduration=1.217841685 podStartE2EDuration="4.437222931s" totalImagesPullingTime="3.219381246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:19.436226081 +0000 UTC m=+39.670458111" watchObservedRunningTime="2026-07-31 21:26:19.437222931 +0000 UTC m=+39.671454970" Jul 31 21:26:20.428764 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:20.428732 2548 generic.go:356] "Generic (PLEG): container finished" podID="768ae4f9-da78-48e2-bbea-ec89315b45b3" containerID="48df1e7302985984a51976b8de799419563e636768e941ff23585685124b6236" exitCode=0 Jul 31 21:26:20.429134 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:20.428843 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ns8z" event={"ID":"768ae4f9-da78-48e2-bbea-ec89315b45b3","Type":"ContainerDied","Data":"48df1e7302985984a51976b8de799419563e636768e941ff23585685124b6236"} Jul 31 21:26:21.434263 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:21.434226 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ns8z" event={"ID":"768ae4f9-da78-48e2-bbea-ec89315b45b3","Type":"ContainerStarted","Data":"842fa59cd3284effd7264014ba6133527427431086990cd1a066168d48a71450"} Jul 31 21:26:21.474482 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:21.474443 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4ns8z" podStartSLOduration=9.396235549 podStartE2EDuration="41.474428279s" totalImagesPullingTime="32.07819273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:21.47388005 +0000 UTC m=+41.708112088" watchObservedRunningTime="2026-07-31 21:26:21.474428279 +0000 UTC m=+41.708660317" Jul 31 21:26:22.901410 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:22.901379 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:22.901842 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:22.901429 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:22.901842 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:22.901454 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:22.901842 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:22.901522 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 21:26:22.901842 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:22.901524 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 21:26:22.901842 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:22.901534 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:22.901842 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:22.901542 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfb6fbf86-vtsps: secret "image-registry-tls" not found Jul 31 21:26:22.901842 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:22.901587 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls podName:785c1568-84cc-45f0-8393-faabbd22658e nodeName:}" failed. No retries permitted until 2026-07-31 21:26:30.901571325 +0000 UTC m=+51.135803342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls") pod "image-registry-cfb6fbf86-vtsps" (UID: "785c1568-84cc-45f0-8393-faabbd22658e") : secret "image-registry-tls" not found Jul 31 21:26:22.901842 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:22.901638 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert podName:c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef nodeName:}" failed. No retries permitted until 2026-07-31 21:26:30.901631509 +0000 UTC m=+51.135863525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-nz24j" (UID: "c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef") : secret "networking-console-plugin-cert" not found Jul 31 21:26:22.901842 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:22.901648 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls podName:ef50ba85-4e8d-4793-bc88-a4cedb14bb0c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:30.901643471 +0000 UTC m=+51.135875488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls") pod "dns-default-dgz6v" (UID: "ef50ba85-4e8d-4793-bc88-a4cedb14bb0c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:30.959871 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:30.959828 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:30.960411 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:30.959928 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:30.960411 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:30.959947 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 21:26:30.960411 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:30.959982 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:30.960411 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:30.960008 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert podName:c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef nodeName:}" failed. No retries permitted until 2026-07-31 21:26:46.959992107 +0000 UTC m=+67.194224124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-nz24j" (UID: "c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef") : secret "networking-console-plugin-cert" not found Jul 31 21:26:30.960411 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:30.960066 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:30.960411 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:30.960105 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 21:26:30.960411 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:30.960124 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls podName:ef50ba85-4e8d-4793-bc88-a4cedb14bb0c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:46.960109015 +0000 UTC m=+67.194341032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls") pod "dns-default-dgz6v" (UID: "ef50ba85-4e8d-4793-bc88-a4cedb14bb0c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:30.960411 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:30.960125 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfb6fbf86-vtsps: secret "image-registry-tls" not found Jul 31 21:26:30.960411 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:30.960179 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls podName:785c1568-84cc-45f0-8393-faabbd22658e nodeName:}" failed. No retries permitted until 2026-07-31 21:26:46.960167375 +0000 UTC m=+67.194399392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls") pod "image-registry-cfb6fbf86-vtsps" (UID: "785c1568-84cc-45f0-8393-faabbd22658e") : secret "image-registry-tls" not found Jul 31 21:26:40.415428 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:40.415403 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkjfh" Jul 31 21:26:45.956768 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:45.956732 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:45.957209 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:45.956797 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:26:45.959810 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:45.959793 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 21:26:45.959864 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:45.959843 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 21:26:45.967334 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:45.967320 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 31 21:26:45.967380 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:45.967373 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs podName:a359de99-657c-4c35-bf34-31ef06ddfbc6 nodeName:}" failed. No retries permitted until 2026-07-31 21:27:49.967357431 +0000 UTC m=+130.201589451 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs") pod "network-metrics-daemon-brfzt" (UID: "a359de99-657c-4c35-bf34-31ef06ddfbc6") : secret "metrics-daemon-secret" not found Jul 31 21:26:45.970445 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:45.970431 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe28664a-22c1-4e57-aac2-08f4b0cc7d14-original-pull-secret\") pod \"global-pull-secret-syncer-fvtj7\" (UID: \"fe28664a-22c1-4e57-aac2-08f4b0cc7d14\") " pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:46.057700 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.057675 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzx2t\" (UniqueName: \"kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t\") pod \"network-check-target-gtfwf\" (UID: \"9d995d78-dace-4279-862a-662597743d1c\") " pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:46.063459 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.063443 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 21:26:46.071663 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.071651 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 21:26:46.081192 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.081169 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzx2t\" (UniqueName: \"kubernetes.io/projected/9d995d78-dace-4279-862a-662597743d1c-kube-api-access-lzx2t\") pod \"network-check-target-gtfwf\" (UID: \"9d995d78-dace-4279-862a-662597743d1c\") " pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:46.095732 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.095716 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtsm8\"" Jul 31 21:26:46.102559 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.102546 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:46.103708 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.103693 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtj7" Jul 31 21:26:46.231166 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.231102 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gtfwf"] Jul 31 21:26:46.234447 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:26:46.234422 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d995d78_dace_4279_862a_662597743d1c.slice/crio-b654f68e547b95e93d6bd2cb6fed7f644bfa7115e7679752e6e77ff227d29b2a WatchSource:0}: Error finding container b654f68e547b95e93d6bd2cb6fed7f644bfa7115e7679752e6e77ff227d29b2a: Status 404 returned error can't find the container with id b654f68e547b95e93d6bd2cb6fed7f644bfa7115e7679752e6e77ff227d29b2a Jul 31 21:26:46.247645 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.247624 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fvtj7"] Jul 31 21:26:46.250147 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:26:46.250122 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe28664a_22c1_4e57_aac2_08f4b0cc7d14.slice/crio-90f7f06e92d69e9b1b0f5b31ee92a07f9c15fbc6d66107d318f23779d807552f WatchSource:0}: Error finding container 90f7f06e92d69e9b1b0f5b31ee92a07f9c15fbc6d66107d318f23779d807552f: Status 404 returned error can't find the container with id 90f7f06e92d69e9b1b0f5b31ee92a07f9c15fbc6d66107d318f23779d807552f Jul 31 21:26:46.487445 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.487377 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fvtj7" event={"ID":"fe28664a-22c1-4e57-aac2-08f4b0cc7d14","Type":"ContainerStarted","Data":"90f7f06e92d69e9b1b0f5b31ee92a07f9c15fbc6d66107d318f23779d807552f"} Jul 31 21:26:46.488366 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.488345 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gtfwf" event={"ID":"9d995d78-dace-4279-862a-662597743d1c","Type":"ContainerStarted","Data":"b654f68e547b95e93d6bd2cb6fed7f644bfa7115e7679752e6e77ff227d29b2a"} Jul 31 21:26:46.964771 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.964735 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:26:46.965242 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.964795 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:26:46.965242 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:46.964853 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:26:46.965242 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:46.964926 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:46.965242 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:46.964993 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 21:26:46.965242 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:46.964994 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 21:26:46.965242 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:46.965051 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfb6fbf86-vtsps: secret "image-registry-tls" not found Jul 31 21:26:46.965242 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:46.965002 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls podName:ef50ba85-4e8d-4793-bc88-a4cedb14bb0c nodeName:}" failed. No retries permitted until 2026-07-31 21:27:18.964980243 +0000 UTC m=+99.199212261 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls") pod "dns-default-dgz6v" (UID: "ef50ba85-4e8d-4793-bc88-a4cedb14bb0c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:46.965242 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:46.965097 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert podName:c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef nodeName:}" failed. No retries permitted until 2026-07-31 21:27:18.965080973 +0000 UTC m=+99.199312993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-nz24j" (UID: "c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef") : secret "networking-console-plugin-cert" not found Jul 31 21:26:46.965242 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:26:46.965110 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls podName:785c1568-84cc-45f0-8393-faabbd22658e nodeName:}" failed. No retries permitted until 2026-07-31 21:27:18.965103309 +0000 UTC m=+99.199335326 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls") pod "image-registry-cfb6fbf86-vtsps" (UID: "785c1568-84cc-45f0-8393-faabbd22658e") : secret "image-registry-tls" not found Jul 31 21:26:51.502330 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:51.502295 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fvtj7" event={"ID":"fe28664a-22c1-4e57-aac2-08f4b0cc7d14","Type":"ContainerStarted","Data":"b5236942e075851cecfaa86f9123c243297add7f36267c7900fb39ff8fa90de5"} Jul 31 21:26:51.503768 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:51.503747 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gtfwf" event={"ID":"9d995d78-dace-4279-862a-662597743d1c","Type":"ContainerStarted","Data":"f8186dc2f8b376599567938d7966249a888329211070c9df309642be1d99cb33"} Jul 31 21:26:51.503894 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:51.503878 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:26:51.518122 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:51.518072 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fvtj7" podStartSLOduration=66.780302661 podStartE2EDuration="1m11.518050436s" totalImagesPullingTime="4.737747775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:51.517491144 +0000 UTC m=+71.751723181" watchObservedRunningTime="2026-07-31 21:26:51.518050436 +0000 UTC m=+71.752282475" Jul 31 21:26:51.532023 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:26:51.531983 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gtfwf" podStartSLOduration=66.782507919 podStartE2EDuration="1m11.531972428s" totalImagesPullingTime="4.749464509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:51.531735044 +0000 UTC m=+71.765967082" watchObservedRunningTime="2026-07-31 21:26:51.531972428 +0000 UTC m=+71.766204467" Jul 31 21:27:18.985589 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:27:18.985474 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:27:18.985589 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:27:18.985525 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:27:18.986093 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:27:18.985626 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 21:27:18.986093 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:27:18.985657 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:27:18.986093 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:27:18.985689 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert podName:c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef nodeName:}" failed. No retries permitted until 2026-07-31 21:28:22.985674114 +0000 UTC m=+163.219906135 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-nz24j" (UID: "c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef") : secret "networking-console-plugin-cert" not found Jul 31 21:27:18.986093 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:27:18.985630 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 21:27:18.986093 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:27:18.985720 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfb6fbf86-vtsps: secret "image-registry-tls" not found Jul 31 21:27:18.986093 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:27:18.985735 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:27:18.986093 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:27:18.985780 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls podName:785c1568-84cc-45f0-8393-faabbd22658e nodeName:}" failed. No retries permitted until 2026-07-31 21:28:22.985765827 +0000 UTC m=+163.219997846 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls") pod "image-registry-cfb6fbf86-vtsps" (UID: "785c1568-84cc-45f0-8393-faabbd22658e") : secret "image-registry-tls" not found Jul 31 21:27:18.986093 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:27:18.985795 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls podName:ef50ba85-4e8d-4793-bc88-a4cedb14bb0c nodeName:}" failed. No retries permitted until 2026-07-31 21:28:22.985787323 +0000 UTC m=+163.220019345 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls") pod "dns-default-dgz6v" (UID: "ef50ba85-4e8d-4793-bc88-a4cedb14bb0c") : secret "dns-default-metrics-tls" not found Jul 31 21:27:22.508348 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:27:22.508319 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gtfwf" Jul 31 21:27:49.986677 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:27:49.986636 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:27:49.987190 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:27:49.986751 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 31 21:27:49.987190 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:27:49.986815 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs podName:a359de99-657c-4c35-bf34-31ef06ddfbc6 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:51.98679862 +0000 UTC m=+252.221030638 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs") pod "network-metrics-daemon-brfzt" (UID: "a359de99-657c-4c35-bf34-31ef06ddfbc6") : secret "metrics-daemon-secret" not found Jul 31 21:28:18.153004 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:28:18.152961 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" podUID="c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef" Jul 31 21:28:18.163091 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:28:18.163067 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" podUID="785c1568-84cc-45f0-8393-faabbd22658e" Jul 31 21:28:18.178041 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:28:18.178018 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dgz6v" podUID="ef50ba85-4e8d-4793-bc88-a4cedb14bb0c" Jul 31 21:28:18.198443 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:28:18.198420 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:28:18.697681 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:28:18.697653 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:28:18.697866 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:28:18.697704 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:28:18.697866 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:28:18.697720 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dgz6v" Jul 31 21:28:23.017761 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:28:23.017717 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:28:23.017761 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:28:23.017783 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:28:23.018228 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:28:23.017812 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:28:23.018228 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:28:23.017877 2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 21:28:23.018228 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:28:23.017885 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:28:23.018228 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:28:23.017945 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 21:28:23.018228 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:28:23.017964 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cfb6fbf86-vtsps: secret "image-registry-tls" not found Jul 31 21:28:23.018228 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:28:23.017954 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls podName:ef50ba85-4e8d-4793-bc88-a4cedb14bb0c nodeName:}" failed. No retries permitted until 2026-07-31 21:30:25.017940406 +0000 UTC m=+285.252172423 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls") pod "dns-default-dgz6v" (UID: "ef50ba85-4e8d-4793-bc88-a4cedb14bb0c") : secret "dns-default-metrics-tls" not found Jul 31 21:28:23.018228 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:28:23.018027 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert podName:c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef nodeName:}" failed. No retries permitted until 2026-07-31 21:30:25.018009902 +0000 UTC m=+285.252241920 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-nz24j" (UID: "c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef") : secret "networking-console-plugin-cert" not found Jul 31 21:28:23.018228 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:28:23.018048 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls podName:785c1568-84cc-45f0-8393-faabbd22658e nodeName:}" failed. No retries permitted until 2026-07-31 21:30:25.018037901 +0000 UTC m=+285.252269922 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls") pod "image-registry-cfb6fbf86-vtsps" (UID: "785c1568-84cc-45f0-8393-faabbd22658e") : secret "image-registry-tls" not found Jul 31 21:28:32.169586 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:28:32.169507 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:29:36.131253 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.131225 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-l9tz9"] Jul 31 21:29:36.134028 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.134013 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.143248 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.143231 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 31 21:29:36.143497 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.143483 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 31 21:29:36.144269 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.144257 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 31 21:29:36.145572 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.145557 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 31 21:29:36.145612 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.145557 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jstvr\"" Jul 31 21:29:36.149164 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.149147 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb"] Jul 31 21:29:36.151753 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.151738 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:36.159182 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.159149 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 31 21:29:36.159301 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.159282 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 31 21:29:36.159820 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.159804 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-l9tz9"] Jul 31 21:29:36.162302 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.162288 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 31 21:29:36.162385 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.162354 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-t579j\"" Jul 31 21:29:36.167676 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.167652 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 31 21:29:36.185977 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.185952 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb"] Jul 31 21:29:36.196706 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.196682 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fceeaf4-4903-437b-950b-7b10ec3b2991-serving-cert\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.196706 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.196705 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fceeaf4-4903-437b-950b-7b10ec3b2991-trusted-ca\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.196815 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.196740 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fceeaf4-4903-437b-950b-7b10ec3b2991-config\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.196815 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.196759 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9rrh\" (UniqueName: \"kubernetes.io/projected/9fceeaf4-4903-437b-950b-7b10ec3b2991-kube-api-access-w9rrh\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.203991 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.203962 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-nrx4s"] Jul 31 21:29:36.206553 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.206534 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-9qpb6"] Jul 31 21:29:36.206702 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.206681 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.209347 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.209332 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw"] Jul 31 21:29:36.209484 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.209471 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9qpb6" Jul 31 21:29:36.209855 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.209839 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 31 21:29:36.210124 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.210108 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 31 21:29:36.210228 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.210133 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 31 21:29:36.210228 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.210201 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rc27p\"" Jul 31 21:29:36.210446 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.210433 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 31 21:29:36.212043 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.212022 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8"] Jul 31 21:29:36.212138 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.212086 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:36.213568 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.213554 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jlvnm\"" Jul 31 21:29:36.214765 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.214751 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cv4cz"] Jul 31 21:29:36.214862 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.214848 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" Jul 31 21:29:36.214951 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.214935 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 31 21:29:36.215018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.214961 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8cl5v\"" Jul 31 21:29:36.216174 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.216160 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 31 21:29:36.216359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.216164 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 31 21:29:36.216478 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.216463 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 31 21:29:36.217483 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.217469 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cv4cz" Jul 31 21:29:36.217984 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.217943 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cklcm\"" Jul 31 21:29:36.217984 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.217955 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 31 21:29:36.218139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.217988 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 31 21:29:36.218264 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.218247 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 31 21:29:36.218335 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.218264 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 31 21:29:36.218561 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.218545 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 31 21:29:36.222072 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.222055 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 31 21:29:36.222256 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.222238 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 31 21:29:36.222548 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.222531 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-z92pv\"" Jul 31 21:29:36.223513 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.223496 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cv4cz"] Jul 31 21:29:36.224410 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.224394 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-9qpb6"] Jul 31 21:29:36.227581 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.227562 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-nrx4s"] Jul 31 21:29:36.228729 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.228709 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8"] Jul 31 21:29:36.232298 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.232251 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw"] Jul 31 21:29:36.297458 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297436 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:36.297551 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297461 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/219f26b6-ed10-4303-8377-dcc2fb015902-serving-cert\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.297551 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297482 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9rrh\" (UniqueName: \"kubernetes.io/projected/9fceeaf4-4903-437b-950b-7b10ec3b2991-kube-api-access-w9rrh\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.297551 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297498 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-45zbb\" (UID: \"0ea32086-dfc0-433e-9296-80d539fc61b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:36.297551 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297517 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jtjc\" (UniqueName: \"kubernetes.io/projected/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-kube-api-access-4jtjc\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:36.297715 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297617 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219f26b6-ed10-4303-8377-dcc2fb015902-trusted-ca-bundle\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.297715 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297658 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc48j\" (UniqueName: \"kubernetes.io/projected/0ea32086-dfc0-433e-9296-80d539fc61b3-kube-api-access-pc48j\") pod \"cluster-samples-operator-559cbf5745-45zbb\" (UID: \"0ea32086-dfc0-433e-9296-80d539fc61b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:36.297715 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297705 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frsh2\" (UniqueName: \"kubernetes.io/projected/a731d5f3-12c2-4b18-9158-373cd4c95585-kube-api-access-frsh2\") pod \"volume-data-source-validator-5b8776669-cv4cz\" (UID: \"a731d5f3-12c2-4b18-9158-373cd4c95585\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cv4cz" Jul 31 21:29:36.297858 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297742 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df0856c9-b2d9-4ced-a894-76e04d2878fe-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-4ckf8\" (UID: \"df0856c9-b2d9-4ced-a894-76e04d2878fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" Jul 31 21:29:36.297858 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297768 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w57w\" (UniqueName: \"kubernetes.io/projected/b7ad8918-7927-4cda-b378-b3ca3ef1412c-kube-api-access-8w57w\") pod \"network-check-source-65bdbbff45-9qpb6\" (UID: \"b7ad8918-7927-4cda-b378-b3ca3ef1412c\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9qpb6" Jul 31 21:29:36.297858 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297795 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/219f26b6-ed10-4303-8377-dcc2fb015902-snapshots\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.297858 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297819 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw7n9\" (UniqueName: \"kubernetes.io/projected/219f26b6-ed10-4303-8377-dcc2fb015902-kube-api-access-dw7n9\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.297858 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297850 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219f26b6-ed10-4303-8377-dcc2fb015902-service-ca-bundle\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.298101 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297932 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fceeaf4-4903-437b-950b-7b10ec3b2991-config\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.298101 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.297966 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df0856c9-b2d9-4ced-a894-76e04d2878fe-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-4ckf8\" (UID: \"df0856c9-b2d9-4ced-a894-76e04d2878fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" Jul 31 21:29:36.298101 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.298013 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5plwc\" (UniqueName: \"kubernetes.io/projected/df0856c9-b2d9-4ced-a894-76e04d2878fe-kube-api-access-5plwc\") pod \"kube-storage-version-migrator-operator-7878f4b88c-4ckf8\" (UID: \"df0856c9-b2d9-4ced-a894-76e04d2878fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" Jul 31 21:29:36.298101 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.298052 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fceeaf4-4903-437b-950b-7b10ec3b2991-serving-cert\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.298101 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.298069 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fceeaf4-4903-437b-950b-7b10ec3b2991-trusted-ca\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.298101 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.298085 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/219f26b6-ed10-4303-8377-dcc2fb015902-tmp\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.298101 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.298100 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:36.298499 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.298411 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fceeaf4-4903-437b-950b-7b10ec3b2991-config\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.298780 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.298761 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fceeaf4-4903-437b-950b-7b10ec3b2991-trusted-ca\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.300301 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.300285 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fceeaf4-4903-437b-950b-7b10ec3b2991-serving-cert\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.338509 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.338485 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9rrh\" (UniqueName: \"kubernetes.io/projected/9fceeaf4-4903-437b-950b-7b10ec3b2991-kube-api-access-w9rrh\") pod \"console-operator-5ccd6b445f-l9tz9\" (UID: \"9fceeaf4-4903-437b-950b-7b10ec3b2991\") " pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.398315 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398271 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5plwc\" (UniqueName: \"kubernetes.io/projected/df0856c9-b2d9-4ced-a894-76e04d2878fe-kube-api-access-5plwc\") pod \"kube-storage-version-migrator-operator-7878f4b88c-4ckf8\" (UID: \"df0856c9-b2d9-4ced-a894-76e04d2878fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" Jul 31 21:29:36.398315 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398304 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/219f26b6-ed10-4303-8377-dcc2fb015902-tmp\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.398451 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398321 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:36.398451 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398350 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:36.398451 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398375 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/219f26b6-ed10-4303-8377-dcc2fb015902-serving-cert\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.398451 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398404 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-45zbb\" (UID: \"0ea32086-dfc0-433e-9296-80d539fc61b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:36.398451 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:36.398430 2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:36.398748 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398427 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jtjc\" (UniqueName: \"kubernetes.io/projected/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-kube-api-access-4jtjc\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:36.398748 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:36.398493 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls podName:9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:36.898476577 +0000 UTC m=+237.132708602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x8ckw" (UID: "9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5") : secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:36.398748 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:36.398510 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 21:29:36.398748 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398542 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219f26b6-ed10-4303-8377-dcc2fb015902-trusted-ca-bundle\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.398748 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:36.398562 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls podName:0ea32086-dfc0-433e-9296-80d539fc61b3 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:36.898546825 +0000 UTC m=+237.132778842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-45zbb" (UID: "0ea32086-dfc0-433e-9296-80d539fc61b3") : secret "samples-operator-tls" not found Jul 31 21:29:36.398748 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398606 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc48j\" (UniqueName: \"kubernetes.io/projected/0ea32086-dfc0-433e-9296-80d539fc61b3-kube-api-access-pc48j\") pod \"cluster-samples-operator-559cbf5745-45zbb\" (UID: \"0ea32086-dfc0-433e-9296-80d539fc61b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:36.398748 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398644 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frsh2\" (UniqueName: \"kubernetes.io/projected/a731d5f3-12c2-4b18-9158-373cd4c95585-kube-api-access-frsh2\") pod \"volume-data-source-validator-5b8776669-cv4cz\" (UID: \"a731d5f3-12c2-4b18-9158-373cd4c95585\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cv4cz" Jul 31 21:29:36.398748 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398677 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df0856c9-b2d9-4ced-a894-76e04d2878fe-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-4ckf8\" (UID: \"df0856c9-b2d9-4ced-a894-76e04d2878fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" Jul 31 21:29:36.398748 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398691 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/219f26b6-ed10-4303-8377-dcc2fb015902-tmp\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.398748 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398704 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w57w\" (UniqueName: \"kubernetes.io/projected/b7ad8918-7927-4cda-b378-b3ca3ef1412c-kube-api-access-8w57w\") pod \"network-check-source-65bdbbff45-9qpb6\" (UID: \"b7ad8918-7927-4cda-b378-b3ca3ef1412c\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9qpb6" Jul 31 21:29:36.399249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398748 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/219f26b6-ed10-4303-8377-dcc2fb015902-snapshots\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.399249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398793 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw7n9\" (UniqueName: \"kubernetes.io/projected/219f26b6-ed10-4303-8377-dcc2fb015902-kube-api-access-dw7n9\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.399249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398829 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219f26b6-ed10-4303-8377-dcc2fb015902-service-ca-bundle\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.399249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.398873 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df0856c9-b2d9-4ced-a894-76e04d2878fe-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-4ckf8\" (UID: \"df0856c9-b2d9-4ced-a894-76e04d2878fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" Jul 31 21:29:36.399249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.399213 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:36.399485 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.399407 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df0856c9-b2d9-4ced-a894-76e04d2878fe-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-4ckf8\" (UID: \"df0856c9-b2d9-4ced-a894-76e04d2878fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" Jul 31 21:29:36.399485 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.399448 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/219f26b6-ed10-4303-8377-dcc2fb015902-snapshots\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.399597 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.399496 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219f26b6-ed10-4303-8377-dcc2fb015902-trusted-ca-bundle\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.399859 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.399837 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219f26b6-ed10-4303-8377-dcc2fb015902-service-ca-bundle\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.401181 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.401161 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df0856c9-b2d9-4ced-a894-76e04d2878fe-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-4ckf8\" (UID: \"df0856c9-b2d9-4ced-a894-76e04d2878fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" Jul 31 21:29:36.401280 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.401207 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/219f26b6-ed10-4303-8377-dcc2fb015902-serving-cert\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.410755 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.410733 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5plwc\" (UniqueName: \"kubernetes.io/projected/df0856c9-b2d9-4ced-a894-76e04d2878fe-kube-api-access-5plwc\") pod \"kube-storage-version-migrator-operator-7878f4b88c-4ckf8\" (UID: \"df0856c9-b2d9-4ced-a894-76e04d2878fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" Jul 31 21:29:36.412645 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.412622 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc48j\" (UniqueName: \"kubernetes.io/projected/0ea32086-dfc0-433e-9296-80d539fc61b3-kube-api-access-pc48j\") pod \"cluster-samples-operator-559cbf5745-45zbb\" (UID: \"0ea32086-dfc0-433e-9296-80d539fc61b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:36.413389 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.413369 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frsh2\" (UniqueName: \"kubernetes.io/projected/a731d5f3-12c2-4b18-9158-373cd4c95585-kube-api-access-frsh2\") pod \"volume-data-source-validator-5b8776669-cv4cz\" (UID: \"a731d5f3-12c2-4b18-9158-373cd4c95585\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cv4cz" Jul 31 21:29:36.414306 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.414280 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w57w\" (UniqueName: \"kubernetes.io/projected/b7ad8918-7927-4cda-b378-b3ca3ef1412c-kube-api-access-8w57w\") pod \"network-check-source-65bdbbff45-9qpb6\" (UID: \"b7ad8918-7927-4cda-b378-b3ca3ef1412c\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9qpb6" Jul 31 21:29:36.431528 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.431511 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jtjc\" (UniqueName: \"kubernetes.io/projected/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-kube-api-access-4jtjc\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:36.439196 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.439180 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw7n9\" (UniqueName: \"kubernetes.io/projected/219f26b6-ed10-4303-8377-dcc2fb015902-kube-api-access-dw7n9\") pod \"insights-operator-77696685b-nrx4s\" (UID: \"219f26b6-ed10-4303-8377-dcc2fb015902\") " pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.441992 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.441972 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:36.516216 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.516108 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-nrx4s" Jul 31 21:29:36.523341 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.523319 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9qpb6" Jul 31 21:29:36.537823 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.537792 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" Jul 31 21:29:36.541622 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.541476 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cv4cz" Jul 31 21:29:36.569589 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.568693 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-l9tz9"] Jul 31 21:29:36.571901 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:29:36.571844 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fceeaf4_4903_437b_950b_7b10ec3b2991.slice/crio-29cafb1fcc75c19cb4b96f13bdb67a96542390d00bc4cc8b0b9a31b717615d0a WatchSource:0}: Error finding container 29cafb1fcc75c19cb4b96f13bdb67a96542390d00bc4cc8b0b9a31b717615d0a: Status 404 returned error can't find the container with id 29cafb1fcc75c19cb4b96f13bdb67a96542390d00bc4cc8b0b9a31b717615d0a Jul 31 21:29:36.694240 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.694007 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-nrx4s"] Jul 31 21:29:36.696105 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.696077 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-9qpb6"] Jul 31 21:29:36.697134 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:29:36.697109 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219f26b6_ed10_4303_8377_dcc2fb015902.slice/crio-4b054b9022f3b20eabbdde778d808604f943cec459099bffdf8ed2c2f22b9088 WatchSource:0}: Error finding container 4b054b9022f3b20eabbdde778d808604f943cec459099bffdf8ed2c2f22b9088: Status 404 returned error can't find the container with id 4b054b9022f3b20eabbdde778d808604f943cec459099bffdf8ed2c2f22b9088 Jul 31 21:29:36.699238 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:29:36.699153 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ad8918_7927_4cda_b378_b3ca3ef1412c.slice/crio-3b43a4ac554a29900e0cab0b2131783e52a166e489da9e043a2ba0a36ebaca28 WatchSource:0}: Error finding container 3b43a4ac554a29900e0cab0b2131783e52a166e489da9e043a2ba0a36ebaca28: Status 404 returned error can't find the container with id 3b43a4ac554a29900e0cab0b2131783e52a166e489da9e043a2ba0a36ebaca28 Jul 31 21:29:36.711762 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.711740 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8"] Jul 31 21:29:36.714398 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:29:36.714375 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0856c9_b2d9_4ced_a894_76e04d2878fe.slice/crio-559eb72ba5a2fe7cfa98f8611b7228b6b5ec661c63d5398b99e9d50868adff72 WatchSource:0}: Error finding container 559eb72ba5a2fe7cfa98f8611b7228b6b5ec661c63d5398b99e9d50868adff72: Status 404 returned error can't find the container with id 559eb72ba5a2fe7cfa98f8611b7228b6b5ec661c63d5398b99e9d50868adff72 Jul 31 21:29:36.726997 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.726957 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cv4cz"] Jul 31 21:29:36.732795 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:29:36.732776 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda731d5f3_12c2_4b18_9158_373cd4c95585.slice/crio-b537588ccf84154a32df02627f8753ecaab98bf639a4a556e6043f415fc00844 WatchSource:0}: Error finding container b537588ccf84154a32df02627f8753ecaab98bf639a4a556e6043f415fc00844: Status 404 returned error can't find the container with id b537588ccf84154a32df02627f8753ecaab98bf639a4a556e6043f415fc00844 Jul 31 21:29:36.874153 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.874120 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" event={"ID":"9fceeaf4-4903-437b-950b-7b10ec3b2991","Type":"ContainerStarted","Data":"29cafb1fcc75c19cb4b96f13bdb67a96542390d00bc4cc8b0b9a31b717615d0a"} Jul 31 21:29:36.875154 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.875123 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" event={"ID":"df0856c9-b2d9-4ced-a894-76e04d2878fe","Type":"ContainerStarted","Data":"559eb72ba5a2fe7cfa98f8611b7228b6b5ec661c63d5398b99e9d50868adff72"} Jul 31 21:29:36.876557 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.876534 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9qpb6" event={"ID":"b7ad8918-7927-4cda-b378-b3ca3ef1412c","Type":"ContainerStarted","Data":"4454f97acf19cef4c21754266d19d2bbeb61ea5db4de213ce251dd310efafdd5"} Jul 31 21:29:36.876674 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.876574 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9qpb6" event={"ID":"b7ad8918-7927-4cda-b378-b3ca3ef1412c","Type":"ContainerStarted","Data":"3b43a4ac554a29900e0cab0b2131783e52a166e489da9e043a2ba0a36ebaca28"} Jul 31 21:29:36.877667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.877646 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cv4cz" event={"ID":"a731d5f3-12c2-4b18-9158-373cd4c95585","Type":"ContainerStarted","Data":"b537588ccf84154a32df02627f8753ecaab98bf639a4a556e6043f415fc00844"} Jul 31 21:29:36.878631 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.878614 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-nrx4s" event={"ID":"219f26b6-ed10-4303-8377-dcc2fb015902","Type":"ContainerStarted","Data":"4b054b9022f3b20eabbdde778d808604f943cec459099bffdf8ed2c2f22b9088"} Jul 31 21:29:36.899378 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.899333 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-9qpb6" podStartSLOduration=0.899316087 podStartE2EDuration="899.316087ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:29:36.898320442 +0000 UTC m=+237.132552480" watchObservedRunningTime="2026-07-31 21:29:36.899316087 +0000 UTC m=+237.133548109" Jul 31 21:29:36.902547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.902530 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-45zbb\" (UID: \"0ea32086-dfc0-433e-9296-80d539fc61b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:36.902634 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:36.902620 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:36.902689 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:36.902657 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 21:29:36.902732 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:36.902713 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls podName:0ea32086-dfc0-433e-9296-80d539fc61b3 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:37.902700482 +0000 UTC m=+238.136932499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-45zbb" (UID: "0ea32086-dfc0-433e-9296-80d539fc61b3") : secret "samples-operator-tls" not found Jul 31 21:29:36.902732 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:36.902717 2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:36.902807 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:36.902751 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls podName:9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:37.902741255 +0000 UTC m=+238.136973273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x8ckw" (UID: "9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5") : secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:37.911294 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:37.911262 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-45zbb\" (UID: \"0ea32086-dfc0-433e-9296-80d539fc61b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:37.911725 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:37.911386 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:37.911725 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:37.911533 2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:37.911725 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:37.911598 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls podName:9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:39.911578703 +0000 UTC m=+240.145810733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x8ckw" (UID: "9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5") : secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:37.912103 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:37.912027 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 21:29:37.912103 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:37.912081 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls podName:0ea32086-dfc0-433e-9296-80d539fc61b3 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:39.912066569 +0000 UTC m=+240.146298590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-45zbb" (UID: "0ea32086-dfc0-433e-9296-80d539fc61b3") : secret "samples-operator-tls" not found Jul 31 21:29:38.888717 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:38.888680 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cv4cz" event={"ID":"a731d5f3-12c2-4b18-9158-373cd4c95585","Type":"ContainerStarted","Data":"7f310072cfcaf50a155eb0d390b556dce70893444dcfd56b80f1fc6c742f6016"} Jul 31 21:29:38.907092 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:38.907035 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cv4cz" podStartSLOduration=1.5888825789999999 podStartE2EDuration="2.907013343s" totalImagesPullingTime="1.318130764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:29:38.906565166 +0000 UTC m=+239.140797206" watchObservedRunningTime="2026-07-31 21:29:38.907013343 +0000 UTC m=+239.141245383" Jul 31 21:29:39.897334 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:39.897299 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" event={"ID":"df0856c9-b2d9-4ced-a894-76e04d2878fe","Type":"ContainerStarted","Data":"1bddebc392f1e8194b5359fa9028cf643f6474b2840a62ba34870a639dd16166"} Jul 31 21:29:39.898823 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:39.898783 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-nrx4s" event={"ID":"219f26b6-ed10-4303-8377-dcc2fb015902","Type":"ContainerStarted","Data":"f11e67b31a70fca1709a1560b9772acac24b16a12c14e5968336f22d1f683c0a"} Jul 31 21:29:39.900344 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:39.900325 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/0.log" Jul 31 21:29:39.900451 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:39.900362 2548 generic.go:356] "Generic (PLEG): container finished" podID="9fceeaf4-4903-437b-950b-7b10ec3b2991" containerID="9bfa88139580d1001a86eba265f3cc97db061792d47f31c5cda224eb6714cb19" exitCode=255 Jul 31 21:29:39.900507 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:39.900447 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" event={"ID":"9fceeaf4-4903-437b-950b-7b10ec3b2991","Type":"ContainerDied","Data":"9bfa88139580d1001a86eba265f3cc97db061792d47f31c5cda224eb6714cb19"} Jul 31 21:29:39.900617 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:39.900604 2548 scope.go:117] "RemoveContainer" containerID="9bfa88139580d1001a86eba265f3cc97db061792d47f31c5cda224eb6714cb19" Jul 31 21:29:39.928382 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:39.928358 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:39.928496 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:39.928409 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-45zbb\" (UID: \"0ea32086-dfc0-433e-9296-80d539fc61b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:39.928557 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:39.928493 2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:39.928557 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:39.928494 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 21:29:39.928557 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:39.928541 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls podName:9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:43.928528416 +0000 UTC m=+244.162760433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x8ckw" (UID: "9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5") : secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:39.928703 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:39.928625 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls podName:0ea32086-dfc0-433e-9296-80d539fc61b3 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:43.928595561 +0000 UTC m=+244.162827594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-45zbb" (UID: "0ea32086-dfc0-433e-9296-80d539fc61b3") : secret "samples-operator-tls" not found Jul 31 21:29:39.928774 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:39.928735 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" podStartSLOduration=0.911279714 podStartE2EDuration="3.928719052s" totalImagesPullingTime="3.017439338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:29:39.928055299 +0000 UTC m=+240.162287341" watchObservedRunningTime="2026-07-31 21:29:39.928719052 +0000 UTC m=+240.162951094" Jul 31 21:29:39.961734 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:39.961649 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-nrx4s" podStartSLOduration=0.931074638 podStartE2EDuration="3.96163216s" totalImagesPullingTime="3.030557522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:29:39.96025782 +0000 UTC m=+240.194489860" watchObservedRunningTime="2026-07-31 21:29:39.96163216 +0000 UTC m=+240.195864200" Jul 31 21:29:40.663980 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.663949 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rvm6m"] Jul 31 21:29:40.667922 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.667886 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.670701 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.670680 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 31 21:29:40.670823 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.670713 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bdrnr\"" Jul 31 21:29:40.670823 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.670735 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 31 21:29:40.683266 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.683241 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rvm6m"] Jul 31 21:29:40.734849 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.734825 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjz5p\" (UniqueName: \"kubernetes.io/projected/acb59409-232c-4e00-88c2-516280ca9169-kube-api-access-jjz5p\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.734968 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.734870 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.734968 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.734888 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/acb59409-232c-4e00-88c2-516280ca9169-data-volume\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.735053 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.734976 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/acb59409-232c-4e00-88c2-516280ca9169-crio-socket\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.735053 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.735028 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.836098 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.836077 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjz5p\" (UniqueName: \"kubernetes.io/projected/acb59409-232c-4e00-88c2-516280ca9169-kube-api-access-jjz5p\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.836195 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.836122 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.836195 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.836137 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/acb59409-232c-4e00-88c2-516280ca9169-data-volume\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.836195 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.836174 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/acb59409-232c-4e00-88c2-516280ca9169-crio-socket\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.836291 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:40.836216 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 21:29:40.836291 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.836224 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.836349 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:40.836291 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm podName:acb59409-232c-4e00-88c2-516280ca9169 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:41.336272065 +0000 UTC m=+241.570504098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvm6m" (UID: "acb59409-232c-4e00-88c2-516280ca9169") : configmap "kube-rbac-proxy" not found Jul 31 21:29:40.836349 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.836314 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/acb59409-232c-4e00-88c2-516280ca9169-crio-socket\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.836349 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:40.836322 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 21:29:40.836481 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:40.836383 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls podName:acb59409-232c-4e00-88c2-516280ca9169 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:41.336370317 +0000 UTC m=+241.570602334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvm6m" (UID: "acb59409-232c-4e00-88c2-516280ca9169") : secret "insights-runtime-extractor-tls" not found Jul 31 21:29:40.836481 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.836450 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/acb59409-232c-4e00-88c2-516280ca9169-data-volume\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.849582 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.849556 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjz5p\" (UniqueName: \"kubernetes.io/projected/acb59409-232c-4e00-88c2-516280ca9169-kube-api-access-jjz5p\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:40.905164 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.905141 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/1.log" Jul 31 21:29:40.905525 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.905513 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/0.log" Jul 31 21:29:40.905577 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.905548 2548 generic.go:356] "Generic (PLEG): container finished" podID="9fceeaf4-4903-437b-950b-7b10ec3b2991" containerID="2c2a343534899d030fab329ec9a47698eeaff5457452d3ee0a04357be42fc830" exitCode=255 Jul 31 21:29:40.905659 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.905633 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" event={"ID":"9fceeaf4-4903-437b-950b-7b10ec3b2991","Type":"ContainerDied","Data":"2c2a343534899d030fab329ec9a47698eeaff5457452d3ee0a04357be42fc830"} Jul 31 21:29:40.905720 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.905706 2548 scope.go:117] "RemoveContainer" containerID="9bfa88139580d1001a86eba265f3cc97db061792d47f31c5cda224eb6714cb19" Jul 31 21:29:40.905937 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:40.905895 2548 scope.go:117] "RemoveContainer" containerID="2c2a343534899d030fab329ec9a47698eeaff5457452d3ee0a04357be42fc830" Jul 31 21:29:40.906127 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:40.906103 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-l9tz9_openshift-console-operator(9fceeaf4-4903-437b-950b-7b10ec3b2991)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" podUID="9fceeaf4-4903-437b-950b-7b10ec3b2991" Jul 31 21:29:41.340089 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:41.340067 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:41.340300 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:41.340135 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:41.340300 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:41.340207 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 21:29:41.340300 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:41.340211 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 21:29:41.340300 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:41.340260 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm podName:acb59409-232c-4e00-88c2-516280ca9169 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:42.340247619 +0000 UTC m=+242.574479637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvm6m" (UID: "acb59409-232c-4e00-88c2-516280ca9169") : configmap "kube-rbac-proxy" not found Jul 31 21:29:41.340300 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:41.340284 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls podName:acb59409-232c-4e00-88c2-516280ca9169 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:42.340267199 +0000 UTC m=+242.574499236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvm6m" (UID: "acb59409-232c-4e00-88c2-516280ca9169") : secret "insights-runtime-extractor-tls" not found Jul 31 21:29:41.910237 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:41.910217 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/1.log" Jul 31 21:29:41.910709 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:41.910501 2548 scope.go:117] "RemoveContainer" containerID="2c2a343534899d030fab329ec9a47698eeaff5457452d3ee0a04357be42fc830" Jul 31 21:29:41.910709 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:41.910622 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-l9tz9_openshift-console-operator(9fceeaf4-4903-437b-950b-7b10ec3b2991)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" podUID="9fceeaf4-4903-437b-950b-7b10ec3b2991" Jul 31 21:29:42.060307 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.060280 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-tlzcw"] Jul 31 21:29:42.064478 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.064463 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" Jul 31 21:29:42.067227 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.067206 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 31 21:29:42.067584 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.067564 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 31 21:29:42.067681 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.067580 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 31 21:29:42.067681 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.067614 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 31 21:29:42.067681 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.067632 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xlj7v\"" Jul 31 21:29:42.074745 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.074729 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-tlzcw"] Jul 31 21:29:42.145949 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.145924 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scdpz\" (UniqueName: \"kubernetes.io/projected/ec814bc4-190d-4886-8428-15d4e4774af0-kube-api-access-scdpz\") pod \"service-ca-98c88fbb5-tlzcw\" (UID: \"ec814bc4-190d-4886-8428-15d4e4774af0\") " pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" Jul 31 21:29:42.146034 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.145976 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ec814bc4-190d-4886-8428-15d4e4774af0-signing-cabundle\") pod \"service-ca-98c88fbb5-tlzcw\" (UID: \"ec814bc4-190d-4886-8428-15d4e4774af0\") " pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" Jul 31 21:29:42.146034 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.146015 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ec814bc4-190d-4886-8428-15d4e4774af0-signing-key\") pod \"service-ca-98c88fbb5-tlzcw\" (UID: \"ec814bc4-190d-4886-8428-15d4e4774af0\") " pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" Jul 31 21:29:42.246683 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.246619 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ec814bc4-190d-4886-8428-15d4e4774af0-signing-key\") pod \"service-ca-98c88fbb5-tlzcw\" (UID: \"ec814bc4-190d-4886-8428-15d4e4774af0\") " pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" Jul 31 21:29:42.246782 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.246755 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scdpz\" (UniqueName: \"kubernetes.io/projected/ec814bc4-190d-4886-8428-15d4e4774af0-kube-api-access-scdpz\") pod \"service-ca-98c88fbb5-tlzcw\" (UID: \"ec814bc4-190d-4886-8428-15d4e4774af0\") " pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" Jul 31 21:29:42.246843 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.246818 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ec814bc4-190d-4886-8428-15d4e4774af0-signing-cabundle\") pod \"service-ca-98c88fbb5-tlzcw\" (UID: \"ec814bc4-190d-4886-8428-15d4e4774af0\") " pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" Jul 31 21:29:42.247337 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.247318 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ec814bc4-190d-4886-8428-15d4e4774af0-signing-cabundle\") pod \"service-ca-98c88fbb5-tlzcw\" (UID: \"ec814bc4-190d-4886-8428-15d4e4774af0\") " pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" Jul 31 21:29:42.248845 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.248824 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ec814bc4-190d-4886-8428-15d4e4774af0-signing-key\") pod \"service-ca-98c88fbb5-tlzcw\" (UID: \"ec814bc4-190d-4886-8428-15d4e4774af0\") " pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" Jul 31 21:29:42.257601 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.257582 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scdpz\" (UniqueName: \"kubernetes.io/projected/ec814bc4-190d-4886-8428-15d4e4774af0-kube-api-access-scdpz\") pod \"service-ca-98c88fbb5-tlzcw\" (UID: \"ec814bc4-190d-4886-8428-15d4e4774af0\") " pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" Jul 31 21:29:42.351287 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.347980 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:42.351287 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.348128 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:42.351287 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:42.348251 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 21:29:42.351287 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:42.348319 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm podName:acb59409-232c-4e00-88c2-516280ca9169 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:44.348297477 +0000 UTC m=+244.582529498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvm6m" (UID: "acb59409-232c-4e00-88c2-516280ca9169") : configmap "kube-rbac-proxy" not found Jul 31 21:29:42.351287 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:42.348704 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 21:29:42.351287 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:42.348757 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls podName:acb59409-232c-4e00-88c2-516280ca9169 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:44.348741693 +0000 UTC m=+244.582973714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvm6m" (UID: "acb59409-232c-4e00-88c2-516280ca9169") : secret "insights-runtime-extractor-tls" not found Jul 31 21:29:42.374056 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.374037 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" Jul 31 21:29:42.499852 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.499830 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-tlzcw"] Jul 31 21:29:42.501977 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:29:42.501951 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec814bc4_190d_4886_8428_15d4e4774af0.slice/crio-89f1924423accff84a3711f7bfedbc9ccd60b75d1e5f32f29c5abf7d54e1381d WatchSource:0}: Error finding container 89f1924423accff84a3711f7bfedbc9ccd60b75d1e5f32f29c5abf7d54e1381d: Status 404 returned error can't find the container with id 89f1924423accff84a3711f7bfedbc9ccd60b75d1e5f32f29c5abf7d54e1381d Jul 31 21:29:42.830840 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.830818 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t7rln_7a782591-1f18-4512-b13c-8e1e8f522b75/dns-node-resolver/0.log" Jul 31 21:29:42.913796 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:42.913767 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" event={"ID":"ec814bc4-190d-4886-8428-15d4e4774af0","Type":"ContainerStarted","Data":"89f1924423accff84a3711f7bfedbc9ccd60b75d1e5f32f29c5abf7d54e1381d"} Jul 31 21:29:43.427799 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:43.427770 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gtjxs_5ee371d3-576a-413b-b19f-4849899c2559/node-ca/0.log" Jul 31 21:29:43.961152 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:43.961119 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:43.961539 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:43.961175 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-45zbb\" (UID: \"0ea32086-dfc0-433e-9296-80d539fc61b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:43.961539 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:43.961265 2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:43.961539 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:43.961314 2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 21:29:43.961539 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:43.961333 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls podName:9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:51.961313175 +0000 UTC m=+252.195545211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x8ckw" (UID: "9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5") : secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:43.961539 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:43.961364 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls podName:0ea32086-dfc0-433e-9296-80d539fc61b3 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:51.961348405 +0000 UTC m=+252.195580423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-45zbb" (UID: "0ea32086-dfc0-433e-9296-80d539fc61b3") : secret "samples-operator-tls" not found Jul 31 21:29:44.364993 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:44.364956 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:44.365176 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:44.365064 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:44.365176 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:44.365095 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 21:29:44.365176 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:44.365158 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 21:29:44.365288 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:44.365180 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm podName:acb59409-232c-4e00-88c2-516280ca9169 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:48.36515847 +0000 UTC m=+248.599390488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvm6m" (UID: "acb59409-232c-4e00-88c2-516280ca9169") : configmap "kube-rbac-proxy" not found Jul 31 21:29:44.365288 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:44.365199 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls podName:acb59409-232c-4e00-88c2-516280ca9169 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:48.365188024 +0000 UTC m=+248.599420041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvm6m" (UID: "acb59409-232c-4e00-88c2-516280ca9169") : secret "insights-runtime-extractor-tls" not found Jul 31 21:29:44.628892 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:44.628832 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vpn9n_a77b984c-43b1-4cf6-b5d1-359e19752c35/serve-healthcheck-canary/0.log" Jul 31 21:29:44.920166 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:44.920108 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" event={"ID":"ec814bc4-190d-4886-8428-15d4e4774af0","Type":"ContainerStarted","Data":"e76edd9b2e1c3878f8916f6990beb7b3c0275461a9383db68af2fc91e4f4ae9f"} Jul 31 21:29:44.939876 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:44.939827 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-tlzcw" podStartSLOduration=1.008965048 podStartE2EDuration="2.939808343s" totalImagesPullingTime="1.930843295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:29:44.938997917 +0000 UTC m=+245.173229958" watchObservedRunningTime="2026-07-31 21:29:44.939808343 +0000 UTC m=+245.174040384" Jul 31 21:29:46.443131 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:46.443070 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:46.443437 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:46.443135 2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:29:46.443437 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:46.443422 2548 scope.go:117] "RemoveContainer" containerID="2c2a343534899d030fab329ec9a47698eeaff5457452d3ee0a04357be42fc830" Jul 31 21:29:46.443558 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:46.443540 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-l9tz9_openshift-console-operator(9fceeaf4-4903-437b-950b-7b10ec3b2991)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" podUID="9fceeaf4-4903-437b-950b-7b10ec3b2991" Jul 31 21:29:48.396754 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:48.396708 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:48.397205 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:48.396810 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:48.397205 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:48.397004 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 21:29:48.397205 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:48.397058 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls podName:acb59409-232c-4e00-88c2-516280ca9169 nodeName:}" failed. No retries permitted until 2026-07-31 21:29:56.397040995 +0000 UTC m=+256.631273015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvm6m" (UID: "acb59409-232c-4e00-88c2-516280ca9169") : secret "insights-runtime-extractor-tls" not found Jul 31 21:29:48.397829 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:48.397799 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/acb59409-232c-4e00-88c2-516280ca9169-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:52.021672 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:52.021642 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:29:52.022129 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:52.021690 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-45zbb\" (UID: \"0ea32086-dfc0-433e-9296-80d539fc61b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:52.022129 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:52.021709 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:29:52.022129 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:52.021793 2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:52.022129 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:52.021803 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 31 21:29:52.022129 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:52.021847 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls podName:9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5 nodeName:}" failed. No retries permitted until 2026-07-31 21:30:08.021834174 +0000 UTC m=+268.256066193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x8ckw" (UID: "9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5") : secret "cluster-monitoring-operator-tls" not found Jul 31 21:29:52.022129 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:52.021861 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs podName:a359de99-657c-4c35-bf34-31ef06ddfbc6 nodeName:}" failed. No retries permitted until 2026-07-31 21:31:54.021854949 +0000 UTC m=+374.256086970 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs") pod "network-metrics-daemon-brfzt" (UID: "a359de99-657c-4c35-bf34-31ef06ddfbc6") : secret "metrics-daemon-secret" not found Jul 31 21:29:52.024134 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:52.024114 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ea32086-dfc0-433e-9296-80d539fc61b3-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-45zbb\" (UID: \"0ea32086-dfc0-433e-9296-80d539fc61b3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:52.063646 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:52.063625 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-t579j\"" Jul 31 21:29:52.070752 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:52.070738 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" Jul 31 21:29:52.200796 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:52.200713 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb"] Jul 31 21:29:52.949601 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:52.949561 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" event={"ID":"0ea32086-dfc0-433e-9296-80d539fc61b3","Type":"ContainerStarted","Data":"59dd8c9eb84ff390b4d3bc06d00a2ad15bc868a1ebebb74ed08ba47c80ed31c5"} Jul 31 21:29:54.963151 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:54.963121 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" event={"ID":"0ea32086-dfc0-433e-9296-80d539fc61b3","Type":"ContainerStarted","Data":"4be32cb9e0878d5515a54bac83a8bf317ffb699a732483f19b4882f68a968651"} Jul 31 21:29:54.963489 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:54.963191 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" event={"ID":"0ea32086-dfc0-433e-9296-80d539fc61b3","Type":"ContainerStarted","Data":"9bd551ddcad0f6d37e44f0b940bf538f77b8a90f3bc99e1f8fdc2bb865ad73b1"} Jul 31 21:29:55.010923 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:55.010871 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-45zbb" podStartSLOduration=17.375890848 podStartE2EDuration="19.010857922s" totalImagesPullingTime="1.634967074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:29:55.009862994 +0000 UTC m=+255.244095042" watchObservedRunningTime="2026-07-31 21:29:55.010857922 +0000 UTC m=+255.245089961" Jul 31 21:29:56.451998 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:56.451971 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:56.454174 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:56.454156 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/acb59409-232c-4e00-88c2-516280ca9169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvm6m\" (UID: \"acb59409-232c-4e00-88c2-516280ca9169\") " pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:56.577013 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:56.576991 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rvm6m" Jul 31 21:29:56.717360 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:56.717304 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rvm6m"] Jul 31 21:29:56.720011 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:29:56.719984 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb59409_232c_4e00_88c2_516280ca9169.slice/crio-f0d34a8f0c5326839040244ecbdc82594ff411948a8382264b80be0e80b3af57 WatchSource:0}: Error finding container f0d34a8f0c5326839040244ecbdc82594ff411948a8382264b80be0e80b3af57: Status 404 returned error can't find the container with id f0d34a8f0c5326839040244ecbdc82594ff411948a8382264b80be0e80b3af57 Jul 31 21:29:56.970737 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:56.970656 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvm6m" event={"ID":"acb59409-232c-4e00-88c2-516280ca9169","Type":"ContainerStarted","Data":"57f7ae97317d276027e40090f6a2b86dd271890fa52e0757f5d1dcf43babde57"} Jul 31 21:29:56.970737 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:56.970725 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvm6m" event={"ID":"acb59409-232c-4e00-88c2-516280ca9169","Type":"ContainerStarted","Data":"f0d34a8f0c5326839040244ecbdc82594ff411948a8382264b80be0e80b3af57"} Jul 31 21:29:57.975468 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:57.975434 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvm6m" event={"ID":"acb59409-232c-4e00-88c2-516280ca9169","Type":"ContainerStarted","Data":"42f7c11c5b2b2d28a318fc930cf5f0ad87556b1a1566902d4234ce2755f88835"} Jul 31 21:29:58.979964 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:58.979893 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvm6m" event={"ID":"acb59409-232c-4e00-88c2-516280ca9169","Type":"ContainerStarted","Data":"531ffacbba8b3b399cc9f378a24bbbd321f63ca103e801c6f625c2ef44a52f51"} Jul 31 21:29:59.001877 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:59.001840 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rvm6m" podStartSLOduration=17.25402271 podStartE2EDuration="19.001826154s" totalImagesPullingTime="1.747803444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:29:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:29:59.000235621 +0000 UTC m=+259.234467660" watchObservedRunningTime="2026-07-31 21:29:59.001826154 +0000 UTC m=+259.236058194" Jul 31 21:29:59.170115 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:59.170092 2548 scope.go:117] "RemoveContainer" containerID="2c2a343534899d030fab329ec9a47698eeaff5457452d3ee0a04357be42fc830" Jul 31 21:29:59.984651 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:59.984630 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:29:59.985006 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:59.984993 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/1.log" Jul 31 21:29:59.985050 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:59.985026 2548 generic.go:356] "Generic (PLEG): container finished" podID="9fceeaf4-4903-437b-950b-7b10ec3b2991" containerID="cc1a7ea25123fa99276f4a2fe39d7535c65e066f3f3597a92f449b9c379f088e" exitCode=255 Jul 31 21:29:59.985125 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:59.985106 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" event={"ID":"9fceeaf4-4903-437b-950b-7b10ec3b2991","Type":"ContainerDied","Data":"cc1a7ea25123fa99276f4a2fe39d7535c65e066f3f3597a92f449b9c379f088e"} Jul 31 21:29:59.985177 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:59.985165 2548 scope.go:117] "RemoveContainer" containerID="2c2a343534899d030fab329ec9a47698eeaff5457452d3ee0a04357be42fc830" Jul 31 21:29:59.985574 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:29:59.985553 2548 scope.go:117] "RemoveContainer" containerID="cc1a7ea25123fa99276f4a2fe39d7535c65e066f3f3597a92f449b9c379f088e" Jul 31 21:29:59.985720 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:29:59.985702 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-l9tz9_openshift-console-operator(9fceeaf4-4903-437b-950b-7b10ec3b2991)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" podUID="9fceeaf4-4903-437b-950b-7b10ec3b2991" Jul 31 21:30:00.988793 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:00.988737 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:30:06.442071 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:06.442033 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:30:06.442466 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:06.442101 2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:30:06.442466 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:06.442340 2548 scope.go:117] "RemoveContainer" containerID="cc1a7ea25123fa99276f4a2fe39d7535c65e066f3f3597a92f449b9c379f088e" Jul 31 21:30:06.442542 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:30:06.442464 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-l9tz9_openshift-console-operator(9fceeaf4-4903-437b-950b-7b10ec3b2991)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" podUID="9fceeaf4-4903-437b-950b-7b10ec3b2991" Jul 31 21:30:08.033187 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:08.033148 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:30:08.035532 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:08.035514 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x8ckw\" (UID: \"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:30:08.334160 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:08.334141 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8cl5v\"" Jul 31 21:30:08.341275 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:08.341258 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" Jul 31 21:30:08.486320 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:08.486232 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw"] Jul 31 21:30:08.488809 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:30:08.488786 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e65bb6a_9887_4ae8_9f1c_dae7cdc55ca5.slice/crio-9fc422d6b66ede75d356404b7304d8be3649813acc4b5af066cd0096ff827580 WatchSource:0}: Error finding container 9fc422d6b66ede75d356404b7304d8be3649813acc4b5af066cd0096ff827580: Status 404 returned error can't find the container with id 9fc422d6b66ede75d356404b7304d8be3649813acc4b5af066cd0096ff827580 Jul 31 21:30:09.016692 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:09.016664 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" event={"ID":"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5","Type":"ContainerStarted","Data":"9fc422d6b66ede75d356404b7304d8be3649813acc4b5af066cd0096ff827580"} Jul 31 21:30:10.975614 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:10.975584 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48"] Jul 31 21:30:10.978641 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:10.978627 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48" Jul 31 21:30:10.989723 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:10.989705 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zgpjs\"" Jul 31 21:30:10.991855 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:10.991838 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 31 21:30:10.999226 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:10.999203 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48"] Jul 31 21:30:11.024285 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:11.024260 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" event={"ID":"9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5","Type":"ContainerStarted","Data":"193dd43cd92cf9308eee1602425807a74336e4a32d4e6dda6364ab8b9faab459"} Jul 31 21:30:11.052382 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:11.052361 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4106e60c-f5ab-46b2-bff7-af24b62d42ac-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-vrv48\" (UID: \"4106e60c-f5ab-46b2-bff7-af24b62d42ac\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48" Jul 31 21:30:11.052895 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:11.052774 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x8ckw" podStartSLOduration=33.38224178 podStartE2EDuration="35.052759364s" totalImagesPullingTime="1.670517584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:11.052605413 +0000 UTC m=+271.286837453" watchObservedRunningTime="2026-07-31 21:30:11.052759364 +0000 UTC m=+271.286991405" Jul 31 21:30:11.153677 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:11.153655 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4106e60c-f5ab-46b2-bff7-af24b62d42ac-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-vrv48\" (UID: \"4106e60c-f5ab-46b2-bff7-af24b62d42ac\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48" Jul 31 21:30:11.155990 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:11.155971 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4106e60c-f5ab-46b2-bff7-af24b62d42ac-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-vrv48\" (UID: \"4106e60c-f5ab-46b2-bff7-af24b62d42ac\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48" Jul 31 21:30:11.288661 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:11.288615 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48" Jul 31 21:30:11.421855 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:11.421834 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48"] Jul 31 21:30:11.423770 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:30:11.423748 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4106e60c_f5ab_46b2_bff7_af24b62d42ac.slice/crio-6969f3943bb9de89c5111e655d58d083bfd67e05e9d0a449b1b44f2ee87b36c6 WatchSource:0}: Error finding container 6969f3943bb9de89c5111e655d58d083bfd67e05e9d0a449b1b44f2ee87b36c6: Status 404 returned error can't find the container with id 6969f3943bb9de89c5111e655d58d083bfd67e05e9d0a449b1b44f2ee87b36c6 Jul 31 21:30:12.028390 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:12.028358 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48" event={"ID":"4106e60c-f5ab-46b2-bff7-af24b62d42ac","Type":"ContainerStarted","Data":"6969f3943bb9de89c5111e655d58d083bfd67e05e9d0a449b1b44f2ee87b36c6"} Jul 31 21:30:13.032725 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:13.032669 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48" event={"ID":"4106e60c-f5ab-46b2-bff7-af24b62d42ac","Type":"ContainerStarted","Data":"3fc09989d85a312dc367dc8a5c2371c9498a34f5de47e058e4f326a95204b802"} Jul 31 21:30:13.033054 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:13.032855 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48" Jul 31 21:30:13.037120 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:13.037101 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48" Jul 31 21:30:13.050216 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:13.050177 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-vrv48" podStartSLOduration=1.765249796 podStartE2EDuration="3.050164594s" totalImagesPullingTime="1.284914798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:13.049654256 +0000 UTC m=+273.283886294" watchObservedRunningTime="2026-07-31 21:30:13.050164594 +0000 UTC m=+273.284396632" Jul 31 21:30:18.378579 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.378550 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6"] Jul 31 21:30:18.381701 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.381680 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.386459 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.386436 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-p7nxf\"" Jul 31 21:30:18.387131 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.386734 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 31 21:30:18.387131 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.386864 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 31 21:30:18.387131 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.386741 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 31 21:30:18.395515 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.395455 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6"] Jul 31 21:30:18.404764 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.404745 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf"] Jul 31 21:30:18.407583 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.407565 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.408306 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.408285 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41631157-646d-4883-aee8-c52119ba1256-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.408424 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.408394 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6jnj\" (UniqueName: \"kubernetes.io/projected/41631157-646d-4883-aee8-c52119ba1256-kube-api-access-h6jnj\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.408486 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.408434 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41631157-646d-4883-aee8-c52119ba1256-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.408586 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.408486 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/41631157-646d-4883-aee8-c52119ba1256-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.414832 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.414816 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 31 21:30:18.415102 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.415086 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 31 21:30:18.415843 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.415826 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 31 21:30:18.415963 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.415867 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qsw8w\"" Jul 31 21:30:18.423310 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.423277 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xpl7c"] Jul 31 21:30:18.426164 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.426145 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf"] Jul 31 21:30:18.426463 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.426284 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.429310 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.429292 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 31 21:30:18.429455 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.429437 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 31 21:30:18.429549 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.429331 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fkndm\"" Jul 31 21:30:18.429812 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.429796 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 31 21:30:18.509795 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.509765 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-wtmp\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.509950 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.509802 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41631157-646d-4883-aee8-c52119ba1256-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.509950 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.509819 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlxc9\" (UniqueName: \"kubernetes.io/projected/1939eb9a-abc4-45a1-8ba9-804771b89fe2-kube-api-access-xlxc9\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.509950 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.509836 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc151d83-10a0-4c9d-aa65-dd1519228c66-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.510136 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.509956 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/41631157-646d-4883-aee8-c52119ba1256-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.510136 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510005 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t8jg\" (UniqueName: \"kubernetes.io/projected/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-api-access-9t8jg\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.510136 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510032 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1939eb9a-abc4-45a1-8ba9-804771b89fe2-metrics-client-ca\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.510136 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510079 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41631157-646d-4883-aee8-c52119ba1256-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.510136 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510105 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-textfile\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.510378 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510141 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-tls\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.510378 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510169 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-accelerators-collector-config\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.510378 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510220 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1939eb9a-abc4-45a1-8ba9-804771b89fe2-sys\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.510378 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510252 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1939eb9a-abc4-45a1-8ba9-804771b89fe2-root\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.510378 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510279 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.510378 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510357 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.510635 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510412 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.510635 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510444 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.510635 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510477 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6jnj\" (UniqueName: \"kubernetes.io/projected/41631157-646d-4883-aee8-c52119ba1256-kube-api-access-h6jnj\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.510635 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510497 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc151d83-10a0-4c9d-aa65-dd1519228c66-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.510825 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.510642 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41631157-646d-4883-aee8-c52119ba1256-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.513108 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.513088 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/41631157-646d-4883-aee8-c52119ba1256-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.513202 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.513186 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41631157-646d-4883-aee8-c52119ba1256-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.529233 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.529209 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6jnj\" (UniqueName: \"kubernetes.io/projected/41631157-646d-4883-aee8-c52119ba1256-kube-api-access-h6jnj\") pod \"openshift-state-metrics-6bb4d7b4dd-bdbm6\" (UID: \"41631157-646d-4883-aee8-c52119ba1256\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.610923 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.610888 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t8jg\" (UniqueName: \"kubernetes.io/projected/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-api-access-9t8jg\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.611016 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.610930 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1939eb9a-abc4-45a1-8ba9-804771b89fe2-metrics-client-ca\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611016 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.610955 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-textfile\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611016 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.610979 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-tls\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611164 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611017 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-accelerators-collector-config\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611164 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611044 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1939eb9a-abc4-45a1-8ba9-804771b89fe2-sys\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611164 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611060 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1939eb9a-abc4-45a1-8ba9-804771b89fe2-root\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611164 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611085 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611164 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611159 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1939eb9a-abc4-45a1-8ba9-804771b89fe2-sys\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611404 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611215 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.611404 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611236 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1939eb9a-abc4-45a1-8ba9-804771b89fe2-root\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611404 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611277 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-textfile\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611404 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611275 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.611404 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611336 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.611404 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611371 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc151d83-10a0-4c9d-aa65-dd1519228c66-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.611673 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611519 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-wtmp\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611673 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611554 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlxc9\" (UniqueName: \"kubernetes.io/projected/1939eb9a-abc4-45a1-8ba9-804771b89fe2-kube-api-access-xlxc9\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611673 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611581 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc151d83-10a0-4c9d-aa65-dd1519228c66-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.611673 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611628 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1939eb9a-abc4-45a1-8ba9-804771b89fe2-metrics-client-ca\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611864 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611700 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-accelerators-collector-config\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611864 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611755 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-wtmp\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.611992 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.611898 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dc151d83-10a0-4c9d-aa65-dd1519228c66-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.612157 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.612134 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.612324 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.612308 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc151d83-10a0-4c9d-aa65-dd1519228c66-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.613839 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.613811 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.614212 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.614193 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.614301 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.614275 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1939eb9a-abc4-45a1-8ba9-804771b89fe2-node-exporter-tls\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.614350 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.614294 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.627043 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.627020 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t8jg\" (UniqueName: \"kubernetes.io/projected/dc151d83-10a0-4c9d-aa65-dd1519228c66-kube-api-access-9t8jg\") pod \"kube-state-metrics-6bd9664c4-lhnrf\" (UID: \"dc151d83-10a0-4c9d-aa65-dd1519228c66\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.627117 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.627103 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlxc9\" (UniqueName: \"kubernetes.io/projected/1939eb9a-abc4-45a1-8ba9-804771b89fe2-kube-api-access-xlxc9\") pod \"node-exporter-xpl7c\" (UID: \"1939eb9a-abc4-45a1-8ba9-804771b89fe2\") " pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.693215 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.693168 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" Jul 31 21:30:18.717243 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.717219 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" Jul 31 21:30:18.736562 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.736541 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xpl7c" Jul 31 21:30:18.749327 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:30:18.749293 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1939eb9a_abc4_45a1_8ba9_804771b89fe2.slice/crio-f296ad6b8606d443025495d536e3108a988421d55de2012e72160c17b07b59d1 WatchSource:0}: Error finding container f296ad6b8606d443025495d536e3108a988421d55de2012e72160c17b07b59d1: Status 404 returned error can't find the container with id f296ad6b8606d443025495d536e3108a988421d55de2012e72160c17b07b59d1 Jul 31 21:30:18.836274 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.836251 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6"] Jul 31 21:30:18.838016 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:30:18.837990 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41631157_646d_4883_aee8_c52119ba1256.slice/crio-356456e8d1ed432370f69de484e80f08a0f311e65e310a0a7030ec100f4ee219 WatchSource:0}: Error finding container 356456e8d1ed432370f69de484e80f08a0f311e65e310a0a7030ec100f4ee219: Status 404 returned error can't find the container with id 356456e8d1ed432370f69de484e80f08a0f311e65e310a0a7030ec100f4ee219 Jul 31 21:30:18.857011 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:18.856992 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf"] Jul 31 21:30:18.870807 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:30:18.870782 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc151d83_10a0_4c9d_aa65_dd1519228c66.slice/crio-37cb7798e4255a40b616b91ea2129aec9b36b679889c0bd7cf96105437e82303 WatchSource:0}: Error finding container 37cb7798e4255a40b616b91ea2129aec9b36b679889c0bd7cf96105437e82303: Status 404 returned error can't find the container with id 37cb7798e4255a40b616b91ea2129aec9b36b679889c0bd7cf96105437e82303 Jul 31 21:30:19.051170 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:19.051143 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpl7c" event={"ID":"1939eb9a-abc4-45a1-8ba9-804771b89fe2","Type":"ContainerStarted","Data":"f296ad6b8606d443025495d536e3108a988421d55de2012e72160c17b07b59d1"} Jul 31 21:30:19.052149 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:19.052129 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" event={"ID":"dc151d83-10a0-4c9d-aa65-dd1519228c66","Type":"ContainerStarted","Data":"37cb7798e4255a40b616b91ea2129aec9b36b679889c0bd7cf96105437e82303"} Jul 31 21:30:19.053610 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:19.053594 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" event={"ID":"41631157-646d-4883-aee8-c52119ba1256","Type":"ContainerStarted","Data":"e214f97a35d77f8d7336424b057b072e639614509a901d1bc77903481c113fa6"} Jul 31 21:30:19.053681 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:19.053628 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" event={"ID":"41631157-646d-4883-aee8-c52119ba1256","Type":"ContainerStarted","Data":"90ae90a2acb926a29c2220b7549f8638ca7bf44b73105ce8442cce103c8dc04a"} Jul 31 21:30:19.053681 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:19.053646 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" event={"ID":"41631157-646d-4883-aee8-c52119ba1256","Type":"ContainerStarted","Data":"356456e8d1ed432370f69de484e80f08a0f311e65e310a0a7030ec100f4ee219"} Jul 31 21:30:20.060922 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:20.060829 2548 generic.go:356] "Generic (PLEG): container finished" podID="1939eb9a-abc4-45a1-8ba9-804771b89fe2" containerID="825e5ad78b1ccc13ba684e9b45dfb66811103f8270497a1723aa790520a939e9" exitCode=0 Jul 31 21:30:20.061326 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:20.060966 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpl7c" event={"ID":"1939eb9a-abc4-45a1-8ba9-804771b89fe2","Type":"ContainerDied","Data":"825e5ad78b1ccc13ba684e9b45dfb66811103f8270497a1723aa790520a939e9"} Jul 31 21:30:20.171850 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:20.171809 2548 scope.go:117] "RemoveContainer" containerID="cc1a7ea25123fa99276f4a2fe39d7535c65e066f3f3597a92f449b9c379f088e" Jul 31 21:30:21.067499 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.067417 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:30:21.067957 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.067526 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" event={"ID":"9fceeaf4-4903-437b-950b-7b10ec3b2991","Type":"ContainerStarted","Data":"82d6c5003ab867ac46c3673390ec123288d4d7b6ce436183f72770a68ac1b4b7"} Jul 31 21:30:21.067957 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.067879 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:30:21.070070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.070038 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" event={"ID":"dc151d83-10a0-4c9d-aa65-dd1519228c66","Type":"ContainerStarted","Data":"d04bb616650768882c8f8938f2c187a1add427a72a9e18eea1680572ba9afba0"} Jul 31 21:30:21.070184 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.070093 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" event={"ID":"dc151d83-10a0-4c9d-aa65-dd1519228c66","Type":"ContainerStarted","Data":"1b33753ae8cbe10e0235866181bcf4c6afd8e0f840e65f0491d861cfd8fc6e14"} Jul 31 21:30:21.070184 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.070115 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" event={"ID":"dc151d83-10a0-4c9d-aa65-dd1519228c66","Type":"ContainerStarted","Data":"07c9f235749cf14cd8d7bfed1bc7a94b61523bf15aab9c165038d9c2bf122a77"} Jul 31 21:30:21.072398 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.072367 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" event={"ID":"41631157-646d-4883-aee8-c52119ba1256","Type":"ContainerStarted","Data":"a7556db2830de16ee18160f69b7ddbc4a246b635b8e23e1643e536048dd93b65"} Jul 31 21:30:21.074486 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.074467 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpl7c" event={"ID":"1939eb9a-abc4-45a1-8ba9-804771b89fe2","Type":"ContainerStarted","Data":"5ca4d4c83b1cb329ace7946387b325e6587f1e3991781bb8f2517d9f1461876c"} Jul 31 21:30:21.074585 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.074506 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xpl7c" event={"ID":"1939eb9a-abc4-45a1-8ba9-804771b89fe2","Type":"ContainerStarted","Data":"4da07362e84c5ca0ab05fba873852fa0d94d04caf73e172671c0d4a026f8e95f"} Jul 31 21:30:21.086531 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.086455 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" podStartSLOduration=41.933238022 podStartE2EDuration="45.086437804s" totalImagesPullingTime="3.153199782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:21.084289301 +0000 UTC m=+281.318521341" watchObservedRunningTime="2026-07-31 21:30:21.086437804 +0000 UTC m=+281.320669844" Jul 31 21:30:21.102089 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.102037 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-lhnrf" podStartSLOduration=1.405104673 podStartE2EDuration="3.102020387s" totalImagesPullingTime="1.696915714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:30:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:21.101454315 +0000 UTC m=+281.335686354" watchObservedRunningTime="2026-07-31 21:30:21.102020387 +0000 UTC m=+281.336252426" Jul 31 21:30:21.123464 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.123425 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xpl7c" podStartSLOduration=2.156095951 podStartE2EDuration="3.123417031s" totalImagesPullingTime="870.878297ms" totalInitContainerRuntime="96.442783ms" isStatefulPod=true podCreationTimestamp="2026-07-31 21:30:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:21.122759611 +0000 UTC m=+281.356991650" watchObservedRunningTime="2026-07-31 21:30:21.123417031 +0000 UTC m=+281.357649070" Jul 31 21:30:21.136849 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.136831 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-l9tz9" Jul 31 21:30:21.142497 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:21.142462 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bdbm6" podStartSLOduration=1.538869244 podStartE2EDuration="3.142449031s" totalImagesPullingTime="1.603579787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:30:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:21.14160996 +0000 UTC m=+281.375842000" watchObservedRunningTime="2026-07-31 21:30:21.142449031 +0000 UTC m=+281.376681126" Jul 31 21:30:21.698313 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:30:21.698278 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" podUID="785c1568-84cc-45f0-8393-faabbd22658e" Jul 31 21:30:21.698313 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:30:21.698279 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" podUID="c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef" Jul 31 21:30:21.698497 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:30:21.698277 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dgz6v" podUID="ef50ba85-4e8d-4793-bc88-a4cedb14bb0c" Jul 31 21:30:22.077951 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:22.077926 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dgz6v" Jul 31 21:30:22.078295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:22.077928 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:30:22.078295 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:22.077979 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:30:23.130324 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.130290 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s"] Jul 31 21:30:23.133876 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.133854 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" Jul 31 21:30:23.136392 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.136374 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lndxh\"" Jul 31 21:30:23.136730 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.136709 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 31 21:30:23.141783 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.141761 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s"] Jul 31 21:30:23.150923 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.150885 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7958b689-9278-49c3-b59d-df78ffc03d24-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-m8d6s\" (UID: \"7958b689-9278-49c3-b59d-df78ffc03d24\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" Jul 31 21:30:23.151514 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.151124 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqmw7\" (UniqueName: \"kubernetes.io/projected/7958b689-9278-49c3-b59d-df78ffc03d24-kube-api-access-lqmw7\") pod \"monitoring-plugin-6dffbbd67-m8d6s\" (UID: \"7958b689-9278-49c3-b59d-df78ffc03d24\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" Jul 31 21:30:23.251964 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.251937 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqmw7\" (UniqueName: \"kubernetes.io/projected/7958b689-9278-49c3-b59d-df78ffc03d24-kube-api-access-lqmw7\") pod \"monitoring-plugin-6dffbbd67-m8d6s\" (UID: \"7958b689-9278-49c3-b59d-df78ffc03d24\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" Jul 31 21:30:23.252081 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.251993 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7958b689-9278-49c3-b59d-df78ffc03d24-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-m8d6s\" (UID: \"7958b689-9278-49c3-b59d-df78ffc03d24\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" Jul 31 21:30:23.252155 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:30:23.252098 2548 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 31 21:30:23.252203 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:30:23.252162 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7958b689-9278-49c3-b59d-df78ffc03d24-monitoring-plugin-cert podName:7958b689-9278-49c3-b59d-df78ffc03d24 nodeName:}" failed. No retries permitted until 2026-07-31 21:30:23.752142749 +0000 UTC m=+283.986374781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7958b689-9278-49c3-b59d-df78ffc03d24-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-m8d6s" (UID: "7958b689-9278-49c3-b59d-df78ffc03d24") : secret "monitoring-plugin-cert" not found Jul 31 21:30:23.260798 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.260770 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqmw7\" (UniqueName: \"kubernetes.io/projected/7958b689-9278-49c3-b59d-df78ffc03d24-kube-api-access-lqmw7\") pod \"monitoring-plugin-6dffbbd67-m8d6s\" (UID: \"7958b689-9278-49c3-b59d-df78ffc03d24\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" Jul 31 21:30:23.609602 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.609572 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8f7c996b8-jzgnp"] Jul 31 21:30:23.616345 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.616315 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.620560 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.620540 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 31 21:30:23.620715 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.620648 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 31 21:30:23.620715 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.620681 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 31 21:30:23.620715 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.620687 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rwdfp\"" Jul 31 21:30:23.620877 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.620684 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 31 21:30:23.620877 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.620837 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 31 21:30:23.627028 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.627011 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 31 21:30:23.628931 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.628897 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8f7c996b8-jzgnp"] Jul 31 21:30:23.655078 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.655056 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-serving-certs-ca-bundle\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.655175 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.655085 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-metrics-client-ca\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.655175 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.655123 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-secret-telemeter-client\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.655175 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.655146 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.655175 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.655170 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.655368 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.655188 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-federate-client-tls\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.655368 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.655287 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfgxx\" (UniqueName: \"kubernetes.io/projected/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-kube-api-access-vfgxx\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.655368 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.655350 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-telemeter-client-tls\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.756111 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.756085 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-serving-certs-ca-bundle\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.756271 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.756116 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-metrics-client-ca\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.756271 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.756150 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-secret-telemeter-client\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.756391 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.756272 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.756391 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.756327 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.756391 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.756366 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-federate-client-tls\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.756535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.756443 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfgxx\" (UniqueName: \"kubernetes.io/projected/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-kube-api-access-vfgxx\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.756535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.756506 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-telemeter-client-tls\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.756630 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.756538 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7958b689-9278-49c3-b59d-df78ffc03d24-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-m8d6s\" (UID: \"7958b689-9278-49c3-b59d-df78ffc03d24\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" Jul 31 21:30:23.756739 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.756710 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-metrics-client-ca\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.756885 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.756860 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-serving-certs-ca-bundle\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.757704 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.757683 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.759797 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.759750 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-federate-client-tls\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.759797 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.759770 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7958b689-9278-49c3-b59d-df78ffc03d24-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-m8d6s\" (UID: \"7958b689-9278-49c3-b59d-df78ffc03d24\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" Jul 31 21:30:23.759972 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.759866 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.760014 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.759976 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-secret-telemeter-client\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.760142 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.760128 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-telemeter-client-tls\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.766813 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.766792 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfgxx\" (UniqueName: \"kubernetes.io/projected/ffefe97c-f63d-4857-9eaf-67a6ac49c3c0-kube-api-access-vfgxx\") pod \"telemeter-client-8f7c996b8-jzgnp\" (UID: \"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0\") " pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:23.927989 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:23.927874 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" Jul 31 21:30:24.043381 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.043348 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" Jul 31 21:30:24.067541 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.067513 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8f7c996b8-jzgnp"] Jul 31 21:30:24.070783 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:30:24.070748 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffefe97c_f63d_4857_9eaf_67a6ac49c3c0.slice/crio-c8df6c99fe0450ad53bb4bad1b8a201024665e1113c54c8b9569b3ddd465d69c WatchSource:0}: Error finding container c8df6c99fe0450ad53bb4bad1b8a201024665e1113c54c8b9569b3ddd465d69c: Status 404 returned error can't find the container with id c8df6c99fe0450ad53bb4bad1b8a201024665e1113c54c8b9569b3ddd465d69c Jul 31 21:30:24.087215 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.087187 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" event={"ID":"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0","Type":"ContainerStarted","Data":"c8df6c99fe0450ad53bb4bad1b8a201024665e1113c54c8b9569b3ddd465d69c"} Jul 31 21:30:24.177595 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.177575 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s"] Jul 31 21:30:24.179859 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:30:24.179793 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7958b689_9278_49c3_b59d_df78ffc03d24.slice/crio-2bdfc41864b13fa284c9b8884b61a8c801ddf093b6620b3ef95d42921848af11 WatchSource:0}: Error finding container 2bdfc41864b13fa284c9b8884b61a8c801ddf093b6620b3ef95d42921848af11: Status 404 returned error can't find the container with id 2bdfc41864b13fa284c9b8884b61a8c801ddf093b6620b3ef95d42921848af11 Jul 31 21:30:24.761410 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.761379 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 21:30:24.765818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.765796 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.779954 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.779888 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x59vf\"" Jul 31 21:30:24.780741 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.780720 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 31 21:30:24.780887 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.780863 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 31 21:30:24.781686 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.781668 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 31 21:30:24.781781 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.781763 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 31 21:30:24.781888 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.781870 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c9t4qb0uq9m90\"" Jul 31 21:30:24.782629 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.782611 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 31 21:30:24.782704 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.782638 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 31 21:30:24.783770 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.783752 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 31 21:30:24.783890 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.783876 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 31 21:30:24.783975 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.783935 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 31 21:30:24.785063 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.785047 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 31 21:30:24.785145 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.785051 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 31 21:30:24.786601 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.786582 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 31 21:30:24.786693 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.786666 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 31 21:30:24.789281 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.789226 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 31 21:30:24.792001 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.791980 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 31 21:30:24.805458 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.805435 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 21:30:24.867284 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867252 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867284 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867283 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867457 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867366 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-config\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867457 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867398 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867457 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867417 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867457 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867434 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867664 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867462 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867664 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867486 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867664 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867507 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867664 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867537 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867664 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867561 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867664 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867585 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867664 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867618 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.867664 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867641 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.868109 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867723 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.868109 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867768 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.868109 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867794 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.868109 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867820 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.868109 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867843 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.868109 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.867867 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9b4b\" (UniqueName: \"kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-kube-api-access-m9b4b\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.968879 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.968851 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.968879 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.968882 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.969204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.968900 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.969204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.968953 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.969204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.968979 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.969204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969001 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.969204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969049 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.969204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969075 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.969204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969116 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.969204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969142 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.969204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969163 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.969204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969189 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.970018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969215 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.970018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969240 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9b4b\" (UniqueName: \"kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-kube-api-access-m9b4b\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.970018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969288 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.970018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969310 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.970018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969396 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-config\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.970018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969433 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.970018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969458 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.970018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969487 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.970018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969569 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.970018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.969897 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.970669 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.970605 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.971471 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.971439 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.971592 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.971491 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.973436 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.973404 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.974711 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.973695 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.974711 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.973827 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.974711 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.974292 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.974711 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.974415 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.974711 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.974665 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.975032 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.974814 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.975884 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.975865 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.976190 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.976152 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.976288 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.976222 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-config\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.976288 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.976236 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.976471 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.976449 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.977899 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.977878 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.978006 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.977885 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:24.983018 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:24.982991 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9b4b\" (UniqueName: \"kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-kube-api-access-m9b4b\") pod \"prometheus-k8s-0\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:25.070623 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.070594 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:30:25.070782 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.070752 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:30:25.070842 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.070801 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:30:25.073644 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.073583 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef50ba85-4e8d-4793-bc88-a4cedb14bb0c-metrics-tls\") pod \"dns-default-dgz6v\" (UID: \"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c\") " pod="openshift-dns/dns-default-dgz6v" Jul 31 21:30:25.073644 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.073598 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"image-registry-cfb6fbf86-vtsps\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:30:25.073839 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.073817 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-nz24j\" (UID: \"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:30:25.076782 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.076762 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:25.083249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.083229 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pzhm8\"" Jul 31 21:30:25.084937 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.084719 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtvng\"" Jul 31 21:30:25.088951 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.088931 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:30:25.089052 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.088968 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" Jul 31 21:30:25.093058 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.093039 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" event={"ID":"7958b689-9278-49c3-b59d-df78ffc03d24","Type":"ContainerStarted","Data":"2bdfc41864b13fa284c9b8884b61a8c801ddf093b6620b3ef95d42921848af11"} Jul 31 21:30:25.097758 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.097741 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jxlqr\"" Jul 31 21:30:25.099815 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.099798 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dgz6v" Jul 31 21:30:25.625737 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.625671 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 21:30:25.629768 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:30:25.629742 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f318051_ed43_48fd_8c32_d5c6037897d3.slice/crio-607028aa9dff58687226038a32367d496550e0fe37f698079a9b2dad7845504e WatchSource:0}: Error finding container 607028aa9dff58687226038a32367d496550e0fe37f698079a9b2dad7845504e: Status 404 returned error can't find the container with id 607028aa9dff58687226038a32367d496550e0fe37f698079a9b2dad7845504e Jul 31 21:30:25.633169 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.633147 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dgz6v"] Jul 31 21:30:25.634446 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:30:25.634408 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef50ba85_4e8d_4793_bc88_a4cedb14bb0c.slice/crio-4e268008242004f6d7d4598a24c1869ca6cec64150876ed2c693590dbbf2fe5c WatchSource:0}: Error finding container 4e268008242004f6d7d4598a24c1869ca6cec64150876ed2c693590dbbf2fe5c: Status 404 returned error can't find the container with id 4e268008242004f6d7d4598a24c1869ca6cec64150876ed2c693590dbbf2fe5c Jul 31 21:30:25.648670 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.648650 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-nz24j"] Jul 31 21:30:25.651342 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:30:25.651318 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3474ee1_309d_4eb7_98c8_b2ef3f8a37ef.slice/crio-a29637defedea33a61f92d459d5a639ab2b13b809bf43133bcd0569925ad0bf1 WatchSource:0}: Error finding container a29637defedea33a61f92d459d5a639ab2b13b809bf43133bcd0569925ad0bf1: Status 404 returned error can't find the container with id a29637defedea33a61f92d459d5a639ab2b13b809bf43133bcd0569925ad0bf1 Jul 31 21:30:25.678200 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:25.674739 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cfb6fbf86-vtsps"] Jul 31 21:30:25.678200 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:30:25.675757 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785c1568_84cc_45f0_8393_faabbd22658e.slice/crio-7a2ee14bcf45c923ad035ebfb8afddd22fd465ced60909f5c943560b62e09cb7 WatchSource:0}: Error finding container 7a2ee14bcf45c923ad035ebfb8afddd22fd465ced60909f5c943560b62e09cb7: Status 404 returned error can't find the container with id 7a2ee14bcf45c923ad035ebfb8afddd22fd465ced60909f5c943560b62e09cb7 Jul 31 21:30:26.099074 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:26.099035 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dgz6v" event={"ID":"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c","Type":"ContainerStarted","Data":"4e268008242004f6d7d4598a24c1869ca6cec64150876ed2c693590dbbf2fe5c"} Jul 31 21:30:26.100394 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:26.100369 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerStarted","Data":"607028aa9dff58687226038a32367d496550e0fe37f698079a9b2dad7845504e"} Jul 31 21:30:26.102031 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:26.102009 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" event={"ID":"7958b689-9278-49c3-b59d-df78ffc03d24","Type":"ContainerStarted","Data":"28d926583ecfdf0207882ae05080d5ea84f6b52279c1105f289d5c6c26e8eacc"} Jul 31 21:30:26.102209 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:26.102194 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" Jul 31 21:30:26.103507 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:26.103466 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" event={"ID":"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef","Type":"ContainerStarted","Data":"a29637defedea33a61f92d459d5a639ab2b13b809bf43133bcd0569925ad0bf1"} Jul 31 21:30:26.105395 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:26.105322 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" event={"ID":"785c1568-84cc-45f0-8393-faabbd22658e","Type":"ContainerStarted","Data":"c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51"} Jul 31 21:30:26.105395 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:26.105363 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" event={"ID":"785c1568-84cc-45f0-8393-faabbd22658e","Type":"ContainerStarted","Data":"7a2ee14bcf45c923ad035ebfb8afddd22fd465ced60909f5c943560b62e09cb7"} Jul 31 21:30:26.105557 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:26.105462 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:30:26.107839 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:26.107817 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" Jul 31 21:30:26.128023 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:26.127958 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-m8d6s" podStartSLOduration=1.8320113 podStartE2EDuration="3.127939253s" totalImagesPullingTime="1.295927953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:26.126563525 +0000 UTC m=+286.360795588" watchObservedRunningTime="2026-07-31 21:30:26.127939253 +0000 UTC m=+286.362171291" Jul 31 21:30:26.186296 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:26.184539 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" podStartSLOduration=286.184517208 podStartE2EDuration="4m46.184517208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:26.184246809 +0000 UTC m=+286.418478848" watchObservedRunningTime="2026-07-31 21:30:26.184517208 +0000 UTC m=+286.418749248" Jul 31 21:30:27.112503 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:27.112419 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" event={"ID":"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0","Type":"ContainerStarted","Data":"c7512cbc39fd504808df3aca7bf2b3149f6488cc524db982309a98f330064a4d"} Jul 31 21:30:28.122870 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:28.122836 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" event={"ID":"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0","Type":"ContainerStarted","Data":"99196f7b8b8517ec73586aa6aa4dd7ba09f9fade5c4b8bc2885f72a6a0919ec5"} Jul 31 21:30:28.123299 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:28.122932 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" event={"ID":"ffefe97c-f63d-4857-9eaf-67a6ac49c3c0","Type":"ContainerStarted","Data":"60b09c29afa5dd00210b6376ea58135ed21e154c8af0dc9c43f3cfe521971059"} Jul 31 21:30:28.124650 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:28.124622 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dgz6v" event={"ID":"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c","Type":"ContainerStarted","Data":"a52f5d5bb6ba94e60921733af70263d407e9097818e59f24cc2c75efc763d95d"} Jul 31 21:30:28.124760 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:28.124670 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dgz6v" event={"ID":"ef50ba85-4e8d-4793-bc88-a4cedb14bb0c","Type":"ContainerStarted","Data":"641e5faba7041631765ec4e7f6b1ae4aeebf4bae2752011e216a6f50d23467e4"} Jul 31 21:30:28.124760 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:28.124693 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dgz6v" Jul 31 21:30:28.126102 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:28.126080 2548 generic.go:356] "Generic (PLEG): container finished" podID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerID="f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63" exitCode=0 Jul 31 21:30:28.126209 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:28.126165 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerDied","Data":"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63"} Jul 31 21:30:28.127641 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:28.127623 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" event={"ID":"c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef","Type":"ContainerStarted","Data":"8832f1c9b3b65b7757093fa4efe59c77b02a26a919d66a22c29ff0724fc94083"} Jul 31 21:30:28.168449 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:28.168402 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8f7c996b8-jzgnp" podStartSLOduration=1.55579908 podStartE2EDuration="5.168387548s" totalImagesPullingTime="3.612588468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:30:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:28.166307096 +0000 UTC m=+288.400539145" watchObservedRunningTime="2026-07-31 21:30:28.168387548 +0000 UTC m=+288.402619587" Jul 31 21:30:28.250612 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:28.250532 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-nz24j" podStartSLOduration=283.184852201 podStartE2EDuration="4m45.250518045s" totalImagesPullingTime="2.065665844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:28.213373705 +0000 UTC m=+288.447605754" watchObservedRunningTime="2026-07-31 21:30:28.250518045 +0000 UTC m=+288.484750125" Jul 31 21:30:28.250955 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:28.250932 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dgz6v" podStartSLOduration=251.163107437 podStartE2EDuration="4m13.25092563s" totalImagesPullingTime="2.087818193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:28.249857815 +0000 UTC m=+288.484089853" watchObservedRunningTime="2026-07-31 21:30:28.25092563 +0000 UTC m=+288.485157659" Jul 31 21:30:32.148231 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:32.148199 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerStarted","Data":"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b"} Jul 31 21:30:32.148598 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:32.148295 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerStarted","Data":"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf"} Jul 31 21:30:33.157024 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:33.155665 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerStarted","Data":"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667"} Jul 31 21:30:34.163444 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:34.163413 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerStarted","Data":"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9"} Jul 31 21:30:34.163776 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:34.163471 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerStarted","Data":"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908"} Jul 31 21:30:34.163776 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:34.163495 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerStarted","Data":"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604"} Jul 31 21:30:34.208498 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:34.208440 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.304434626 podStartE2EDuration="10.208425034s" totalImagesPullingTime="6.874163678s" totalInitContainerRuntime="29.82673ms" isStatefulPod=false podCreationTimestamp="2026-07-31 21:30:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:34.20639809 +0000 UTC m=+294.440630180" watchObservedRunningTime="2026-07-31 21:30:34.208425034 +0000 UTC m=+294.442657072" Jul 31 21:30:35.077166 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:35.077136 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:30:35.170462 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:30:35.170431 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-brfzt" podUID="a359de99-657c-4c35-bf34-31ef06ddfbc6" Jul 31 21:30:38.133321 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:38.133291 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dgz6v" Jul 31 21:30:40.077438 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:40.077407 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:30:40.078594 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:40.078577 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:30:40.087946 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:40.087887 2548 kubelet.go:1648] "Image garbage collection succeeded" Jul 31 21:30:45.093227 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:45.093191 2548 patch_prober.go:28] interesting pod/image-registry-cfb6fbf86-vtsps container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 21:30:45.098100 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:45.093246 2548 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" podUID="785c1568-84cc-45f0-8393-faabbd22658e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 21:30:47.117369 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:47.117343 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:30:50.171749 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:50.171721 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:30:51.234656 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:51.234625 2548 generic.go:356] "Generic (PLEG): container finished" podID="219f26b6-ed10-4303-8377-dcc2fb015902" containerID="f11e67b31a70fca1709a1560b9772acac24b16a12c14e5968336f22d1f683c0a" exitCode=0 Jul 31 21:30:51.235028 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:51.234702 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-nrx4s" event={"ID":"219f26b6-ed10-4303-8377-dcc2fb015902","Type":"ContainerDied","Data":"f11e67b31a70fca1709a1560b9772acac24b16a12c14e5968336f22d1f683c0a"} Jul 31 21:30:51.235075 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:51.235035 2548 scope.go:117] "RemoveContainer" containerID="f11e67b31a70fca1709a1560b9772acac24b16a12c14e5968336f22d1f683c0a" Jul 31 21:30:52.240382 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:52.240349 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-nrx4s" event={"ID":"219f26b6-ed10-4303-8377-dcc2fb015902","Type":"ContainerStarted","Data":"e7a8226b7dfa1073284cd46a8f7d443b3cdd7f0bd0c11a34c1a9134745000780"} Jul 31 21:30:55.312444 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:55.312413 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-x8ckw_9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5/cluster-monitoring-operator/0.log" Jul 31 21:30:55.511769 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:55.511740 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lhnrf_dc151d83-10a0-4c9d-aa65-dd1519228c66/kube-state-metrics/0.log" Jul 31 21:30:55.717346 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:55.717322 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lhnrf_dc151d83-10a0-4c9d-aa65-dd1519228c66/kube-rbac-proxy-main/0.log" Jul 31 21:30:55.910133 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:55.910110 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lhnrf_dc151d83-10a0-4c9d-aa65-dd1519228c66/kube-rbac-proxy-self/0.log" Jul 31 21:30:56.309549 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:56.309529 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-m8d6s_7958b689-9278-49c3-b59d-df78ffc03d24/monitoring-plugin/0.log" Jul 31 21:30:56.788300 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:56.788267 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cfb6fbf86-vtsps"] Jul 31 21:30:57.709987 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:57.709964 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpl7c_1939eb9a-abc4-45a1-8ba9-804771b89fe2/init-textfile/0.log" Jul 31 21:30:57.913220 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:57.913196 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpl7c_1939eb9a-abc4-45a1-8ba9-804771b89fe2/node-exporter/0.log" Jul 31 21:30:58.110838 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:58.110811 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpl7c_1939eb9a-abc4-45a1-8ba9-804771b89fe2/kube-rbac-proxy/0.log" Jul 31 21:30:58.311434 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:58.311412 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bdbm6_41631157-646d-4883-aee8-c52119ba1256/kube-rbac-proxy-main/0.log" Jul 31 21:30:58.510841 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:58.510778 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bdbm6_41631157-646d-4883-aee8-c52119ba1256/kube-rbac-proxy-self/0.log" Jul 31 21:30:58.711024 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:58.710999 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bdbm6_41631157-646d-4883-aee8-c52119ba1256/openshift-state-metrics/0.log" Jul 31 21:30:58.911191 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:58.911171 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1f318051-ed43-48fd-8c32-d5c6037897d3/init-config-reloader/0.log" Jul 31 21:30:59.112626 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:59.112606 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1f318051-ed43-48fd-8c32-d5c6037897d3/prometheus/0.log" Jul 31 21:30:59.310489 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:59.310443 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1f318051-ed43-48fd-8c32-d5c6037897d3/config-reloader/0.log" Jul 31 21:30:59.511973 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:59.511953 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1f318051-ed43-48fd-8c32-d5c6037897d3/thanos-sidecar/0.log" Jul 31 21:30:59.711897 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:59.711877 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1f318051-ed43-48fd-8c32-d5c6037897d3/kube-rbac-proxy-web/0.log" Jul 31 21:30:59.911306 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:30:59.911286 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1f318051-ed43-48fd-8c32-d5c6037897d3/kube-rbac-proxy/0.log" Jul 31 21:31:00.114699 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:00.114661 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1f318051-ed43-48fd-8c32-d5c6037897d3/kube-rbac-proxy-thanos/0.log" Jul 31 21:31:00.710507 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:00.710480 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-vrv48_4106e60c-f5ab-46b2-bff7-af24b62d42ac/prometheus-operator-admission-webhook/0.log" Jul 31 21:31:00.911147 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:00.911122 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f7c996b8-jzgnp_ffefe97c-f63d-4857-9eaf-67a6ac49c3c0/telemeter-client/0.log" Jul 31 21:31:01.120689 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:01.120663 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f7c996b8-jzgnp_ffefe97c-f63d-4857-9eaf-67a6ac49c3c0/reload/0.log" Jul 31 21:31:01.310954 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:01.310897 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f7c996b8-jzgnp_ffefe97c-f63d-4857-9eaf-67a6ac49c3c0/kube-rbac-proxy/0.log" Jul 31 21:31:02.710846 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:02.710820 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-nz24j_c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef/networking-console-plugin/0.log" Jul 31 21:31:02.913355 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:02.913330 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:31:03.112294 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:03.112266 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/3.log" Jul 31 21:31:04.310502 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:04.310475 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dgz6v_ef50ba85-4e8d-4793-bc88-a4cedb14bb0c/dns/0.log" Jul 31 21:31:04.510197 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:04.510173 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dgz6v_ef50ba85-4e8d-4793-bc88-a4cedb14bb0c/kube-rbac-proxy/0.log" Jul 31 21:31:05.289843 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:05.289814 2548 generic.go:356] "Generic (PLEG): container finished" podID="df0856c9-b2d9-4ced-a894-76e04d2878fe" containerID="1bddebc392f1e8194b5359fa9028cf643f6474b2840a62ba34870a639dd16166" exitCode=0 Jul 31 21:31:05.290011 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:05.289885 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" event={"ID":"df0856c9-b2d9-4ced-a894-76e04d2878fe","Type":"ContainerDied","Data":"1bddebc392f1e8194b5359fa9028cf643f6474b2840a62ba34870a639dd16166"} Jul 31 21:31:05.290223 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:05.290209 2548 scope.go:117] "RemoveContainer" containerID="1bddebc392f1e8194b5359fa9028cf643f6474b2840a62ba34870a639dd16166" Jul 31 21:31:05.510015 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:05.509984 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t7rln_7a782591-1f18-4512-b13c-8e1e8f522b75/dns-node-resolver/0.log" Jul 31 21:31:06.296215 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:06.296184 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-4ckf8" event={"ID":"df0856c9-b2d9-4ced-a894-76e04d2878fe","Type":"ContainerStarted","Data":"e0e45ed8ceca799140adeb6912e493b1d87deecf71b62f20202bea1b58e0fb6b"} Jul 31 21:31:06.315971 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:06.315943 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vpn9n_a77b984c-43b1-4cf6-b5d1-359e19752c35/serve-healthcheck-canary/0.log" Jul 31 21:31:21.807208 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:21.807170 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" podUID="785c1568-84cc-45f0-8393-faabbd22658e" containerName="registry" containerID="cri-o://c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51" gracePeriod=30 Jul 31 21:31:23.049535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.049510 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:31:23.183283 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.183192 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-trusted-ca\") pod \"785c1568-84cc-45f0-8393-faabbd22658e\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " Jul 31 21:31:23.183283 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.183229 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rx5m\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-kube-api-access-5rx5m\") pod \"785c1568-84cc-45f0-8393-faabbd22658e\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " Jul 31 21:31:23.183283 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.183259 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-bound-sa-token\") pod \"785c1568-84cc-45f0-8393-faabbd22658e\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " Jul 31 21:31:23.183550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.183292 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785c1568-84cc-45f0-8393-faabbd22658e-ca-trust-extracted\") pod \"785c1568-84cc-45f0-8393-faabbd22658e\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " Jul 31 21:31:23.183550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.183473 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-installation-pull-secrets\") pod \"785c1568-84cc-45f0-8393-faabbd22658e\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " Jul 31 21:31:23.183550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.183525 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-registry-certificates\") pod \"785c1568-84cc-45f0-8393-faabbd22658e\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " Jul 31 21:31:23.183701 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.183562 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") pod \"785c1568-84cc-45f0-8393-faabbd22658e\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " Jul 31 21:31:23.183701 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.183600 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-image-registry-private-configuration\") pod \"785c1568-84cc-45f0-8393-faabbd22658e\" (UID: \"785c1568-84cc-45f0-8393-faabbd22658e\") " Jul 31 21:31:23.183797 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.183688 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "785c1568-84cc-45f0-8393-faabbd22658e" (UID: "785c1568-84cc-45f0-8393-faabbd22658e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:31:23.183951 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.183890 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "785c1568-84cc-45f0-8393-faabbd22658e" (UID: "785c1568-84cc-45f0-8393-faabbd22658e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:31:23.184148 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.184130 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-trusted-ca\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:23.184229 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.184177 2548 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/785c1568-84cc-45f0-8393-faabbd22658e-registry-certificates\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:23.186510 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.186480 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "785c1568-84cc-45f0-8393-faabbd22658e" (UID: "785c1568-84cc-45f0-8393-faabbd22658e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:31:23.186510 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.186494 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "785c1568-84cc-45f0-8393-faabbd22658e" (UID: "785c1568-84cc-45f0-8393-faabbd22658e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:31:23.186677 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.186481 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "785c1568-84cc-45f0-8393-faabbd22658e" (UID: "785c1568-84cc-45f0-8393-faabbd22658e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:31:23.186677 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.186592 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "785c1568-84cc-45f0-8393-faabbd22658e" (UID: "785c1568-84cc-45f0-8393-faabbd22658e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:31:23.186677 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.186618 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-kube-api-access-5rx5m" (OuterVolumeSpecName: "kube-api-access-5rx5m") pod "785c1568-84cc-45f0-8393-faabbd22658e" (UID: "785c1568-84cc-45f0-8393-faabbd22658e"). InnerVolumeSpecName "kube-api-access-5rx5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:31:23.192019 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.191981 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/785c1568-84cc-45f0-8393-faabbd22658e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "785c1568-84cc-45f0-8393-faabbd22658e" (UID: "785c1568-84cc-45f0-8393-faabbd22658e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:31:23.284987 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.284950 2548 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-bound-sa-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:23.284987 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.284979 2548 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/785c1568-84cc-45f0-8393-faabbd22658e-ca-trust-extracted\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:23.284987 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.284990 2548 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-installation-pull-secrets\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:23.285205 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.285001 2548 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-registry-tls\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:23.285205 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.285010 2548 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/785c1568-84cc-45f0-8393-faabbd22658e-image-registry-private-configuration\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:23.285205 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.285019 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rx5m\" (UniqueName: \"kubernetes.io/projected/785c1568-84cc-45f0-8393-faabbd22658e-kube-api-access-5rx5m\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:23.374629 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.374595 2548 generic.go:356] "Generic (PLEG): container finished" podID="785c1568-84cc-45f0-8393-faabbd22658e" containerID="c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51" exitCode=0 Jul 31 21:31:23.374805 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.374636 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" Jul 31 21:31:23.374805 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.374673 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" event={"ID":"785c1568-84cc-45f0-8393-faabbd22658e","Type":"ContainerDied","Data":"c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51"} Jul 31 21:31:23.374805 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.374734 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfb6fbf86-vtsps" event={"ID":"785c1568-84cc-45f0-8393-faabbd22658e","Type":"ContainerDied","Data":"7a2ee14bcf45c923ad035ebfb8afddd22fd465ced60909f5c943560b62e09cb7"} Jul 31 21:31:23.374805 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.374756 2548 scope.go:117] "RemoveContainer" containerID="c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51" Jul 31 21:31:23.383486 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.383469 2548 scope.go:117] "RemoveContainer" containerID="c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51" Jul 31 21:31:23.383778 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:31:23.383759 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51\": container with ID starting with c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51 not found: ID does not exist" containerID="c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51" Jul 31 21:31:23.383844 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.383790 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51"} err="failed to get container status \"c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51\": rpc error: code = NotFound desc = could not find container \"c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51\": container with ID starting with c8545f0a822a469a6a48bbcfa0f92d74b724a19b85b4fffdf38abae0c7e05f51 not found: ID does not exist" Jul 31 21:31:23.395171 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.395142 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cfb6fbf86-vtsps"] Jul 31 21:31:23.402140 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:23.402115 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cfb6fbf86-vtsps"] Jul 31 21:31:24.174379 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:24.174346 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="785c1568-84cc-45f0-8393-faabbd22658e" path="/var/lib/kubelet/pods/785c1568-84cc-45f0-8393-faabbd22658e/volumes" Jul 31 21:31:25.077794 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:25.077764 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:25.097564 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:25.097530 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:25.399837 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:25.399764 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.016508 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.016476 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 21:31:43.016901 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.016770 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="prometheus" containerID="cri-o://c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf" gracePeriod=600 Jul 31 21:31:43.016901 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.016787 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy" containerID="cri-o://2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908" gracePeriod=600 Jul 31 21:31:43.016901 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.016822 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="thanos-sidecar" containerID="cri-o://c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667" gracePeriod=600 Jul 31 21:31:43.016901 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.016860 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="config-reloader" containerID="cri-o://3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b" gracePeriod=600 Jul 31 21:31:43.017179 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.016862 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy-web" containerID="cri-o://651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604" gracePeriod=600 Jul 31 21:31:43.017179 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.016860 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9" gracePeriod=600 Jul 31 21:31:43.261496 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.261469 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.268328 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268258 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-db\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268328 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268299 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-tls-assets\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268328 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268322 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-config-out\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268576 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268348 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-0\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268576 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268370 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-kube-rbac-proxy\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268576 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268395 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-metrics-client-certs\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268576 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268416 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-trusted-ca-bundle\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268576 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268436 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-config\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268576 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268462 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-grpc-tls\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268576 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268489 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9b4b\" (UniqueName: \"kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-kube-api-access-m9b4b\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268576 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268518 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-1\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268576 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268544 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-metrics-client-ca\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.268576 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268571 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-web-config\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.269070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268609 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-tls\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.269070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268642 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.269070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268669 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-kubelet-serving-ca-bundle\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.269070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268721 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-2\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.269070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268758 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.269070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268797 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-serving-certs-ca-bundle\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.269070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.268853 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-thanos-prometheus-http-client-file\") pod \"1f318051-ed43-48fd-8c32-d5c6037897d3\" (UID: \"1f318051-ed43-48fd-8c32-d5c6037897d3\") " Jul 31 21:31:43.269070 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.269003 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:31:43.269444 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.269108 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:31:43.269444 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.269190 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.269444 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.269210 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.270108 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.269762 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:31:43.270108 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.269844 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:31:43.270279 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.270189 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:31:43.270482 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.270450 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:31:43.270663 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.270637 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:31:43.271405 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.271317 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:31:43.272525 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.272487 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-kube-api-access-m9b4b" (OuterVolumeSpecName: "kube-api-access-m9b4b") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "kube-api-access-m9b4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:31:43.272783 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.272750 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:31:43.273272 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.273242 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-config-out" (OuterVolumeSpecName: "config-out") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:31:43.273363 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.273290 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:31:43.273451 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.273431 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:31:43.273499 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.273443 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:31:43.273547 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.273536 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:31:43.273632 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.273618 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:31:43.273824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.273810 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:31:43.274009 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.273988 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-config" (OuterVolumeSpecName: "config") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:31:43.274283 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.274255 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:31:43.284839 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.284811 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-web-config" (OuterVolumeSpecName: "web-config") pod "1f318051-ed43-48fd-8c32-d5c6037897d3" (UID: "1f318051-ed43-48fd-8c32-d5c6037897d3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:31:43.370512 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370477 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-metrics-client-ca\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370512 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370508 2548 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-web-config\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370512 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370518 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370527 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370536 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370545 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370554 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370564 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370572 2548 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370580 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-db\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370588 2548 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-tls-assets\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370595 2548 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f318051-ed43-48fd-8c32-d5c6037897d3-config-out\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370603 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1f318051-ed43-48fd-8c32-d5c6037897d3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370610 2548 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-kube-rbac-proxy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370618 2548 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-metrics-client-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370625 2548 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-config\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370632 2548 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f318051-ed43-48fd-8c32-d5c6037897d3-secret-grpc-tls\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.370750 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.370640 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9b4b\" (UniqueName: \"kubernetes.io/projected/1f318051-ed43-48fd-8c32-d5c6037897d3-kube-api-access-m9b4b\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:31:43.454262 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454232 2548 generic.go:356] "Generic (PLEG): container finished" podID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerID="ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9" exitCode=0 Jul 31 21:31:43.454262 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454257 2548 generic.go:356] "Generic (PLEG): container finished" podID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerID="2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908" exitCode=0 Jul 31 21:31:43.454262 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454265 2548 generic.go:356] "Generic (PLEG): container finished" podID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerID="651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604" exitCode=0 Jul 31 21:31:43.454262 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454270 2548 generic.go:356] "Generic (PLEG): container finished" podID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerID="c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667" exitCode=0 Jul 31 21:31:43.454517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454275 2548 generic.go:356] "Generic (PLEG): container finished" podID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerID="3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b" exitCode=0 Jul 31 21:31:43.454517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454280 2548 generic.go:356] "Generic (PLEG): container finished" podID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerID="c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf" exitCode=0 Jul 31 21:31:43.454517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454312 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.454517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454320 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerDied","Data":"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9"} Jul 31 21:31:43.454517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454404 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerDied","Data":"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908"} Jul 31 21:31:43.454517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454446 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerDied","Data":"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604"} Jul 31 21:31:43.454517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454469 2548 scope.go:117] "RemoveContainer" containerID="ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9" Jul 31 21:31:43.454517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454487 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerDied","Data":"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667"} Jul 31 21:31:43.454804 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454527 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerDied","Data":"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b"} Jul 31 21:31:43.454804 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454568 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerDied","Data":"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf"} Jul 31 21:31:43.454804 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.454610 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1f318051-ed43-48fd-8c32-d5c6037897d3","Type":"ContainerDied","Data":"607028aa9dff58687226038a32367d496550e0fe37f698079a9b2dad7845504e"} Jul 31 21:31:43.462900 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.462881 2548 scope.go:117] "RemoveContainer" containerID="2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908" Jul 31 21:31:43.470325 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.470308 2548 scope.go:117] "RemoveContainer" containerID="651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604" Jul 31 21:31:43.477427 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.477405 2548 scope.go:117] "RemoveContainer" containerID="c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667" Jul 31 21:31:43.479875 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.479851 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 21:31:43.484675 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.484654 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 21:31:43.485495 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.485481 2548 scope.go:117] "RemoveContainer" containerID="3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b" Jul 31 21:31:43.492640 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.492621 2548 scope.go:117] "RemoveContainer" containerID="c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf" Jul 31 21:31:43.500015 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.499997 2548 scope.go:117] "RemoveContainer" containerID="f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63" Jul 31 21:31:43.507150 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.507135 2548 scope.go:117] "RemoveContainer" containerID="ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9" Jul 31 21:31:43.507442 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:31:43.507424 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": container with ID starting with ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9 not found: ID does not exist" containerID="ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9" Jul 31 21:31:43.507488 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.507457 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9"} err="failed to get container status \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": rpc error: code = NotFound desc = could not find container \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": container with ID starting with ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9 not found: ID does not exist" Jul 31 21:31:43.507488 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.507478 2548 scope.go:117] "RemoveContainer" containerID="2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908" Jul 31 21:31:43.507738 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:31:43.507703 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": container with ID starting with 2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908 not found: ID does not exist" containerID="2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908" Jul 31 21:31:43.507787 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.507743 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908"} err="failed to get container status \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": rpc error: code = NotFound desc = could not find container \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": container with ID starting with 2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908 not found: ID does not exist" Jul 31 21:31:43.507787 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.507764 2548 scope.go:117] "RemoveContainer" containerID="651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604" Jul 31 21:31:43.508051 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:31:43.508036 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": container with ID starting with 651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604 not found: ID does not exist" containerID="651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604" Jul 31 21:31:43.508093 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.508056 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604"} err="failed to get container status \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": rpc error: code = NotFound desc = could not find container \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": container with ID starting with 651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604 not found: ID does not exist" Jul 31 21:31:43.508093 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.508072 2548 scope.go:117] "RemoveContainer" containerID="c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667" Jul 31 21:31:43.508318 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:31:43.508297 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": container with ID starting with c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667 not found: ID does not exist" containerID="c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667" Jul 31 21:31:43.508365 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.508323 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667"} err="failed to get container status \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": rpc error: code = NotFound desc = could not find container \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": container with ID starting with c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667 not found: ID does not exist" Jul 31 21:31:43.508365 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.508338 2548 scope.go:117] "RemoveContainer" containerID="3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b" Jul 31 21:31:43.508555 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:31:43.508539 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": container with ID starting with 3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b not found: ID does not exist" containerID="3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b" Jul 31 21:31:43.508593 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.508559 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b"} err="failed to get container status \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": rpc error: code = NotFound desc = could not find container \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": container with ID starting with 3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b not found: ID does not exist" Jul 31 21:31:43.508593 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.508576 2548 scope.go:117] "RemoveContainer" containerID="c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf" Jul 31 21:31:43.508758 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:31:43.508742 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": container with ID starting with c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf not found: ID does not exist" containerID="c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf" Jul 31 21:31:43.508798 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.508763 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf"} err="failed to get container status \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": rpc error: code = NotFound desc = could not find container \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": container with ID starting with c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf not found: ID does not exist" Jul 31 21:31:43.508798 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.508777 2548 scope.go:117] "RemoveContainer" containerID="f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63" Jul 31 21:31:43.508995 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:31:43.508979 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": container with ID starting with f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63 not found: ID does not exist" containerID="f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63" Jul 31 21:31:43.509030 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.508998 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63"} err="failed to get container status \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": rpc error: code = NotFound desc = could not find container \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": container with ID starting with f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63 not found: ID does not exist" Jul 31 21:31:43.509030 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.509009 2548 scope.go:117] "RemoveContainer" containerID="ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9" Jul 31 21:31:43.509217 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.509201 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9"} err="failed to get container status \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": rpc error: code = NotFound desc = could not find container \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": container with ID starting with ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9 not found: ID does not exist" Jul 31 21:31:43.509255 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.509217 2548 scope.go:117] "RemoveContainer" containerID="2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908" Jul 31 21:31:43.509435 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.509421 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908"} err="failed to get container status \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": rpc error: code = NotFound desc = could not find container \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": container with ID starting with 2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908 not found: ID does not exist" Jul 31 21:31:43.509481 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.509436 2548 scope.go:117] "RemoveContainer" containerID="651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604" Jul 31 21:31:43.509637 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.509622 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604"} err="failed to get container status \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": rpc error: code = NotFound desc = could not find container \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": container with ID starting with 651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604 not found: ID does not exist" Jul 31 21:31:43.509686 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.509637 2548 scope.go:117] "RemoveContainer" containerID="c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667" Jul 31 21:31:43.509875 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.509854 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667"} err="failed to get container status \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": rpc error: code = NotFound desc = could not find container \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": container with ID starting with c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667 not found: ID does not exist" Jul 31 21:31:43.509875 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.509872 2548 scope.go:117] "RemoveContainer" containerID="3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b" Jul 31 21:31:43.510174 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.510148 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b"} err="failed to get container status \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": rpc error: code = NotFound desc = could not find container \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": container with ID starting with 3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b not found: ID does not exist" Jul 31 21:31:43.510247 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.510176 2548 scope.go:117] "RemoveContainer" containerID="c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf" Jul 31 21:31:43.510497 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.510443 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf"} err="failed to get container status \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": rpc error: code = NotFound desc = could not find container \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": container with ID starting with c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf not found: ID does not exist" Jul 31 21:31:43.510497 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.510467 2548 scope.go:117] "RemoveContainer" containerID="f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63" Jul 31 21:31:43.511296 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.511275 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63"} err="failed to get container status \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": rpc error: code = NotFound desc = could not find container \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": container with ID starting with f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63 not found: ID does not exist" Jul 31 21:31:43.511296 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.511296 2548 scope.go:117] "RemoveContainer" containerID="ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9" Jul 31 21:31:43.511534 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.511519 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9"} err="failed to get container status \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": rpc error: code = NotFound desc = could not find container \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": container with ID starting with ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9 not found: ID does not exist" Jul 31 21:31:43.511588 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.511535 2548 scope.go:117] "RemoveContainer" containerID="2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908" Jul 31 21:31:43.511751 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.511730 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908"} err="failed to get container status \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": rpc error: code = NotFound desc = could not find container \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": container with ID starting with 2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908 not found: ID does not exist" Jul 31 21:31:43.511795 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.511752 2548 scope.go:117] "RemoveContainer" containerID="651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604" Jul 31 21:31:43.512006 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.511986 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604"} err="failed to get container status \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": rpc error: code = NotFound desc = could not find container \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": container with ID starting with 651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604 not found: ID does not exist" Jul 31 21:31:43.512006 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512007 2548 scope.go:117] "RemoveContainer" containerID="c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667" Jul 31 21:31:43.512250 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512229 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667"} err="failed to get container status \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": rpc error: code = NotFound desc = could not find container \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": container with ID starting with c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667 not found: ID does not exist" Jul 31 21:31:43.512299 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512251 2548 scope.go:117] "RemoveContainer" containerID="3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b" Jul 31 21:31:43.512299 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512274 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 21:31:43.512482 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512468 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b"} err="failed to get container status \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": rpc error: code = NotFound desc = could not find container \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": container with ID starting with 3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b not found: ID does not exist" Jul 31 21:31:43.512541 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512483 2548 scope.go:117] "RemoveContainer" containerID="c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf" Jul 31 21:31:43.512633 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512620 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="prometheus" Jul 31 21:31:43.512679 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512635 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="prometheus" Jul 31 21:31:43.512679 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512646 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy-thanos" Jul 31 21:31:43.512679 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512654 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy-thanos" Jul 31 21:31:43.512679 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512665 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="785c1568-84cc-45f0-8393-faabbd22658e" containerName="registry" Jul 31 21:31:43.512679 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512674 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="785c1568-84cc-45f0-8393-faabbd22658e" containerName="registry" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512688 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="init-config-reloader" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512698 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="init-config-reloader" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512707 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512715 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512708 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf"} err="failed to get container status \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": rpc error: code = NotFound desc = could not find container \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": container with ID starting with c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf not found: ID does not exist" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512726 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy-web" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512729 2548 scope.go:117] "RemoveContainer" containerID="f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512731 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy-web" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512792 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="thanos-sidecar" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512803 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="thanos-sidecar" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512814 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="config-reloader" Jul 31 21:31:43.512818 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512820 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="config-reloader" Jul 31 21:31:43.513401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512898 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="785c1568-84cc-45f0-8393-faabbd22658e" containerName="registry" Jul 31 21:31:43.513401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512927 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy-web" Jul 31 21:31:43.513401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512937 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="thanos-sidecar" Jul 31 21:31:43.513401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512945 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy-thanos" Jul 31 21:31:43.513401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512955 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="config-reloader" Jul 31 21:31:43.513401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512963 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="prometheus" Jul 31 21:31:43.513401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.512970 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" containerName="kube-rbac-proxy" Jul 31 21:31:43.513401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.513018 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63"} err="failed to get container status \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": rpc error: code = NotFound desc = could not find container \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": container with ID starting with f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63 not found: ID does not exist" Jul 31 21:31:43.513401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.513041 2548 scope.go:117] "RemoveContainer" containerID="ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9" Jul 31 21:31:43.513401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.513243 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9"} err="failed to get container status \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": rpc error: code = NotFound desc = could not find container \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": container with ID starting with ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9 not found: ID does not exist" Jul 31 21:31:43.513401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.513258 2548 scope.go:117] "RemoveContainer" containerID="2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908" Jul 31 21:31:43.513741 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.513455 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908"} err="failed to get container status \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": rpc error: code = NotFound desc = could not find container \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": container with ID starting with 2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908 not found: ID does not exist" Jul 31 21:31:43.513741 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.513476 2548 scope.go:117] "RemoveContainer" containerID="651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604" Jul 31 21:31:43.513741 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.513676 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604"} err="failed to get container status \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": rpc error: code = NotFound desc = could not find container \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": container with ID starting with 651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604 not found: ID does not exist" Jul 31 21:31:43.513741 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.513692 2548 scope.go:117] "RemoveContainer" containerID="c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667" Jul 31 21:31:43.513944 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.513927 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667"} err="failed to get container status \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": rpc error: code = NotFound desc = could not find container \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": container with ID starting with c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667 not found: ID does not exist" Jul 31 21:31:43.513981 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.513945 2548 scope.go:117] "RemoveContainer" containerID="3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b" Jul 31 21:31:43.514171 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.514152 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b"} err="failed to get container status \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": rpc error: code = NotFound desc = could not find container \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": container with ID starting with 3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b not found: ID does not exist" Jul 31 21:31:43.514221 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.514171 2548 scope.go:117] "RemoveContainer" containerID="c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf" Jul 31 21:31:43.514398 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.514378 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf"} err="failed to get container status \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": rpc error: code = NotFound desc = could not find container \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": container with ID starting with c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf not found: ID does not exist" Jul 31 21:31:43.514398 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.514396 2548 scope.go:117] "RemoveContainer" containerID="f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63" Jul 31 21:31:43.514644 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.514624 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63"} err="failed to get container status \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": rpc error: code = NotFound desc = could not find container \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": container with ID starting with f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63 not found: ID does not exist" Jul 31 21:31:43.514708 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.514646 2548 scope.go:117] "RemoveContainer" containerID="ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9" Jul 31 21:31:43.514896 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.514878 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9"} err="failed to get container status \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": rpc error: code = NotFound desc = could not find container \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": container with ID starting with ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9 not found: ID does not exist" Jul 31 21:31:43.514996 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.514898 2548 scope.go:117] "RemoveContainer" containerID="2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908" Jul 31 21:31:43.515127 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.515111 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908"} err="failed to get container status \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": rpc error: code = NotFound desc = could not find container \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": container with ID starting with 2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908 not found: ID does not exist" Jul 31 21:31:43.515182 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.515128 2548 scope.go:117] "RemoveContainer" containerID="651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604" Jul 31 21:31:43.515315 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.515299 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604"} err="failed to get container status \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": rpc error: code = NotFound desc = could not find container \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": container with ID starting with 651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604 not found: ID does not exist" Jul 31 21:31:43.515355 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.515315 2548 scope.go:117] "RemoveContainer" containerID="c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667" Jul 31 21:31:43.515501 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.515486 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667"} err="failed to get container status \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": rpc error: code = NotFound desc = could not find container \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": container with ID starting with c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667 not found: ID does not exist" Jul 31 21:31:43.515549 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.515504 2548 scope.go:117] "RemoveContainer" containerID="3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b" Jul 31 21:31:43.515718 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.515704 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b"} err="failed to get container status \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": rpc error: code = NotFound desc = could not find container \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": container with ID starting with 3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b not found: ID does not exist" Jul 31 21:31:43.515718 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.515718 2548 scope.go:117] "RemoveContainer" containerID="c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf" Jul 31 21:31:43.515956 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.515942 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf"} err="failed to get container status \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": rpc error: code = NotFound desc = could not find container \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": container with ID starting with c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf not found: ID does not exist" Jul 31 21:31:43.515956 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.515956 2548 scope.go:117] "RemoveContainer" containerID="f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63" Jul 31 21:31:43.516154 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.516141 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63"} err="failed to get container status \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": rpc error: code = NotFound desc = could not find container \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": container with ID starting with f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63 not found: ID does not exist" Jul 31 21:31:43.516198 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.516155 2548 scope.go:117] "RemoveContainer" containerID="ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9" Jul 31 21:31:43.516369 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.516355 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9"} err="failed to get container status \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": rpc error: code = NotFound desc = could not find container \"ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9\": container with ID starting with ca8b14e89e180c21a8dc339192ae6b64b3d03e4971b2e3fb31aa1ecccf48b6f9 not found: ID does not exist" Jul 31 21:31:43.516369 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.516369 2548 scope.go:117] "RemoveContainer" containerID="2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908" Jul 31 21:31:43.516562 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.516548 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908"} err="failed to get container status \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": rpc error: code = NotFound desc = could not find container \"2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908\": container with ID starting with 2d8f3d35169dbd5e929dec7e1c6f52c8d775fccfe12b60c154b22c06eb048908 not found: ID does not exist" Jul 31 21:31:43.516602 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.516562 2548 scope.go:117] "RemoveContainer" containerID="651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604" Jul 31 21:31:43.516794 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.516765 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604"} err="failed to get container status \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": rpc error: code = NotFound desc = could not find container \"651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604\": container with ID starting with 651a8fffac3cb642d54cb49e94ed6ee7a91a38e3b0051f3884fa548865cca604 not found: ID does not exist" Jul 31 21:31:43.516794 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.516781 2548 scope.go:117] "RemoveContainer" containerID="c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667" Jul 31 21:31:43.517084 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.516991 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667"} err="failed to get container status \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": rpc error: code = NotFound desc = could not find container \"c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667\": container with ID starting with c2cf6bfd109292af0fe6274f01a4381ebdee41638483255136f37965370f2667 not found: ID does not exist" Jul 31 21:31:43.517084 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.517011 2548 scope.go:117] "RemoveContainer" containerID="3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b" Jul 31 21:31:43.517216 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.517200 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b"} err="failed to get container status \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": rpc error: code = NotFound desc = could not find container \"3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b\": container with ID starting with 3a80efee56e8fb611a98c6c8136dcf0f81ebb7e4d066cab401eabe5c0fb9df2b not found: ID does not exist" Jul 31 21:31:43.517253 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.517216 2548 scope.go:117] "RemoveContainer" containerID="c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf" Jul 31 21:31:43.517399 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.517385 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf"} err="failed to get container status \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": rpc error: code = NotFound desc = could not find container \"c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf\": container with ID starting with c0a57119ea6a8ea8f48b49a24eafc7deefb2ee78d7fa2eaf5da7a7baa51b57cf not found: ID does not exist" Jul 31 21:31:43.517399 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.517399 2548 scope.go:117] "RemoveContainer" containerID="f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63" Jul 31 21:31:43.517564 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.517549 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63"} err="failed to get container status \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": rpc error: code = NotFound desc = could not find container \"f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63\": container with ID starting with f08123c9fbc140462d04bb686bc7c58069e0955079bab3f7dfbf419455e6bd63 not found: ID does not exist" Jul 31 21:31:43.518809 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.518771 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.521494 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.521470 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 31 21:31:43.521494 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.521483 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 31 21:31:43.521633 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.521470 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 31 21:31:43.521633 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.521471 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 31 21:31:43.521830 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.521815 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 31 21:31:43.521902 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.521890 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 31 21:31:43.522013 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.521995 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 31 21:31:43.522073 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.521998 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c9t4qb0uq9m90\"" Jul 31 21:31:43.522073 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.522033 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 31 21:31:43.522224 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.522078 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 31 21:31:43.522224 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.522103 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 31 21:31:43.522314 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.522299 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 31 21:31:43.522457 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.522442 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x59vf\"" Jul 31 21:31:43.522518 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.522502 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 31 21:31:43.522552 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.522542 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 31 21:31:43.525610 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.525592 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 31 21:31:43.527947 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.527931 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 31 21:31:43.531811 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.531792 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 21:31:43.572007 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.571972 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e1acec3-d263-4c6e-92ac-88311bea75f2-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572007 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572012 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572029 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572050 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572142 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572244 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572180 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572369 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572252 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572369 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572276 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572369 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572295 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572369 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572318 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572369 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572337 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572369 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572351 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572613 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572371 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572613 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572396 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e1acec3-d263-4c6e-92ac-88311bea75f2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572613 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572431 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc5dq\" (UniqueName: \"kubernetes.io/projected/6e1acec3-d263-4c6e-92ac-88311bea75f2-kube-api-access-hc5dq\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572613 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572493 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572613 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572526 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572613 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572550 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-config\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572613 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572590 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.572613 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.572604 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673001 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.672968 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673001 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673005 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673030 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673048 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673063 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673116 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673166 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673197 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e1acec3-d263-4c6e-92ac-88311bea75f2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673218 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc5dq\" (UniqueName: \"kubernetes.io/projected/6e1acec3-d263-4c6e-92ac-88311bea75f2-kube-api-access-hc5dq\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673249 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673248 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673280 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673303 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-config\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673335 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673358 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673383 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e1acec3-d263-4c6e-92ac-88311bea75f2-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673424 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673447 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673471 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673510 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673537 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.673667 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673580 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.674384 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.673889 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.674384 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.674023 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.674384 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.674179 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.674519 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.674475 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.674636 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.674586 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.675508 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.675478 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.676359 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.676334 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.676446 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.676373 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.676446 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.676416 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.677335 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.676993 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.677335 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.677238 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e1acec3-d263-4c6e-92ac-88311bea75f2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.677496 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.677448 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e1acec3-d263-4c6e-92ac-88311bea75f2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.677718 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.677621 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.677796 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.677773 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e1acec3-d263-4c6e-92ac-88311bea75f2-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.678922 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.678888 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.679152 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.679135 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.679152 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.679147 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-config\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.679238 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.679216 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e1acec3-d263-4c6e-92ac-88311bea75f2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.684937 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.684902 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc5dq\" (UniqueName: \"kubernetes.io/projected/6e1acec3-d263-4c6e-92ac-88311bea75f2-kube-api-access-hc5dq\") pod \"prometheus-k8s-0\" (UID: \"6e1acec3-d263-4c6e-92ac-88311bea75f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.829779 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.829754 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:43.965156 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:43.965134 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 21:31:43.967075 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:31:43.967050 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1acec3_d263_4c6e_92ac_88311bea75f2.slice/crio-bc89046995cbb20e4d5d804844eda80a05c1d586ba3e9df423f1b66ddb850000 WatchSource:0}: Error finding container bc89046995cbb20e4d5d804844eda80a05c1d586ba3e9df423f1b66ddb850000: Status 404 returned error can't find the container with id bc89046995cbb20e4d5d804844eda80a05c1d586ba3e9df423f1b66ddb850000 Jul 31 21:31:44.173889 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:44.173820 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f318051-ed43-48fd-8c32-d5c6037897d3" path="/var/lib/kubelet/pods/1f318051-ed43-48fd-8c32-d5c6037897d3/volumes" Jul 31 21:31:44.460254 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:44.460181 2548 generic.go:356] "Generic (PLEG): container finished" podID="6e1acec3-d263-4c6e-92ac-88311bea75f2" containerID="e4c4d32ecf0c80c40bca5d9aca8781562ef6f755954329488218cb2c05bb6a01" exitCode=0 Jul 31 21:31:44.460400 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:44.460265 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1acec3-d263-4c6e-92ac-88311bea75f2","Type":"ContainerDied","Data":"e4c4d32ecf0c80c40bca5d9aca8781562ef6f755954329488218cb2c05bb6a01"} Jul 31 21:31:44.460400 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:44.460350 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1acec3-d263-4c6e-92ac-88311bea75f2","Type":"ContainerStarted","Data":"bc89046995cbb20e4d5d804844eda80a05c1d586ba3e9df423f1b66ddb850000"} Jul 31 21:31:45.467352 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:45.467311 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1acec3-d263-4c6e-92ac-88311bea75f2","Type":"ContainerStarted","Data":"32bc884d2317d38ee51f77f0fecf2f473ba74ef032baac8c451dfe7c7032b6b5"} Jul 31 21:31:45.467813 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:45.467394 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1acec3-d263-4c6e-92ac-88311bea75f2","Type":"ContainerStarted","Data":"c55c512432be0910c028e8c9db5f16bd3434da4c180ac68f2ee6e44f0cfa4032"} Jul 31 21:31:45.467813 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:45.467431 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1acec3-d263-4c6e-92ac-88311bea75f2","Type":"ContainerStarted","Data":"572df88884bd8c2c9384a18ea7fac49c5668639d0a7398311b53cf703ecded42"} Jul 31 21:31:45.467813 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:45.467470 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1acec3-d263-4c6e-92ac-88311bea75f2","Type":"ContainerStarted","Data":"e3797c6e5874f55648f1fd6537a63eeeab8e0128fbb127dde120fe1e4e0f540d"} Jul 31 21:31:45.467813 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:45.467513 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1acec3-d263-4c6e-92ac-88311bea75f2","Type":"ContainerStarted","Data":"900f4c44c0d14d7b68c2744f18df11e38b29555f69e81f1516247a3bf00d4367"} Jul 31 21:31:45.467813 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:45.467551 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1acec3-d263-4c6e-92ac-88311bea75f2","Type":"ContainerStarted","Data":"6a1f4156872f03443e1ade93dfd2794fa5fa40e9f8e1a46b8146d4305470cc47"} Jul 31 21:31:45.496816 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:45.496760 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.475654802 podStartE2EDuration="2.496739671s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.084869ms" isStatefulPod=false podCreationTimestamp="2026-07-31 21:31:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:31:45.494997304 +0000 UTC m=+365.729229344" watchObservedRunningTime="2026-07-31 21:31:45.496739671 +0000 UTC m=+365.730971711" Jul 31 21:31:48.830933 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:48.830875 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:31:54.068990 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:54.068949 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:31:54.071302 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:54.071282 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a359de99-657c-4c35-bf34-31ef06ddfbc6-metrics-certs\") pod \"network-metrics-daemon-brfzt\" (UID: \"a359de99-657c-4c35-bf34-31ef06ddfbc6\") " pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:31:54.075019 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:54.075003 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nppbx\"" Jul 31 21:31:54.082417 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:54.082403 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brfzt" Jul 31 21:31:54.211040 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:54.211017 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-brfzt"] Jul 31 21:31:54.213076 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:31:54.213050 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda359de99_657c_4c35_bf34_31ef06ddfbc6.slice/crio-d504c012f6a5c82c582c9069e4c1d5953f74385b5e0606ac9fe4125ab9f503cb WatchSource:0}: Error finding container d504c012f6a5c82c582c9069e4c1d5953f74385b5e0606ac9fe4125ab9f503cb: Status 404 returned error can't find the container with id d504c012f6a5c82c582c9069e4c1d5953f74385b5e0606ac9fe4125ab9f503cb Jul 31 21:31:54.215021 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:54.215004 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 21:31:54.504225 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:54.504192 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brfzt" event={"ID":"a359de99-657c-4c35-bf34-31ef06ddfbc6","Type":"ContainerStarted","Data":"d504c012f6a5c82c582c9069e4c1d5953f74385b5e0606ac9fe4125ab9f503cb"} Jul 31 21:31:56.513867 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:56.513828 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brfzt" event={"ID":"a359de99-657c-4c35-bf34-31ef06ddfbc6","Type":"ContainerStarted","Data":"b643a72b90178e654f0dacf24db6f88eab97de8cd683fd779c9da61c55bd7c6b"} Jul 31 21:31:56.514275 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:56.513893 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brfzt" event={"ID":"a359de99-657c-4c35-bf34-31ef06ddfbc6","Type":"ContainerStarted","Data":"44f77f0a196a1df05eac7caf7c2804c2e0617a161217fa12bbb582380beff0dd"} Jul 31 21:31:56.531417 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:31:56.531369 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-brfzt" podStartSLOduration=375.29289018 podStartE2EDuration="6m16.531352224s" totalImagesPullingTime="1.238462044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:31:56.530054943 +0000 UTC m=+376.764286982" watchObservedRunningTime="2026-07-31 21:31:56.531352224 +0000 UTC m=+376.765584262" Jul 31 21:32:43.829884 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:32:43.829852 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:32:43.845595 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:32:43.845568 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:32:44.722585 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:32:44.722563 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 21:33:26.954972 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:26.954935 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q"] Jul 31 21:33:26.958294 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:26.958272 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q" Jul 31 21:33:26.961265 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:26.961247 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 31 21:33:26.962424 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:26.962404 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-t9v29\"" Jul 31 21:33:26.962520 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:26.962443 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 31 21:33:26.967269 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:26.967249 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q"] Jul 31 21:33:27.132618 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:27.132586 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb5fx\" (UniqueName: \"kubernetes.io/projected/e8b6b51e-3239-4ad4-84da-0db64c934acd-kube-api-access-tb5fx\") pod \"cert-manager-cainjector-559cdd8c87-n2p9q\" (UID: \"e8b6b51e-3239-4ad4-84da-0db64c934acd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q" Jul 31 21:33:27.132795 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:27.132649 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8b6b51e-3239-4ad4-84da-0db64c934acd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n2p9q\" (UID: \"e8b6b51e-3239-4ad4-84da-0db64c934acd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q" Jul 31 21:33:27.233560 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:27.233477 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb5fx\" (UniqueName: \"kubernetes.io/projected/e8b6b51e-3239-4ad4-84da-0db64c934acd-kube-api-access-tb5fx\") pod \"cert-manager-cainjector-559cdd8c87-n2p9q\" (UID: \"e8b6b51e-3239-4ad4-84da-0db64c934acd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q" Jul 31 21:33:27.233560 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:27.233538 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8b6b51e-3239-4ad4-84da-0db64c934acd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n2p9q\" (UID: \"e8b6b51e-3239-4ad4-84da-0db64c934acd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q" Jul 31 21:33:27.242453 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:27.242415 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8b6b51e-3239-4ad4-84da-0db64c934acd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n2p9q\" (UID: \"e8b6b51e-3239-4ad4-84da-0db64c934acd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q" Jul 31 21:33:27.242592 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:27.242536 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb5fx\" (UniqueName: \"kubernetes.io/projected/e8b6b51e-3239-4ad4-84da-0db64c934acd-kube-api-access-tb5fx\") pod \"cert-manager-cainjector-559cdd8c87-n2p9q\" (UID: \"e8b6b51e-3239-4ad4-84da-0db64c934acd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q" Jul 31 21:33:27.279381 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:27.279354 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q" Jul 31 21:33:27.406776 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:27.406651 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q"] Jul 31 21:33:27.409445 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:33:27.409413 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8b6b51e_3239_4ad4_84da_0db64c934acd.slice/crio-d899c8e3895e5f010050caee55bf027cdc3eed9a81aea26e21bc668fc3d629a6 WatchSource:0}: Error finding container d899c8e3895e5f010050caee55bf027cdc3eed9a81aea26e21bc668fc3d629a6: Status 404 returned error can't find the container with id d899c8e3895e5f010050caee55bf027cdc3eed9a81aea26e21bc668fc3d629a6 Jul 31 21:33:27.879704 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:27.879670 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q" event={"ID":"e8b6b51e-3239-4ad4-84da-0db64c934acd","Type":"ContainerStarted","Data":"d899c8e3895e5f010050caee55bf027cdc3eed9a81aea26e21bc668fc3d629a6"} Jul 31 21:33:30.895800 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:30.895756 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q" event={"ID":"e8b6b51e-3239-4ad4-84da-0db64c934acd","Type":"ContainerStarted","Data":"f4a96ace9e3b360734374ce93dbec0a16947c9fe9f8627adec993f011420f7ff"} Jul 31 21:33:30.915499 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:30.915451 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2p9q" podStartSLOduration=1.807965641 podStartE2EDuration="4.915436213s" totalImagesPullingTime="3.107470572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:33:30.914136181 +0000 UTC m=+471.148368237" watchObservedRunningTime="2026-07-31 21:33:30.915436213 +0000 UTC m=+471.149668252" Jul 31 21:33:36.226628 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.226590 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn"] Jul 31 21:33:36.230054 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.230034 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn" Jul 31 21:33:36.232827 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.232811 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-746qw\"" Jul 31 21:33:36.232933 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.232872 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 31 21:33:36.234156 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.234138 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 31 21:33:36.242606 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.242582 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn"] Jul 31 21:33:36.304549 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.304503 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a87fdd3d-d86a-43b0-a542-346d7d8a50df-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vtbhn\" (UID: \"a87fdd3d-d86a-43b0-a542-346d7d8a50df\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn" Jul 31 21:33:36.304733 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.304575 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rllc\" (UniqueName: \"kubernetes.io/projected/a87fdd3d-d86a-43b0-a542-346d7d8a50df-kube-api-access-7rllc\") pod \"openshift-lws-operator-fd8ccff4c-vtbhn\" (UID: \"a87fdd3d-d86a-43b0-a542-346d7d8a50df\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn" Jul 31 21:33:36.404922 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.404886 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a87fdd3d-d86a-43b0-a542-346d7d8a50df-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vtbhn\" (UID: \"a87fdd3d-d86a-43b0-a542-346d7d8a50df\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn" Jul 31 21:33:36.405083 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.404948 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rllc\" (UniqueName: \"kubernetes.io/projected/a87fdd3d-d86a-43b0-a542-346d7d8a50df-kube-api-access-7rllc\") pod \"openshift-lws-operator-fd8ccff4c-vtbhn\" (UID: \"a87fdd3d-d86a-43b0-a542-346d7d8a50df\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn" Jul 31 21:33:36.405279 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.405254 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a87fdd3d-d86a-43b0-a542-346d7d8a50df-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vtbhn\" (UID: \"a87fdd3d-d86a-43b0-a542-346d7d8a50df\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn" Jul 31 21:33:36.413701 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.413676 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rllc\" (UniqueName: \"kubernetes.io/projected/a87fdd3d-d86a-43b0-a542-346d7d8a50df-kube-api-access-7rllc\") pod \"openshift-lws-operator-fd8ccff4c-vtbhn\" (UID: \"a87fdd3d-d86a-43b0-a542-346d7d8a50df\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn" Jul 31 21:33:36.539406 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.539320 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn" Jul 31 21:33:36.677666 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.677635 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn"] Jul 31 21:33:36.680690 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:33:36.680659 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda87fdd3d_d86a_43b0_a542_346d7d8a50df.slice/crio-4788a669bb3deb644d105200fdb06ccbedf96eae4b497a8627500fd167094a1d WatchSource:0}: Error finding container 4788a669bb3deb644d105200fdb06ccbedf96eae4b497a8627500fd167094a1d: Status 404 returned error can't find the container with id 4788a669bb3deb644d105200fdb06ccbedf96eae4b497a8627500fd167094a1d Jul 31 21:33:36.920889 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:36.920845 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn" event={"ID":"a87fdd3d-d86a-43b0-a542-346d7d8a50df","Type":"ContainerStarted","Data":"4788a669bb3deb644d105200fdb06ccbedf96eae4b497a8627500fd167094a1d"} Jul 31 21:33:39.938981 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:39.938945 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn" event={"ID":"a87fdd3d-d86a-43b0-a542-346d7d8a50df","Type":"ContainerStarted","Data":"29e40d6fd546c6a8f49783d51e9a099036dd2e8947ee0ad2ffde2554355c3bd2"} Jul 31 21:33:39.960533 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:39.960485 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhn" podStartSLOduration=1.395659492 podStartE2EDuration="3.960471346s" totalImagesPullingTime="2.564811854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:33:39.958214958 +0000 UTC m=+480.192446999" watchObservedRunningTime="2026-07-31 21:33:39.960471346 +0000 UTC m=+480.194703384" Jul 31 21:33:56.439802 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.439768 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph"] Jul 31 21:33:56.446774 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.446754 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.449571 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.449545 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 31 21:33:56.449571 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.449562 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 31 21:33:56.450050 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.449961 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 31 21:33:56.450241 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.450209 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wqfbt\"" Jul 31 21:33:56.450349 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.450313 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 31 21:33:56.461971 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.461949 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph"] Jul 31 21:33:56.560024 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.559987 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/293dbfff-da0a-4f7f-98ae-878863606cc3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.560172 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.560045 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/293dbfff-da0a-4f7f-98ae-878863606cc3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.560172 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.560099 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/293dbfff-da0a-4f7f-98ae-878863606cc3-tmp\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.560172 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.560141 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/293dbfff-da0a-4f7f-98ae-878863606cc3-manifests\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.560297 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.560200 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r56z2\" (UniqueName: \"kubernetes.io/projected/293dbfff-da0a-4f7f-98ae-878863606cc3-kube-api-access-r56z2\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.661261 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.661224 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/293dbfff-da0a-4f7f-98ae-878863606cc3-manifests\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.661436 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.661284 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r56z2\" (UniqueName: \"kubernetes.io/projected/293dbfff-da0a-4f7f-98ae-878863606cc3-kube-api-access-r56z2\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.661436 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.661314 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/293dbfff-da0a-4f7f-98ae-878863606cc3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.661436 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.661343 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/293dbfff-da0a-4f7f-98ae-878863606cc3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.661436 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.661362 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/293dbfff-da0a-4f7f-98ae-878863606cc3-tmp\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.661703 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.661681 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/293dbfff-da0a-4f7f-98ae-878863606cc3-manifests\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.663779 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.663746 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/293dbfff-da0a-4f7f-98ae-878863606cc3-tmp\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.663883 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.663796 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/293dbfff-da0a-4f7f-98ae-878863606cc3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.663979 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.663965 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/293dbfff-da0a-4f7f-98ae-878863606cc3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.671726 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.671706 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r56z2\" (UniqueName: \"kubernetes.io/projected/293dbfff-da0a-4f7f-98ae-878863606cc3-kube-api-access-r56z2\") pod \"opendatahub-operator-controller-manager-7b88b5667d-lvhph\" (UID: \"293dbfff-da0a-4f7f-98ae-878863606cc3\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.758146 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.758066 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:33:56.921376 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:56.921351 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph"] Jul 31 21:33:56.924901 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:33:56.924878 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod293dbfff_da0a_4f7f_98ae_878863606cc3.slice/crio-c17bbd247a5d7cff1151d22eb70c1bf15cbe7e95fdd9295a6e3f2409223cfaab WatchSource:0}: Error finding container c17bbd247a5d7cff1151d22eb70c1bf15cbe7e95fdd9295a6e3f2409223cfaab: Status 404 returned error can't find the container with id c17bbd247a5d7cff1151d22eb70c1bf15cbe7e95fdd9295a6e3f2409223cfaab Jul 31 21:33:57.020322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:33:57.020245 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" event={"ID":"293dbfff-da0a-4f7f-98ae-878863606cc3","Type":"ContainerStarted","Data":"c17bbd247a5d7cff1151d22eb70c1bf15cbe7e95fdd9295a6e3f2409223cfaab"} Jul 31 21:34:01.043022 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:01.042987 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" event={"ID":"293dbfff-da0a-4f7f-98ae-878863606cc3","Type":"ContainerStarted","Data":"24d8a2db82fc67d4b4b0878ffef6cb7ecda37bf4f8e7d2cb3312ba62526b51b3"} Jul 31 21:34:02.049177 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:02.049137 2548 generic.go:356] "Generic (PLEG): container finished" podID="293dbfff-da0a-4f7f-98ae-878863606cc3" containerID="24d8a2db82fc67d4b4b0878ffef6cb7ecda37bf4f8e7d2cb3312ba62526b51b3" exitCode=0 Jul 31 21:34:02.049576 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:02.049206 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" event={"ID":"293dbfff-da0a-4f7f-98ae-878863606cc3","Type":"ContainerDied","Data":"24d8a2db82fc67d4b4b0878ffef6cb7ecda37bf4f8e7d2cb3312ba62526b51b3"} Jul 31 21:34:03.056231 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:03.056198 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" event={"ID":"293dbfff-da0a-4f7f-98ae-878863606cc3","Type":"ContainerStarted","Data":"76a63055e01e707524acdbefede1631bc6a19c548feb1b896a68645ce5b0e77c"} Jul 31 21:34:03.056603 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:03.056320 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:34:03.088698 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:03.088653 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" podStartSLOduration=2.591223738 podStartE2EDuration="7.088634503s" totalImagesPullingTime="3.433995698s" totalInitContainerRuntime="1.063415067s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:33:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:34:03.088197571 +0000 UTC m=+503.322429632" watchObservedRunningTime="2026-07-31 21:34:03.088634503 +0000 UTC m=+503.322866541" Jul 31 21:34:14.063215 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:14.063186 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-lvhph" Jul 31 21:34:16.788631 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:16.788589 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc"] Jul 31 21:34:16.795528 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:16.795506 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:16.799687 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:16.799663 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 31 21:34:16.799957 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:16.799939 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 31 21:34:16.800171 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:16.800155 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 31 21:34:16.804588 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:16.804570 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 31 21:34:16.833243 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:16.833218 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc"] Jul 31 21:34:16.952294 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:16.952258 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd9fn\" (UniqueName: \"kubernetes.io/projected/623c95ff-891f-45e7-8d14-5b4453a1e996-kube-api-access-cd9fn\") pod \"kube-auth-proxy-7d77494cc5-z4krc\" (UID: \"623c95ff-891f-45e7-8d14-5b4453a1e996\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:16.952481 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:16.952375 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623c95ff-891f-45e7-8d14-5b4453a1e996-tls-certs\") pod \"kube-auth-proxy-7d77494cc5-z4krc\" (UID: \"623c95ff-891f-45e7-8d14-5b4453a1e996\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:16.952481 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:16.952405 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/623c95ff-891f-45e7-8d14-5b4453a1e996-tmp\") pod \"kube-auth-proxy-7d77494cc5-z4krc\" (UID: \"623c95ff-891f-45e7-8d14-5b4453a1e996\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:17.002151 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.002112 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z6xdq"] Jul 31 21:34:17.005568 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.005548 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" Jul 31 21:34:17.010396 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.010376 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 31 21:34:17.020837 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.020817 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z6xdq"] Jul 31 21:34:17.021808 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.021790 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6znbw\"" Jul 31 21:34:17.053089 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.053014 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623c95ff-891f-45e7-8d14-5b4453a1e996-tls-certs\") pod \"kube-auth-proxy-7d77494cc5-z4krc\" (UID: \"623c95ff-891f-45e7-8d14-5b4453a1e996\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:17.053089 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.053054 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/623c95ff-891f-45e7-8d14-5b4453a1e996-tmp\") pod \"kube-auth-proxy-7d77494cc5-z4krc\" (UID: \"623c95ff-891f-45e7-8d14-5b4453a1e996\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:17.053263 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.053095 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd9fn\" (UniqueName: \"kubernetes.io/projected/623c95ff-891f-45e7-8d14-5b4453a1e996-kube-api-access-cd9fn\") pod \"kube-auth-proxy-7d77494cc5-z4krc\" (UID: \"623c95ff-891f-45e7-8d14-5b4453a1e996\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:17.053263 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:34:17.053206 2548 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 31 21:34:17.053390 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:34:17.053377 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623c95ff-891f-45e7-8d14-5b4453a1e996-tls-certs podName:623c95ff-891f-45e7-8d14-5b4453a1e996 nodeName:}" failed. No retries permitted until 2026-07-31 21:34:17.553355388 +0000 UTC m=+517.787587429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/623c95ff-891f-45e7-8d14-5b4453a1e996-tls-certs") pod "kube-auth-proxy-7d77494cc5-z4krc" (UID: "623c95ff-891f-45e7-8d14-5b4453a1e996") : secret "kube-auth-proxy-tls" not found Jul 31 21:34:17.055582 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.055555 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/623c95ff-891f-45e7-8d14-5b4453a1e996-tmp\") pod \"kube-auth-proxy-7d77494cc5-z4krc\" (UID: \"623c95ff-891f-45e7-8d14-5b4453a1e996\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:17.098552 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.098518 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd9fn\" (UniqueName: \"kubernetes.io/projected/623c95ff-891f-45e7-8d14-5b4453a1e996-kube-api-access-cd9fn\") pod \"kube-auth-proxy-7d77494cc5-z4krc\" (UID: \"623c95ff-891f-45e7-8d14-5b4453a1e996\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:17.154190 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.154158 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71dd4988-ddca-40cc-a95f-257c537256f5-cert\") pod \"odh-model-controller-7998c67dc4-z6xdq\" (UID: \"71dd4988-ddca-40cc-a95f-257c537256f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" Jul 31 21:34:17.154357 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.154259 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx2wk\" (UniqueName: \"kubernetes.io/projected/71dd4988-ddca-40cc-a95f-257c537256f5-kube-api-access-mx2wk\") pod \"odh-model-controller-7998c67dc4-z6xdq\" (UID: \"71dd4988-ddca-40cc-a95f-257c537256f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" Jul 31 21:34:17.255213 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.255180 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx2wk\" (UniqueName: \"kubernetes.io/projected/71dd4988-ddca-40cc-a95f-257c537256f5-kube-api-access-mx2wk\") pod \"odh-model-controller-7998c67dc4-z6xdq\" (UID: \"71dd4988-ddca-40cc-a95f-257c537256f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" Jul 31 21:34:17.255489 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.255417 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71dd4988-ddca-40cc-a95f-257c537256f5-cert\") pod \"odh-model-controller-7998c67dc4-z6xdq\" (UID: \"71dd4988-ddca-40cc-a95f-257c537256f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" Jul 31 21:34:17.255644 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:34:17.255542 2548 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 31 21:34:17.255644 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:34:17.255601 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71dd4988-ddca-40cc-a95f-257c537256f5-cert podName:71dd4988-ddca-40cc-a95f-257c537256f5 nodeName:}" failed. No retries permitted until 2026-07-31 21:34:17.755582385 +0000 UTC m=+517.989814421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/71dd4988-ddca-40cc-a95f-257c537256f5-cert") pod "odh-model-controller-7998c67dc4-z6xdq" (UID: "71dd4988-ddca-40cc-a95f-257c537256f5") : secret "odh-model-controller-webhook-cert" not found Jul 31 21:34:17.288813 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.288777 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx2wk\" (UniqueName: \"kubernetes.io/projected/71dd4988-ddca-40cc-a95f-257c537256f5-kube-api-access-mx2wk\") pod \"odh-model-controller-7998c67dc4-z6xdq\" (UID: \"71dd4988-ddca-40cc-a95f-257c537256f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" Jul 31 21:34:17.559032 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.559001 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623c95ff-891f-45e7-8d14-5b4453a1e996-tls-certs\") pod \"kube-auth-proxy-7d77494cc5-z4krc\" (UID: \"623c95ff-891f-45e7-8d14-5b4453a1e996\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:17.561451 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.561432 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623c95ff-891f-45e7-8d14-5b4453a1e996-tls-certs\") pod \"kube-auth-proxy-7d77494cc5-z4krc\" (UID: \"623c95ff-891f-45e7-8d14-5b4453a1e996\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:17.706243 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.706202 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" Jul 31 21:34:17.760626 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.760598 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71dd4988-ddca-40cc-a95f-257c537256f5-cert\") pod \"odh-model-controller-7998c67dc4-z6xdq\" (UID: \"71dd4988-ddca-40cc-a95f-257c537256f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" Jul 31 21:34:17.766374 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.764062 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71dd4988-ddca-40cc-a95f-257c537256f5-cert\") pod \"odh-model-controller-7998c67dc4-z6xdq\" (UID: \"71dd4988-ddca-40cc-a95f-257c537256f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" Jul 31 21:34:17.875972 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.875948 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc"] Jul 31 21:34:17.877724 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:34:17.877700 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623c95ff_891f_45e7_8d14_5b4453a1e996.slice/crio-4353c1d76f98c80369e35c1c001704cefb7ec5affa95e2fae3cddbbe692422e5 WatchSource:0}: Error finding container 4353c1d76f98c80369e35c1c001704cefb7ec5affa95e2fae3cddbbe692422e5: Status 404 returned error can't find the container with id 4353c1d76f98c80369e35c1c001704cefb7ec5affa95e2fae3cddbbe692422e5 Jul 31 21:34:17.915445 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:17.915414 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" Jul 31 21:34:18.092706 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.092644 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z6xdq"] Jul 31 21:34:18.094892 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:34:18.094845 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71dd4988_ddca_40cc_a95f_257c537256f5.slice/crio-0cce1e59c54e53ec0fa90d366ed094b5ec677aa79b22a25e0db3b8ec4d919e4f WatchSource:0}: Error finding container 0cce1e59c54e53ec0fa90d366ed094b5ec677aa79b22a25e0db3b8ec4d919e4f: Status 404 returned error can't find the container with id 0cce1e59c54e53ec0fa90d366ed094b5ec677aa79b22a25e0db3b8ec4d919e4f Jul 31 21:34:18.125955 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.125930 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" event={"ID":"623c95ff-891f-45e7-8d14-5b4453a1e996","Type":"ContainerStarted","Data":"4353c1d76f98c80369e35c1c001704cefb7ec5affa95e2fae3cddbbe692422e5"} Jul 31 21:34:18.127094 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.127067 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" event={"ID":"71dd4988-ddca-40cc-a95f-257c537256f5","Type":"ContainerStarted","Data":"0cce1e59c54e53ec0fa90d366ed094b5ec677aa79b22a25e0db3b8ec4d919e4f"} Jul 31 21:34:18.555280 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.555184 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s66v6"] Jul 31 21:34:18.559298 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.559268 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" Jul 31 21:34:18.563691 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.563671 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-xlhvp\"" Jul 31 21:34:18.564034 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.563816 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 31 21:34:18.583992 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.583967 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s66v6"] Jul 31 21:34:18.670046 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.670011 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e88a7ba5-37cc-41c6-9258-24abeb2a4403-tls-certs\") pod \"model-serving-api-54d89bd5fc-s66v6\" (UID: \"e88a7ba5-37cc-41c6-9258-24abeb2a4403\") " pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" Jul 31 21:34:18.670242 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.670074 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bc8q\" (UniqueName: \"kubernetes.io/projected/e88a7ba5-37cc-41c6-9258-24abeb2a4403-kube-api-access-7bc8q\") pod \"model-serving-api-54d89bd5fc-s66v6\" (UID: \"e88a7ba5-37cc-41c6-9258-24abeb2a4403\") " pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" Jul 31 21:34:18.772785 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.772718 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e88a7ba5-37cc-41c6-9258-24abeb2a4403-tls-certs\") pod \"model-serving-api-54d89bd5fc-s66v6\" (UID: \"e88a7ba5-37cc-41c6-9258-24abeb2a4403\") " pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" Jul 31 21:34:18.773003 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.772824 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bc8q\" (UniqueName: \"kubernetes.io/projected/e88a7ba5-37cc-41c6-9258-24abeb2a4403-kube-api-access-7bc8q\") pod \"model-serving-api-54d89bd5fc-s66v6\" (UID: \"e88a7ba5-37cc-41c6-9258-24abeb2a4403\") " pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" Jul 31 21:34:18.788082 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.786738 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e88a7ba5-37cc-41c6-9258-24abeb2a4403-tls-certs\") pod \"model-serving-api-54d89bd5fc-s66v6\" (UID: \"e88a7ba5-37cc-41c6-9258-24abeb2a4403\") " pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" Jul 31 21:34:18.803712 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.803677 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bc8q\" (UniqueName: \"kubernetes.io/projected/e88a7ba5-37cc-41c6-9258-24abeb2a4403-kube-api-access-7bc8q\") pod \"model-serving-api-54d89bd5fc-s66v6\" (UID: \"e88a7ba5-37cc-41c6-9258-24abeb2a4403\") " pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" Jul 31 21:34:18.874418 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:18.874382 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" Jul 31 21:34:19.089621 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.088357 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s66v6"] Jul 31 21:34:19.094415 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:34:19.094379 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88a7ba5_37cc_41c6_9258_24abeb2a4403.slice/crio-1d584f55c35b24623fffcb62b6ef81480bf6ab15b31d21b36b9960b96777be40 WatchSource:0}: Error finding container 1d584f55c35b24623fffcb62b6ef81480bf6ab15b31d21b36b9960b96777be40: Status 404 returned error can't find the container with id 1d584f55c35b24623fffcb62b6ef81480bf6ab15b31d21b36b9960b96777be40 Jul 31 21:34:19.135555 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.135459 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" event={"ID":"e88a7ba5-37cc-41c6-9258-24abeb2a4403","Type":"ContainerStarted","Data":"1d584f55c35b24623fffcb62b6ef81480bf6ab15b31d21b36b9960b96777be40"} Jul 31 21:34:19.234932 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.234880 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq"] Jul 31 21:34:19.240138 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.240113 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.245210 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.244712 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 31 21:34:19.245210 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.244788 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 31 21:34:19.245210 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.244938 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 31 21:34:19.245210 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.244980 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 31 21:34:19.245210 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.245108 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9jtr7\"" Jul 31 21:34:19.263179 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.263110 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq"] Jul 31 21:34:19.381737 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.381697 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.382006 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.381774 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.382006 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.381822 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.382006 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.381863 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e24229-3e55-4ea8-a302-e4252ec592cb-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.382006 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.381892 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.382006 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.381993 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.382283 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.382017 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmvsq\" (UniqueName: \"kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-kube-api-access-bmvsq\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.482945 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.482828 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.482945 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.482893 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.483170 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.482958 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e24229-3e55-4ea8-a302-e4252ec592cb-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.483170 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.482985 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.483170 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.483029 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.483170 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.483053 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmvsq\" (UniqueName: \"kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-kube-api-access-bmvsq\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.483170 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.483129 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.486113 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.486016 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.487568 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.487524 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.488711 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.488684 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.488890 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.488837 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e24229-3e55-4ea8-a302-e4252ec592cb-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.489142 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.489084 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.501155 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.501124 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.504283 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.504254 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmvsq\" (UniqueName: \"kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-kube-api-access-bmvsq\") pod \"istiod-openshift-gateway-7b7995d5cd-jm7jq\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:19.554837 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:19.554806 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:22.762781 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:22.762757 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq"] Jul 31 21:34:22.765961 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:34:22.765935 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e24229_3e55_4ea8_a302_e4252ec592cb.slice/crio-ee3d06198a696212a0fb2895570734ae5cd56795184861819d22f6803a79745f WatchSource:0}: Error finding container ee3d06198a696212a0fb2895570734ae5cd56795184861819d22f6803a79745f: Status 404 returned error can't find the container with id ee3d06198a696212a0fb2895570734ae5cd56795184861819d22f6803a79745f Jul 31 21:34:23.163725 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:23.163693 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" event={"ID":"e88a7ba5-37cc-41c6-9258-24abeb2a4403","Type":"ContainerStarted","Data":"5dabb9a42f49095e4c2ddb9f35e21eacacb54af7473e4ffb39374147a24e7392"} Jul 31 21:34:23.163940 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:23.163794 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" Jul 31 21:34:23.165251 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:23.165227 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" event={"ID":"a8e24229-3e55-4ea8-a302-e4252ec592cb","Type":"ContainerStarted","Data":"ee3d06198a696212a0fb2895570734ae5cd56795184861819d22f6803a79745f"} Jul 31 21:34:23.166568 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:23.166548 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" event={"ID":"623c95ff-891f-45e7-8d14-5b4453a1e996","Type":"ContainerStarted","Data":"b64f5ca8a20606ea03c3d3b033b4ae89dda035959bcba2f65a6abedec7232f90"} Jul 31 21:34:23.168009 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:23.167979 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" event={"ID":"71dd4988-ddca-40cc-a95f-257c537256f5","Type":"ContainerStarted","Data":"c83644a518a42e2899cd21eeb783298a7fae70527aaa5b9fd81044e90a64ec4a"} Jul 31 21:34:23.168154 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:23.168139 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" Jul 31 21:34:23.184348 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:23.184306 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" podStartSLOduration=1.670370285 podStartE2EDuration="5.184294368s" totalImagesPullingTime="3.513924083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:34:23.183033739 +0000 UTC m=+523.417265779" watchObservedRunningTime="2026-07-31 21:34:23.184294368 +0000 UTC m=+523.418526407" Jul 31 21:34:23.221282 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:23.221242 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d77494cc5-z4krc" podStartSLOduration=2.486806452 podStartE2EDuration="7.221229764s" totalImagesPullingTime="4.734423312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:34:23.220473649 +0000 UTC m=+523.454705718" watchObservedRunningTime="2026-07-31 21:34:23.221229764 +0000 UTC m=+523.455461804" Jul 31 21:34:23.222631 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:23.222600 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" podStartSLOduration=2.703782265 podStartE2EDuration="7.222589544s" totalImagesPullingTime="4.518807279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:34:23.202378081 +0000 UTC m=+523.436610115" watchObservedRunningTime="2026-07-31 21:34:23.222589544 +0000 UTC m=+523.456821583" Jul 31 21:34:25.435606 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:25.435565 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 31 21:34:25.435938 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:25.435631 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 31 21:34:26.186466 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:26.186437 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" event={"ID":"a8e24229-3e55-4ea8-a302-e4252ec592cb","Type":"ContainerStarted","Data":"2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00"} Jul 31 21:34:26.186640 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:26.186579 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:26.188215 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:26.188193 2548 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-jm7jq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 31 21:34:26.188307 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:26.188230 2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" podUID="a8e24229-3e55-4ea8-a302-e4252ec592cb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 21:34:26.253453 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:26.253407 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" podStartSLOduration=4.586166082 podStartE2EDuration="7.253392413s" totalImagesPullingTime="2.667226331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:34:26.251012037 +0000 UTC m=+526.485244123" watchObservedRunningTime="2026-07-31 21:34:26.253392413 +0000 UTC m=+526.487624452" Jul 31 21:34:26.889941 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:26.889752 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f"] Jul 31 21:34:26.894782 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:26.894760 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:26.897875 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:26.897853 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gn2hs\"" Jul 31 21:34:26.921421 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:26.921393 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f"] Jul 31 21:34:27.061035 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.061001 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.061035 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.061036 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c25e75c-15b6-404d-999f-81f25af54d38-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.061275 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.061059 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.061275 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.061127 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.061275 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.061160 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnfbk\" (UniqueName: \"kubernetes.io/projected/8c25e75c-15b6-404d-999f-81f25af54d38-kube-api-access-qnfbk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.061275 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.061188 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c25e75c-15b6-404d-999f-81f25af54d38-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.061275 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.061243 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.061275 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.061259 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.061473 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.061307 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c25e75c-15b6-404d-999f-81f25af54d38-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.162410 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.162326 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnfbk\" (UniqueName: \"kubernetes.io/projected/8c25e75c-15b6-404d-999f-81f25af54d38-kube-api-access-qnfbk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.162410 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.162366 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c25e75c-15b6-404d-999f-81f25af54d38-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.162410 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.162397 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.162632 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.162424 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.162632 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.162457 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c25e75c-15b6-404d-999f-81f25af54d38-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.163155 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.163023 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.163155 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.163116 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c25e75c-15b6-404d-999f-81f25af54d38-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.163330 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.163181 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.163330 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.163217 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.169936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.163434 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.169936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.163479 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.169936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.163681 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.169936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.163959 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.169936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.164369 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c25e75c-15b6-404d-999f-81f25af54d38-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.169936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.165987 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c25e75c-15b6-404d-999f-81f25af54d38-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.169936 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.166075 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c25e75c-15b6-404d-999f-81f25af54d38-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.173824 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.173794 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c25e75c-15b6-404d-999f-81f25af54d38-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.174473 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.174455 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnfbk\" (UniqueName: \"kubernetes.io/projected/8c25e75c-15b6-404d-999f-81f25af54d38-kube-api-access-qnfbk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f\" (UID: \"8c25e75c-15b6-404d-999f-81f25af54d38\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.192771 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.192747 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:27.204857 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.204834 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:27.404291 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:27.404269 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f"] Jul 31 21:34:27.406012 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:34:27.405985 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c25e75c_15b6_404d_999f_81f25af54d38.slice/crio-b2985c8c5ca8b3843384483a1a84617c37c80973da631bd09f5693ac7cfe71f4 WatchSource:0}: Error finding container b2985c8c5ca8b3843384483a1a84617c37c80973da631bd09f5693ac7cfe71f4: Status 404 returned error can't find the container with id b2985c8c5ca8b3843384483a1a84617c37c80973da631bd09f5693ac7cfe71f4 Jul 31 21:34:28.199068 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.199033 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" event={"ID":"8c25e75c-15b6-404d-999f-81f25af54d38","Type":"ContainerStarted","Data":"b2985c8c5ca8b3843384483a1a84617c37c80973da631bd09f5693ac7cfe71f4"} Jul 31 21:34:28.330943 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.330896 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp"] Jul 31 21:34:28.336209 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.336187 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" Jul 31 21:34:28.340217 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.340191 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xxmvq\"" Jul 31 21:34:28.340337 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.340271 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 31 21:34:28.369729 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.369702 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp"] Jul 31 21:34:28.475517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.475346 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkxwd\" (UniqueName: \"kubernetes.io/projected/4135e118-1cf3-407a-87d5-dc88aa9d0efb-kube-api-access-hkxwd\") pod \"kserve-controller-manager-d6f4b65b8-gh8tp\" (UID: \"4135e118-1cf3-407a-87d5-dc88aa9d0efb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" Jul 31 21:34:28.475517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.475419 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4135e118-1cf3-407a-87d5-dc88aa9d0efb-cert\") pod \"kserve-controller-manager-d6f4b65b8-gh8tp\" (UID: \"4135e118-1cf3-407a-87d5-dc88aa9d0efb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" Jul 31 21:34:28.576386 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.576349 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkxwd\" (UniqueName: \"kubernetes.io/projected/4135e118-1cf3-407a-87d5-dc88aa9d0efb-kube-api-access-hkxwd\") pod \"kserve-controller-manager-d6f4b65b8-gh8tp\" (UID: \"4135e118-1cf3-407a-87d5-dc88aa9d0efb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" Jul 31 21:34:28.576568 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.576396 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4135e118-1cf3-407a-87d5-dc88aa9d0efb-cert\") pod \"kserve-controller-manager-d6f4b65b8-gh8tp\" (UID: \"4135e118-1cf3-407a-87d5-dc88aa9d0efb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" Jul 31 21:34:28.583204 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.583154 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4135e118-1cf3-407a-87d5-dc88aa9d0efb-cert\") pod \"kserve-controller-manager-d6f4b65b8-gh8tp\" (UID: \"4135e118-1cf3-407a-87d5-dc88aa9d0efb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" Jul 31 21:34:28.612380 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.612309 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkxwd\" (UniqueName: \"kubernetes.io/projected/4135e118-1cf3-407a-87d5-dc88aa9d0efb-kube-api-access-hkxwd\") pod \"kserve-controller-manager-d6f4b65b8-gh8tp\" (UID: \"4135e118-1cf3-407a-87d5-dc88aa9d0efb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" Jul 31 21:34:28.650109 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.650044 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" Jul 31 21:34:28.835897 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:28.835870 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp"] Jul 31 21:34:28.837742 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:34:28.837713 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4135e118_1cf3_407a_87d5_dc88aa9d0efb.slice/crio-17837b24e26a68b495c2f4ec98859bfeef3e5fda0affef4603953f858533bfab WatchSource:0}: Error finding container 17837b24e26a68b495c2f4ec98859bfeef3e5fda0affef4603953f858533bfab: Status 404 returned error can't find the container with id 17837b24e26a68b495c2f4ec98859bfeef3e5fda0affef4603953f858533bfab Jul 31 21:34:29.206861 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:29.206825 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" event={"ID":"4135e118-1cf3-407a-87d5-dc88aa9d0efb","Type":"ContainerStarted","Data":"17837b24e26a68b495c2f4ec98859bfeef3e5fda0affef4603953f858533bfab"} Jul 31 21:34:31.177861 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:31.177828 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 31 21:34:31.178164 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:31.177896 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 31 21:34:31.178164 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:31.177942 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 31 21:34:32.222766 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.222715 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" event={"ID":"8c25e75c-15b6-404d-999f-81f25af54d38","Type":"ContainerStarted","Data":"d3cd5fe2712e2cbc7210b075594400c7e5fd55272caff872e8ab1323e48eea36"} Jul 31 21:34:32.224253 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.224230 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" event={"ID":"4135e118-1cf3-407a-87d5-dc88aa9d0efb","Type":"ContainerStarted","Data":"bbd3c3db06fe52b3f1bd180693f8bb522a065609e4ca1b13afa67c0bda841289"} Jul 31 21:34:32.224422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.224406 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" Jul 31 21:34:32.255622 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.255580 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" podStartSLOduration=2.48605846 podStartE2EDuration="6.25556518s" totalImagesPullingTime="3.76950672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:34:32.252931964 +0000 UTC m=+532.487163998" watchObservedRunningTime="2026-07-31 21:34:32.25556518 +0000 UTC m=+532.489797218" Jul 31 21:34:32.283894 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.283846 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" podStartSLOduration=1.944517516 podStartE2EDuration="4.283807707s" totalImagesPullingTime="2.339290191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:34:32.283598767 +0000 UTC m=+532.517830807" watchObservedRunningTime="2026-07-31 21:34:32.283807707 +0000 UTC m=+532.518039743" Jul 31 21:34:32.316820 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.316796 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq"] Jul 31 21:34:32.317017 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.316994 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" podUID="a8e24229-3e55-4ea8-a302-e4252ec592cb" containerName="discovery" containerID="cri-o://2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00" gracePeriod=30 Jul 31 21:34:32.577618 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.577588 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:32.719193 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.719163 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-dns-cert\") pod \"a8e24229-3e55-4ea8-a302-e4252ec592cb\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " Jul 31 21:34:32.719362 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.719205 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-ca-configmap\") pod \"a8e24229-3e55-4ea8-a302-e4252ec592cb\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " Jul 31 21:34:32.719362 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.719226 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e24229-3e55-4ea8-a302-e4252ec592cb-local-certs\") pod \"a8e24229-3e55-4ea8-a302-e4252ec592cb\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " Jul 31 21:34:32.719362 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.719242 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-token\") pod \"a8e24229-3e55-4ea8-a302-e4252ec592cb\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " Jul 31 21:34:32.719517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.719386 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-cacerts\") pod \"a8e24229-3e55-4ea8-a302-e4252ec592cb\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " Jul 31 21:34:32.719517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.719456 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmvsq\" (UniqueName: \"kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-kube-api-access-bmvsq\") pod \"a8e24229-3e55-4ea8-a302-e4252ec592cb\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " Jul 31 21:34:32.719517 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.719485 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-kubeconfig\") pod \"a8e24229-3e55-4ea8-a302-e4252ec592cb\" (UID: \"a8e24229-3e55-4ea8-a302-e4252ec592cb\") " Jul 31 21:34:32.719666 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.719631 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a8e24229-3e55-4ea8-a302-e4252ec592cb" (UID: "a8e24229-3e55-4ea8-a302-e4252ec592cb"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:34:32.719831 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.719812 2548 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-ca-configmap\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:34:32.721735 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.721699 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a8e24229-3e55-4ea8-a302-e4252ec592cb" (UID: "a8e24229-3e55-4ea8-a302-e4252ec592cb"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:34:32.721837 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.721738 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a8e24229-3e55-4ea8-a302-e4252ec592cb" (UID: "a8e24229-3e55-4ea8-a302-e4252ec592cb"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:34:32.721897 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.721858 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-cacerts" (OuterVolumeSpecName: "cacerts") pod "a8e24229-3e55-4ea8-a302-e4252ec592cb" (UID: "a8e24229-3e55-4ea8-a302-e4252ec592cb"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:34:32.721897 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.721863 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e24229-3e55-4ea8-a302-e4252ec592cb-local-certs" (OuterVolumeSpecName: "local-certs") pod "a8e24229-3e55-4ea8-a302-e4252ec592cb" (UID: "a8e24229-3e55-4ea8-a302-e4252ec592cb"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:34:32.722060 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.722040 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-kube-api-access-bmvsq" (OuterVolumeSpecName: "kube-api-access-bmvsq") pod "a8e24229-3e55-4ea8-a302-e4252ec592cb" (UID: "a8e24229-3e55-4ea8-a302-e4252ec592cb"). InnerVolumeSpecName "kube-api-access-bmvsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:34:32.722120 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.722098 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "a8e24229-3e55-4ea8-a302-e4252ec592cb" (UID: "a8e24229-3e55-4ea8-a302-e4252ec592cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:34:32.820311 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.820289 2548 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-cacerts\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:34:32.820311 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.820311 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmvsq\" (UniqueName: \"kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-kube-api-access-bmvsq\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:34:32.820440 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.820321 2548 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-kubeconfig\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:34:32.820440 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.820328 2548 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-csr-dns-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:34:32.820440 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.820336 2548 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e24229-3e55-4ea8-a302-e4252ec592cb-local-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:34:32.820440 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:32.820343 2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e24229-3e55-4ea8-a302-e4252ec592cb-istio-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:34:33.205836 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.205764 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:33.210418 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.210398 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:33.229741 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.229711 2548 generic.go:356] "Generic (PLEG): container finished" podID="a8e24229-3e55-4ea8-a302-e4252ec592cb" containerID="2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00" exitCode=0 Jul 31 21:34:33.230203 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.229758 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" Jul 31 21:34:33.230203 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.229801 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" event={"ID":"a8e24229-3e55-4ea8-a302-e4252ec592cb","Type":"ContainerDied","Data":"2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00"} Jul 31 21:34:33.230203 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.229849 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq" event={"ID":"a8e24229-3e55-4ea8-a302-e4252ec592cb","Type":"ContainerDied","Data":"ee3d06198a696212a0fb2895570734ae5cd56795184861819d22f6803a79745f"} Jul 31 21:34:33.230203 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.229882 2548 scope.go:117] "RemoveContainer" containerID="2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00" Jul 31 21:34:33.230549 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.230513 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:33.231423 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.231407 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f" Jul 31 21:34:33.239092 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.239075 2548 scope.go:117] "RemoveContainer" containerID="2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00" Jul 31 21:34:33.239347 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:34:33.239328 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00\": container with ID starting with 2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00 not found: ID does not exist" containerID="2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00" Jul 31 21:34:33.239405 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.239359 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00"} err="failed to get container status \"2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00\": rpc error: code = NotFound desc = could not find container \"2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00\": container with ID starting with 2012f3aa6812ffd592c305d4bdae5f10d0e300f35277dfb418098fcff3df0c00 not found: ID does not exist" Jul 31 21:34:33.389197 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.389166 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq"] Jul 31 21:34:33.400232 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:33.400208 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jm7jq"] Jul 31 21:34:34.174580 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:34.174541 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8e24229-3e55-4ea8-a302-e4252ec592cb" path="/var/lib/kubelet/pods/a8e24229-3e55-4ea8-a302-e4252ec592cb/volumes" Jul 31 21:34:34.176269 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:34.176248 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-z6xdq" Jul 31 21:34:34.178248 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:34:34.178232 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-s66v6" Jul 31 21:35:03.235245 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:03.235217 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gh8tp" Jul 31 21:35:36.244946 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.244895 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk"] Jul 31 21:35:36.245439 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.245304 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e24229-3e55-4ea8-a302-e4252ec592cb" containerName="discovery" Jul 31 21:35:36.245439 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.245319 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e24229-3e55-4ea8-a302-e4252ec592cb" containerName="discovery" Jul 31 21:35:36.245439 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.245375 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e24229-3e55-4ea8-a302-e4252ec592cb" containerName="discovery" Jul 31 21:35:36.248427 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.248412 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:36.256642 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.256627 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 31 21:35:36.257133 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.257119 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 31 21:35:36.257978 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.257965 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zkvj5\"" Jul 31 21:35:36.276113 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.276080 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk"] Jul 31 21:35:36.344709 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.344674 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff55b002-c829-40fc-ae0f-b87d8d393236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" (UID: \"ff55b002-c829-40fc-ae0f-b87d8d393236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:36.344709 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.344722 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2x4k\" (UniqueName: \"kubernetes.io/projected/ff55b002-c829-40fc-ae0f-b87d8d393236-kube-api-access-j2x4k\") pod \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" (UID: \"ff55b002-c829-40fc-ae0f-b87d8d393236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:36.446065 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.446027 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff55b002-c829-40fc-ae0f-b87d8d393236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" (UID: \"ff55b002-c829-40fc-ae0f-b87d8d393236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:36.446239 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.446086 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2x4k\" (UniqueName: \"kubernetes.io/projected/ff55b002-c829-40fc-ae0f-b87d8d393236-kube-api-access-j2x4k\") pod \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" (UID: \"ff55b002-c829-40fc-ae0f-b87d8d393236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:36.446382 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.446362 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff55b002-c829-40fc-ae0f-b87d8d393236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" (UID: \"ff55b002-c829-40fc-ae0f-b87d8d393236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:36.460781 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.460744 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2x4k\" (UniqueName: \"kubernetes.io/projected/ff55b002-c829-40fc-ae0f-b87d8d393236-kube-api-access-j2x4k\") pod \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" (UID: \"ff55b002-c829-40fc-ae0f-b87d8d393236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:36.558591 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.558521 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:36.720492 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:36.720466 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk"] Jul 31 21:35:36.721492 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:35:36.721469 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff55b002_c829_40fc_ae0f_b87d8d393236.slice/crio-8ceeffe55d84aeaec0ee3181c134d079cc097656a1f1fd79f179ab40e5705ebd WatchSource:0}: Error finding container 8ceeffe55d84aeaec0ee3181c134d079cc097656a1f1fd79f179ab40e5705ebd: Status 404 returned error can't find the container with id 8ceeffe55d84aeaec0ee3181c134d079cc097656a1f1fd79f179ab40e5705ebd Jul 31 21:35:37.547163 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:37.547122 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" event={"ID":"ff55b002-c829-40fc-ae0f-b87d8d393236","Type":"ContainerStarted","Data":"8ceeffe55d84aeaec0ee3181c134d079cc097656a1f1fd79f179ab40e5705ebd"} Jul 31 21:35:38.602338 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:38.602303 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-mz8gv"] Jul 31 21:35:38.612971 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:38.612947 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-mz8gv" Jul 31 21:35:38.617099 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:38.616836 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4nkxs\"" Jul 31 21:35:38.621625 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:38.621561 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-mz8gv"] Jul 31 21:35:38.769526 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:38.768869 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hh6x\" (UniqueName: \"kubernetes.io/projected/cc25a677-b40a-45c3-97b6-b9967e482701-kube-api-access-4hh6x\") pod \"authorino-operator-68d88948d8-mz8gv\" (UID: \"cc25a677-b40a-45c3-97b6-b9967e482701\") " pod="kuadrant-system/authorino-operator-68d88948d8-mz8gv" Jul 31 21:35:38.870138 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:38.870051 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hh6x\" (UniqueName: \"kubernetes.io/projected/cc25a677-b40a-45c3-97b6-b9967e482701-kube-api-access-4hh6x\") pod \"authorino-operator-68d88948d8-mz8gv\" (UID: \"cc25a677-b40a-45c3-97b6-b9967e482701\") " pod="kuadrant-system/authorino-operator-68d88948d8-mz8gv" Jul 31 21:35:38.880941 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:38.880794 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hh6x\" (UniqueName: \"kubernetes.io/projected/cc25a677-b40a-45c3-97b6-b9967e482701-kube-api-access-4hh6x\") pod \"authorino-operator-68d88948d8-mz8gv\" (UID: \"cc25a677-b40a-45c3-97b6-b9967e482701\") " pod="kuadrant-system/authorino-operator-68d88948d8-mz8gv" Jul 31 21:35:38.929507 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:38.929466 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-mz8gv" Jul 31 21:35:39.077258 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:39.077228 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-mz8gv"] Jul 31 21:35:39.079193 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:35:39.079161 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc25a677_b40a_45c3_97b6_b9967e482701.slice/crio-0de2b55054c04d48a05104f65550998f1b27f3dda67b958f3f9094dd582808a8 WatchSource:0}: Error finding container 0de2b55054c04d48a05104f65550998f1b27f3dda67b958f3f9094dd582808a8: Status 404 returned error can't find the container with id 0de2b55054c04d48a05104f65550998f1b27f3dda67b958f3f9094dd582808a8 Jul 31 21:35:39.562467 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:39.562428 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-mz8gv" event={"ID":"cc25a677-b40a-45c3-97b6-b9967e482701","Type":"ContainerStarted","Data":"0de2b55054c04d48a05104f65550998f1b27f3dda67b958f3f9094dd582808a8"} Jul 31 21:35:40.580991 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:40.580963 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-9fb59"] Jul 31 21:35:40.585158 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:40.585135 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9fb59" Jul 31 21:35:40.585783 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:40.585754 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6jbd\" (UniqueName: \"kubernetes.io/projected/b084ff8f-dcd2-4cf9-bf34-75b5d036f0e3-kube-api-access-d6jbd\") pod \"dns-operator-controller-manager-5985564776-9fb59\" (UID: \"b084ff8f-dcd2-4cf9-bf34-75b5d036f0e3\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-9fb59" Jul 31 21:35:40.590718 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:40.590681 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 31 21:35:40.590837 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:40.590793 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zzdwk\"" Jul 31 21:35:40.602855 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:40.602828 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-9fb59"] Jul 31 21:35:40.686949 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:40.686889 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6jbd\" (UniqueName: \"kubernetes.io/projected/b084ff8f-dcd2-4cf9-bf34-75b5d036f0e3-kube-api-access-d6jbd\") pod \"dns-operator-controller-manager-5985564776-9fb59\" (UID: \"b084ff8f-dcd2-4cf9-bf34-75b5d036f0e3\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-9fb59" Jul 31 21:35:40.697458 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:40.697425 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6jbd\" (UniqueName: \"kubernetes.io/projected/b084ff8f-dcd2-4cf9-bf34-75b5d036f0e3-kube-api-access-d6jbd\") pod \"dns-operator-controller-manager-5985564776-9fb59\" (UID: \"b084ff8f-dcd2-4cf9-bf34-75b5d036f0e3\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-9fb59" Jul 31 21:35:40.897957 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:40.897846 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9fb59" Jul 31 21:35:41.377535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:41.377510 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:35:41.377960 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:41.377941 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:35:41.576107 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:41.576070 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" event={"ID":"ff55b002-c829-40fc-ae0f-b87d8d393236","Type":"ContainerStarted","Data":"f70c7facbc6bfc20a0c5784110a097f43f864e970685cdbf962d20a01470d7bf"} Jul 31 21:35:41.576274 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:41.576132 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:41.577656 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:41.577629 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-mz8gv" event={"ID":"cc25a677-b40a-45c3-97b6-b9967e482701","Type":"ContainerStarted","Data":"f27c0fc2b10c65308f71a38beb518a59f1d65acfbb6855ff48d243beed26ca48"} Jul 31 21:35:41.577768 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:41.577758 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-mz8gv" Jul 31 21:35:41.582504 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:41.582486 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-9fb59"] Jul 31 21:35:41.584166 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:35:41.584146 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb084ff8f_dcd2_4cf9_bf34_75b5d036f0e3.slice/crio-63e0e3f1aa928e337ede0ab6b4216c7299bb4b878b5c9852b7a7f8a05e146f7b WatchSource:0}: Error finding container 63e0e3f1aa928e337ede0ab6b4216c7299bb4b878b5c9852b7a7f8a05e146f7b: Status 404 returned error can't find the container with id 63e0e3f1aa928e337ede0ab6b4216c7299bb4b878b5c9852b7a7f8a05e146f7b Jul 31 21:35:41.603620 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:41.603572 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" podStartSLOduration=0.877283145 podStartE2EDuration="5.603559189s" totalImagesPullingTime="4.726276044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:35:41.600886785 +0000 UTC m=+601.835118823" watchObservedRunningTime="2026-07-31 21:35:41.603559189 +0000 UTC m=+601.837791228" Jul 31 21:35:41.620969 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:41.620926 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-mz8gv" podStartSLOduration=1.257873446 podStartE2EDuration="3.620897326s" totalImagesPullingTime="2.36302388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:35:41.620454597 +0000 UTC m=+601.854686636" watchObservedRunningTime="2026-07-31 21:35:41.620897326 +0000 UTC m=+601.855129364" Jul 31 21:35:42.586217 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:42.586174 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9fb59" event={"ID":"b084ff8f-dcd2-4cf9-bf34-75b5d036f0e3","Type":"ContainerStarted","Data":"63e0e3f1aa928e337ede0ab6b4216c7299bb4b878b5c9852b7a7f8a05e146f7b"} Jul 31 21:35:42.877109 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:42.877014 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l"] Jul 31 21:35:42.881156 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:42.881133 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:42.884205 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:42.884182 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-nljqd\"" Jul 31 21:35:42.893864 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:42.893834 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l"] Jul 31 21:35:42.905686 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:42.905657 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkdhz\" (UniqueName: \"kubernetes.io/projected/7d4f6f1d-877f-47f6-a56c-09e95edcc43f-kube-api-access-tkdhz\") pod \"limitador-operator-controller-manager-6c549b6d85-cc26l\" (UID: \"7d4f6f1d-877f-47f6-a56c-09e95edcc43f\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:43.006458 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:43.006417 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkdhz\" (UniqueName: \"kubernetes.io/projected/7d4f6f1d-877f-47f6-a56c-09e95edcc43f-kube-api-access-tkdhz\") pod \"limitador-operator-controller-manager-6c549b6d85-cc26l\" (UID: \"7d4f6f1d-877f-47f6-a56c-09e95edcc43f\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:43.016981 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:43.016951 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkdhz\" (UniqueName: \"kubernetes.io/projected/7d4f6f1d-877f-47f6-a56c-09e95edcc43f-kube-api-access-tkdhz\") pod \"limitador-operator-controller-manager-6c549b6d85-cc26l\" (UID: \"7d4f6f1d-877f-47f6-a56c-09e95edcc43f\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:43.194885 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:43.194804 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:43.332242 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:43.332204 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l"] Jul 31 21:35:43.334229 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:35:43.334201 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4f6f1d_877f_47f6_a56c_09e95edcc43f.slice/crio-fb3d1d81c8ff5481315ee84c79f4875dac393d9e75a20fd09d5574237d8d9a80 WatchSource:0}: Error finding container fb3d1d81c8ff5481315ee84c79f4875dac393d9e75a20fd09d5574237d8d9a80: Status 404 returned error can't find the container with id fb3d1d81c8ff5481315ee84c79f4875dac393d9e75a20fd09d5574237d8d9a80 Jul 31 21:35:43.592639 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:43.592609 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" event={"ID":"7d4f6f1d-877f-47f6-a56c-09e95edcc43f","Type":"ContainerStarted","Data":"fb3d1d81c8ff5481315ee84c79f4875dac393d9e75a20fd09d5574237d8d9a80"} Jul 31 21:35:43.594255 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:43.594228 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9fb59" event={"ID":"b084ff8f-dcd2-4cf9-bf34-75b5d036f0e3","Type":"ContainerStarted","Data":"a67e85458a01f1729db16185b7b3fe4ac6e8d75910e960ee48b38e4d8bd20635"} Jul 31 21:35:43.594369 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:43.594357 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9fb59" Jul 31 21:35:43.615631 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:43.615585 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9fb59" podStartSLOduration=2.144206629 podStartE2EDuration="3.615573125s" totalImagesPullingTime="1.471366496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:35:43.613143021 +0000 UTC m=+603.847375059" watchObservedRunningTime="2026-07-31 21:35:43.615573125 +0000 UTC m=+603.849805163" Jul 31 21:35:46.611242 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:46.611210 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" event={"ID":"7d4f6f1d-877f-47f6-a56c-09e95edcc43f","Type":"ContainerStarted","Data":"a8359df61e5902b2f617f2b47a65d5d920a7b5df1ae778486519b95208c8d7db"} Jul 31 21:35:46.611681 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:46.611315 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:52.588897 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:52.588862 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:52.589344 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:52.589040 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-mz8gv" Jul 31 21:35:52.619134 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:52.619082 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" podStartSLOduration=8.36249224 podStartE2EDuration="10.619066808s" totalImagesPullingTime="2.256574568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:35:46.639123785 +0000 UTC m=+606.873355824" watchObservedRunningTime="2026-07-31 21:35:52.619066808 +0000 UTC m=+612.853298846" Jul 31 21:35:54.442229 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.442191 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk"] Jul 31 21:35:54.442646 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.442381 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" containerName="manager" containerID="cri-o://f70c7facbc6bfc20a0c5784110a097f43f864e970685cdbf962d20a01470d7bf" gracePeriod=2 Jul 31 21:35:54.454896 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.454869 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk"] Jul 31 21:35:54.463019 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.462994 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l"] Jul 31 21:35:54.463247 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.463207 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" containerName="manager" containerID="cri-o://a8359df61e5902b2f617f2b47a65d5d920a7b5df1ae778486519b95208c8d7db" gracePeriod=2 Jul 31 21:35:54.465320 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.465286 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:54.465677 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.465655 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:54.482140 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.482111 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l"] Jul 31 21:35:54.486131 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.486109 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77"] Jul 31 21:35:54.486511 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.486496 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" containerName="manager" Jul 31 21:35:54.486511 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.486511 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" containerName="manager" Jul 31 21:35:54.486666 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.486524 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" containerName="manager" Jul 31 21:35:54.486666 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.486533 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" containerName="manager" Jul 31 21:35:54.486666 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.486643 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" containerName="manager" Jul 31 21:35:54.486666 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.486660 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" containerName="manager" Jul 31 21:35:54.489778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.489759 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:35:54.496399 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.496348 2548 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7d4f6f1d-877f-47f6-a56c-09e95edcc43f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-cc26l\": pods \"limitador-operator-controller-manager-6c549b6d85-cc26l\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:54.499216 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.499192 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t"] Jul 31 21:35:54.503248 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.503229 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t" Jul 31 21:35:54.511235 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.511207 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77"] Jul 31 21:35:54.519732 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.519383 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t"] Jul 31 21:35:54.537234 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.537194 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:54.539796 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.539765 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cc26l\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:54.563001 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.562962 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:54.567643 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.567601 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cc26l\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:54.604618 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.603483 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-9fb59" Jul 31 21:35:54.607861 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.607823 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:54.614241 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.614213 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-54p77\" (UID: \"74ae4a84-ecbf-4199-b78f-dec2ac64bc25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:35:54.614394 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.614281 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcm6v\" (UniqueName: \"kubernetes.io/projected/d4fecfa4-6d09-459a-a128-eca0d9567256-kube-api-access-wcm6v\") pod \"limitador-operator-controller-manager-6c549b6d85-rrz5t\" (UID: \"d4fecfa4-6d09-459a-a128-eca0d9567256\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t" Jul 31 21:35:54.614394 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.614296 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrtj6\" (UniqueName: \"kubernetes.io/projected/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-kube-api-access-mrtj6\") pod \"kuadrant-operator-controller-manager-58fc56757c-54p77\" (UID: \"74ae4a84-ecbf-4199-b78f-dec2ac64bc25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:35:54.637457 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.637415 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cc26l\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:54.665655 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.665599 2548 generic.go:356] "Generic (PLEG): container finished" podID="ff55b002-c829-40fc-ae0f-b87d8d393236" containerID="f70c7facbc6bfc20a0c5784110a097f43f864e970685cdbf962d20a01470d7bf" exitCode=0 Jul 31 21:35:54.667720 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.667666 2548 generic.go:356] "Generic (PLEG): container finished" podID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" containerID="a8359df61e5902b2f617f2b47a65d5d920a7b5df1ae778486519b95208c8d7db" exitCode=0 Jul 31 21:35:54.715000 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.714969 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcm6v\" (UniqueName: \"kubernetes.io/projected/d4fecfa4-6d09-459a-a128-eca0d9567256-kube-api-access-wcm6v\") pod \"limitador-operator-controller-manager-6c549b6d85-rrz5t\" (UID: \"d4fecfa4-6d09-459a-a128-eca0d9567256\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t" Jul 31 21:35:54.715142 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.715120 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrtj6\" (UniqueName: \"kubernetes.io/projected/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-kube-api-access-mrtj6\") pod \"kuadrant-operator-controller-manager-58fc56757c-54p77\" (UID: \"74ae4a84-ecbf-4199-b78f-dec2ac64bc25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:35:54.715322 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.715283 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-54p77\" (UID: \"74ae4a84-ecbf-4199-b78f-dec2ac64bc25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:35:54.715582 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.715564 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-54p77\" (UID: \"74ae4a84-ecbf-4199-b78f-dec2ac64bc25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:35:54.720725 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.720701 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:54.723633 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.723593 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:54.725060 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.725042 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:54.726033 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.726004 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cc26l\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:54.726640 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.726620 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrtj6\" (UniqueName: \"kubernetes.io/projected/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-kube-api-access-mrtj6\") pod \"kuadrant-operator-controller-manager-58fc56757c-54p77\" (UID: \"74ae4a84-ecbf-4199-b78f-dec2ac64bc25\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:35:54.727056 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.727039 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcm6v\" (UniqueName: \"kubernetes.io/projected/d4fecfa4-6d09-459a-a128-eca0d9567256-kube-api-access-wcm6v\") pod \"limitador-operator-controller-manager-6c549b6d85-rrz5t\" (UID: \"d4fecfa4-6d09-459a-a128-eca0d9567256\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t" Jul 31 21:35:54.728279 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.728258 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:54.730494 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:54.730473 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cc26l\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:54.816436 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.816407 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkdhz\" (UniqueName: \"kubernetes.io/projected/7d4f6f1d-877f-47f6-a56c-09e95edcc43f-kube-api-access-tkdhz\") pod \"7d4f6f1d-877f-47f6-a56c-09e95edcc43f\" (UID: \"7d4f6f1d-877f-47f6-a56c-09e95edcc43f\") " Jul 31 21:35:54.816598 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.816460 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff55b002-c829-40fc-ae0f-b87d8d393236-extensions-socket-volume\") pod \"ff55b002-c829-40fc-ae0f-b87d8d393236\" (UID: \"ff55b002-c829-40fc-ae0f-b87d8d393236\") " Jul 31 21:35:54.816663 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.816640 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2x4k\" (UniqueName: \"kubernetes.io/projected/ff55b002-c829-40fc-ae0f-b87d8d393236-kube-api-access-j2x4k\") pod \"ff55b002-c829-40fc-ae0f-b87d8d393236\" (UID: \"ff55b002-c829-40fc-ae0f-b87d8d393236\") " Jul 31 21:35:54.816965 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.816895 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff55b002-c829-40fc-ae0f-b87d8d393236-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ff55b002-c829-40fc-ae0f-b87d8d393236" (UID: "ff55b002-c829-40fc-ae0f-b87d8d393236"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:35:54.818716 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.818692 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff55b002-c829-40fc-ae0f-b87d8d393236-kube-api-access-j2x4k" (OuterVolumeSpecName: "kube-api-access-j2x4k") pod "ff55b002-c829-40fc-ae0f-b87d8d393236" (UID: "ff55b002-c829-40fc-ae0f-b87d8d393236"). InnerVolumeSpecName "kube-api-access-j2x4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:35:54.818794 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.818711 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d4f6f1d-877f-47f6-a56c-09e95edcc43f-kube-api-access-tkdhz" (OuterVolumeSpecName: "kube-api-access-tkdhz") pod "7d4f6f1d-877f-47f6-a56c-09e95edcc43f" (UID: "7d4f6f1d-877f-47f6-a56c-09e95edcc43f"). InnerVolumeSpecName "kube-api-access-tkdhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:35:54.877940 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.877876 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:35:54.885454 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.885433 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t" Jul 31 21:35:54.917892 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.917858 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff55b002-c829-40fc-ae0f-b87d8d393236-extensions-socket-volume\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:35:54.917892 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.917892 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2x4k\" (UniqueName: \"kubernetes.io/projected/ff55b002-c829-40fc-ae0f-b87d8d393236-kube-api-access-j2x4k\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:35:54.917892 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:54.917904 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkdhz\" (UniqueName: \"kubernetes.io/projected/7d4f6f1d-877f-47f6-a56c-09e95edcc43f-kube-api-access-tkdhz\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:35:55.077232 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.077204 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77"] Jul 31 21:35:55.079313 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:35:55.079273 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ae4a84_ecbf_4199_b78f_dec2ac64bc25.slice/crio-347b8283808cc5fb810c086137d578ce75caf64070f78c1fda5ba13e9714febd WatchSource:0}: Error finding container 347b8283808cc5fb810c086137d578ce75caf64070f78c1fda5ba13e9714febd: Status 404 returned error can't find the container with id 347b8283808cc5fb810c086137d578ce75caf64070f78c1fda5ba13e9714febd Jul 31 21:35:55.090426 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:35:55.090403 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4fecfa4_6d09_459a_a128_eca0d9567256.slice/crio-5b5f5c7365fb67301f31277fc978411ffa3417378f9930bd1704ad9aff2aa167 WatchSource:0}: Error finding container 5b5f5c7365fb67301f31277fc978411ffa3417378f9930bd1704ad9aff2aa167: Status 404 returned error can't find the container with id 5b5f5c7365fb67301f31277fc978411ffa3417378f9930bd1704ad9aff2aa167 Jul 31 21:35:55.096839 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.096820 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t"] Jul 31 21:35:55.673891 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.673853 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:55.674356 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.673899 2548 scope.go:117] "RemoveContainer" containerID="f70c7facbc6bfc20a0c5784110a097f43f864e970685cdbf962d20a01470d7bf" Jul 31 21:35:55.675747 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.675722 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:55.677469 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.677430 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t" event={"ID":"d4fecfa4-6d09-459a-a128-eca0d9567256","Type":"ContainerStarted","Data":"ac7b5a708db5ac51233bfa4d93d41a5ce58dc083953df7e3d4b47686f51e343f"} Jul 31 21:35:55.677585 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.677512 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t" Jul 31 21:35:55.677585 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.677540 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t" event={"ID":"d4fecfa4-6d09-459a-a128-eca0d9567256","Type":"ContainerStarted","Data":"5b5f5c7365fb67301f31277fc978411ffa3417378f9930bd1704ad9aff2aa167"} Jul 31 21:35:55.678588 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:55.678559 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:55.679358 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.679333 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" event={"ID":"74ae4a84-ecbf-4199-b78f-dec2ac64bc25","Type":"ContainerStarted","Data":"6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea"} Jul 31 21:35:55.679452 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.679380 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" event={"ID":"74ae4a84-ecbf-4199-b78f-dec2ac64bc25","Type":"ContainerStarted","Data":"347b8283808cc5fb810c086137d578ce75caf64070f78c1fda5ba13e9714febd"} Jul 31 21:35:55.679452 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.679405 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:35:55.680942 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:55.680900 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cc26l\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:55.683992 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.683888 2548 scope.go:117] "RemoveContainer" containerID="a8359df61e5902b2f617f2b47a65d5d920a7b5df1ae778486519b95208c8d7db" Jul 31 21:35:55.706889 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:55.706847 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:55.706889 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.706856 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t" podStartSLOduration=1.706842227 podStartE2EDuration="1.706842227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:35:55.703817332 +0000 UTC m=+615.938049370" watchObservedRunningTime="2026-07-31 21:35:55.706842227 +0000 UTC m=+615.941074265" Jul 31 21:35:55.710388 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:55.710367 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cc26l\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:55.739591 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.739478 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" podStartSLOduration=1.7394557609999999 podStartE2EDuration="1.739455761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:35:55.7367487 +0000 UTC m=+615.970980740" watchObservedRunningTime="2026-07-31 21:35:55.739455761 +0000 UTC m=+615.973687802" Jul 31 21:35:55.742041 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:55.742010 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cc26l\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:55.744244 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:55.744225 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:55.810119 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.810064 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9"] Jul 31 21:35:55.815117 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.815063 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:35:55.835368 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.835338 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9"] Jul 31 21:35:55.865356 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:55.865315 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-fkmtk\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fkmtk" Jul 31 21:35:55.868828 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:35:55.868805 2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cc26l\" is forbidden: User \"system:node:ip-10-0-135-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-32.ec2.internal' and this object" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cc26l" Jul 31 21:35:55.927436 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.927409 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txn9w\" (UniqueName: \"kubernetes.io/projected/ef568074-f1a4-4b5d-9b44-58749c9f01f5-kube-api-access-txn9w\") pod \"kuadrant-operator-controller-manager-68cf589589-v7wm9\" (UID: \"ef568074-f1a4-4b5d-9b44-58749c9f01f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:35:55.927584 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:55.927475 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef568074-f1a4-4b5d-9b44-58749c9f01f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-v7wm9\" (UID: \"ef568074-f1a4-4b5d-9b44-58749c9f01f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:35:56.028392 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.028306 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txn9w\" (UniqueName: \"kubernetes.io/projected/ef568074-f1a4-4b5d-9b44-58749c9f01f5-kube-api-access-txn9w\") pod \"kuadrant-operator-controller-manager-68cf589589-v7wm9\" (UID: \"ef568074-f1a4-4b5d-9b44-58749c9f01f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:35:56.028392 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.028366 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef568074-f1a4-4b5d-9b44-58749c9f01f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-v7wm9\" (UID: \"ef568074-f1a4-4b5d-9b44-58749c9f01f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:35:56.028703 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.028686 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef568074-f1a4-4b5d-9b44-58749c9f01f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-v7wm9\" (UID: \"ef568074-f1a4-4b5d-9b44-58749c9f01f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:35:56.043521 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.043491 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txn9w\" (UniqueName: \"kubernetes.io/projected/ef568074-f1a4-4b5d-9b44-58749c9f01f5-kube-api-access-txn9w\") pod \"kuadrant-operator-controller-manager-68cf589589-v7wm9\" (UID: \"ef568074-f1a4-4b5d-9b44-58749c9f01f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:35:56.128079 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.128050 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:35:56.176390 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.176356 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d4f6f1d-877f-47f6-a56c-09e95edcc43f" path="/var/lib/kubelet/pods/7d4f6f1d-877f-47f6-a56c-09e95edcc43f/volumes" Jul 31 21:35:56.176703 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.176690 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff55b002-c829-40fc-ae0f-b87d8d393236" path="/var/lib/kubelet/pods/ff55b002-c829-40fc-ae0f-b87d8d393236/volumes" Jul 31 21:35:56.276145 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.276124 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9"] Jul 31 21:35:56.278488 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:35:56.278428 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef568074_f1a4_4b5d_9b44_58749c9f01f5.slice/crio-2ae6020a46af230134a4bbd8d292f559b683052ee96319bcfb6fff18419b84bf WatchSource:0}: Error finding container 2ae6020a46af230134a4bbd8d292f559b683052ee96319bcfb6fff18419b84bf: Status 404 returned error can't find the container with id 2ae6020a46af230134a4bbd8d292f559b683052ee96319bcfb6fff18419b84bf Jul 31 21:35:56.693345 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.693314 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" event={"ID":"ef568074-f1a4-4b5d-9b44-58749c9f01f5","Type":"ContainerStarted","Data":"7cb32e7d3bc024b82bdba5a57d55bf67a5d0b516948f85ec080999ba02eaaee6"} Jul 31 21:35:56.693766 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.693397 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" event={"ID":"ef568074-f1a4-4b5d-9b44-58749c9f01f5","Type":"ContainerStarted","Data":"2ae6020a46af230134a4bbd8d292f559b683052ee96319bcfb6fff18419b84bf"} Jul 31 21:35:56.693766 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.693513 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:35:56.727412 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:35:56.727362 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" podStartSLOduration=1.727346426 podStartE2EDuration="1.727346426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:35:56.725163982 +0000 UTC m=+616.959396020" watchObservedRunningTime="2026-07-31 21:35:56.727346426 +0000 UTC m=+616.961578469" Jul 31 21:36:06.697284 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:06.697195 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-rrz5t" Jul 31 21:36:06.697675 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:06.697347 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:36:07.703265 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:07.703238 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:36:07.790590 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:07.790560 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77"] Jul 31 21:36:07.790785 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:07.790759 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" podUID="74ae4a84-ecbf-4199-b78f-dec2ac64bc25" containerName="manager" containerID="cri-o://6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea" gracePeriod=10 Jul 31 21:36:08.084803 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.084779 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:36:08.136400 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.136370 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-extensions-socket-volume\") pod \"74ae4a84-ecbf-4199-b78f-dec2ac64bc25\" (UID: \"74ae4a84-ecbf-4199-b78f-dec2ac64bc25\") " Jul 31 21:36:08.136526 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.136503 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrtj6\" (UniqueName: \"kubernetes.io/projected/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-kube-api-access-mrtj6\") pod \"74ae4a84-ecbf-4199-b78f-dec2ac64bc25\" (UID: \"74ae4a84-ecbf-4199-b78f-dec2ac64bc25\") " Jul 31 21:36:08.136751 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.136725 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "74ae4a84-ecbf-4199-b78f-dec2ac64bc25" (UID: "74ae4a84-ecbf-4199-b78f-dec2ac64bc25"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:36:08.138628 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.138599 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-kube-api-access-mrtj6" (OuterVolumeSpecName: "kube-api-access-mrtj6") pod "74ae4a84-ecbf-4199-b78f-dec2ac64bc25" (UID: "74ae4a84-ecbf-4199-b78f-dec2ac64bc25"). InnerVolumeSpecName "kube-api-access-mrtj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:36:08.238013 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.237937 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-extensions-socket-volume\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:36:08.238013 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.237968 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrtj6\" (UniqueName: \"kubernetes.io/projected/74ae4a84-ecbf-4199-b78f-dec2ac64bc25-kube-api-access-mrtj6\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:36:08.759332 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.759302 2548 generic.go:356] "Generic (PLEG): container finished" podID="74ae4a84-ecbf-4199-b78f-dec2ac64bc25" containerID="6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea" exitCode=0 Jul 31 21:36:08.759749 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.759361 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" Jul 31 21:36:08.759749 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.759399 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" event={"ID":"74ae4a84-ecbf-4199-b78f-dec2ac64bc25","Type":"ContainerDied","Data":"6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea"} Jul 31 21:36:08.759749 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.759453 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77" event={"ID":"74ae4a84-ecbf-4199-b78f-dec2ac64bc25","Type":"ContainerDied","Data":"347b8283808cc5fb810c086137d578ce75caf64070f78c1fda5ba13e9714febd"} Jul 31 21:36:08.759749 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.759477 2548 scope.go:117] "RemoveContainer" containerID="6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea" Jul 31 21:36:08.768066 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.768052 2548 scope.go:117] "RemoveContainer" containerID="6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea" Jul 31 21:36:08.768303 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:36:08.768287 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea\": container with ID starting with 6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea not found: ID does not exist" containerID="6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea" Jul 31 21:36:08.768351 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.768312 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea"} err="failed to get container status \"6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea\": rpc error: code = NotFound desc = could not find container \"6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea\": container with ID starting with 6c429d3db98c952b0f91ead7966dd6d0ae58f76fec24b4b2d11a2614c951c0ea not found: ID does not exist" Jul 31 21:36:08.782975 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.782950 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77"] Jul 31 21:36:08.798110 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:08.798087 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54p77"] Jul 31 21:36:10.175773 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:10.175740 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74ae4a84-ecbf-4199-b78f-dec2ac64bc25" path="/var/lib/kubelet/pods/74ae4a84-ecbf-4199-b78f-dec2ac64bc25/volumes" Jul 31 21:36:24.230660 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.230625 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp"] Jul 31 21:36:24.231277 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.231251 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ae4a84-ecbf-4199-b78f-dec2ac64bc25" containerName="manager" Jul 31 21:36:24.231432 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.231276 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ae4a84-ecbf-4199-b78f-dec2ac64bc25" containerName="manager" Jul 31 21:36:24.231432 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.231395 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ae4a84-ecbf-4199-b78f-dec2ac64bc25" containerName="manager" Jul 31 21:36:24.235798 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.235778 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.238678 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.238652 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2h6bh\"" Jul 31 21:36:24.249800 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.249776 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp"] Jul 31 21:36:24.393221 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.393187 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wvjv\" (UniqueName: \"kubernetes.io/projected/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-kube-api-access-2wvjv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.393401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.393245 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.393401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.393314 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.393401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.393351 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.393401 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.393387 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.393537 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.393413 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.393537 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.393438 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.393537 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.393477 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.393537 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.393511 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494292 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494213 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494292 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494247 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494292 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494289 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494320 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494353 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wvjv\" (UniqueName: \"kubernetes.io/projected/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-kube-api-access-2wvjv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494410 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494447 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494483 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494536 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494848 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494665 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494931 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494874 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494993 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494903 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.494993 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.494982 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.495174 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.495146 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.496699 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.496680 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.497062 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.497040 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.502865 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.502838 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.502988 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.502929 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wvjv\" (UniqueName: \"kubernetes.io/projected/6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152-kube-api-access-2wvjv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6mzmp\" (UID: \"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.545821 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.545785 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:24.691962 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.691928 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp"] Jul 31 21:36:24.692379 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:36:24.692358 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fc8c5ae_cae3_46d7_8f2b_e6a1257ad152.slice/crio-1054a123138471b1b9beea76a8b6e089b0ad5733cd5dc8457885aa80aad25d0c WatchSource:0}: Error finding container 1054a123138471b1b9beea76a8b6e089b0ad5733cd5dc8457885aa80aad25d0c: Status 404 returned error can't find the container with id 1054a123138471b1b9beea76a8b6e089b0ad5733cd5dc8457885aa80aad25d0c Jul 31 21:36:24.694571 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.694545 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 31 21:36:24.694638 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.694607 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 31 21:36:24.694638 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.694634 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 31 21:36:24.850294 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.850259 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" event={"ID":"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152","Type":"ContainerStarted","Data":"cd89adc8b2a298e2053d68fc2c6de4eb8ffa2ced7ab79643901769e1878ad719"} Jul 31 21:36:24.850458 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.850322 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" event={"ID":"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152","Type":"ContainerStarted","Data":"1054a123138471b1b9beea76a8b6e089b0ad5733cd5dc8457885aa80aad25d0c"} Jul 31 21:36:24.873422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:24.873365 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" podStartSLOduration=0.873347953 podStartE2EDuration="873.347953ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:24.872298756 +0000 UTC m=+645.106530814" watchObservedRunningTime="2026-07-31 21:36:24.873347953 +0000 UTC m=+645.107579990" Jul 31 21:36:25.546778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:25.546743 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:25.551756 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:25.551730 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:25.863411 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:25.863374 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:25.864305 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:25.864284 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:36:25.976838 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:25.976805 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-x54fl"] Jul 31 21:36:25.980552 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:25.980533 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:25.983380 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:25.983361 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 31 21:36:25.983463 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:25.983445 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jbxq9\"" Jul 31 21:36:25.992302 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:25.992279 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-x54fl"] Jul 31 21:36:26.081937 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:26.080687 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-x54fl"] Jul 31 21:36:26.109407 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:26.109376 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bebe6941-0dba-4a33-bf02-06f50fc7df01-config-file\") pod \"limitador-limitador-859c4d96d6-x54fl\" (UID: \"bebe6941-0dba-4a33-bf02-06f50fc7df01\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:26.109564 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:26.109414 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w856\" (UniqueName: \"kubernetes.io/projected/bebe6941-0dba-4a33-bf02-06f50fc7df01-kube-api-access-6w856\") pod \"limitador-limitador-859c4d96d6-x54fl\" (UID: \"bebe6941-0dba-4a33-bf02-06f50fc7df01\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:26.210163 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:26.210082 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bebe6941-0dba-4a33-bf02-06f50fc7df01-config-file\") pod \"limitador-limitador-859c4d96d6-x54fl\" (UID: \"bebe6941-0dba-4a33-bf02-06f50fc7df01\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:26.210163 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:26.210117 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w856\" (UniqueName: \"kubernetes.io/projected/bebe6941-0dba-4a33-bf02-06f50fc7df01-kube-api-access-6w856\") pod \"limitador-limitador-859c4d96d6-x54fl\" (UID: \"bebe6941-0dba-4a33-bf02-06f50fc7df01\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:26.210754 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:26.210734 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bebe6941-0dba-4a33-bf02-06f50fc7df01-config-file\") pod \"limitador-limitador-859c4d96d6-x54fl\" (UID: \"bebe6941-0dba-4a33-bf02-06f50fc7df01\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:26.218965 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:26.218937 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w856\" (UniqueName: \"kubernetes.io/projected/bebe6941-0dba-4a33-bf02-06f50fc7df01-kube-api-access-6w856\") pod \"limitador-limitador-859c4d96d6-x54fl\" (UID: \"bebe6941-0dba-4a33-bf02-06f50fc7df01\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:26.292503 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:26.292470 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:26.436720 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:26.436640 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-x54fl"] Jul 31 21:36:26.438932 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:36:26.438894 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbebe6941_0dba_4a33_bf02_06f50fc7df01.slice/crio-f117ec2249a4e17726dd2e1244fc5c13e6cbc172fabb212247e9a7eb70a79c8f WatchSource:0}: Error finding container f117ec2249a4e17726dd2e1244fc5c13e6cbc172fabb212247e9a7eb70a79c8f: Status 404 returned error can't find the container with id f117ec2249a4e17726dd2e1244fc5c13e6cbc172fabb212247e9a7eb70a79c8f Jul 31 21:36:26.873128 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:26.873086 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" event={"ID":"bebe6941-0dba-4a33-bf02-06f50fc7df01","Type":"ContainerStarted","Data":"f117ec2249a4e17726dd2e1244fc5c13e6cbc172fabb212247e9a7eb70a79c8f"} Jul 31 21:36:28.886160 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:28.886129 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" event={"ID":"bebe6941-0dba-4a33-bf02-06f50fc7df01","Type":"ContainerStarted","Data":"42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883"} Jul 31 21:36:28.886566 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:28.886192 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:28.906282 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:28.906229 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" podStartSLOduration=2.520966232 podStartE2EDuration="3.906214422s" totalImagesPullingTime="1.38524819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:28.904699366 +0000 UTC m=+649.138931406" watchObservedRunningTime="2026-07-31 21:36:28.906214422 +0000 UTC m=+649.140446461" Jul 31 21:36:39.892638 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:39.892606 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:40.926055 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:40.926019 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-x54fl"] Jul 31 21:36:40.926636 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:40.926254 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" podUID="bebe6941-0dba-4a33-bf02-06f50fc7df01" containerName="limitador" containerID="cri-o://42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883" gracePeriod=30 Jul 31 21:36:41.481194 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.481174 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:41.555672 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.555576 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bebe6941-0dba-4a33-bf02-06f50fc7df01-config-file\") pod \"bebe6941-0dba-4a33-bf02-06f50fc7df01\" (UID: \"bebe6941-0dba-4a33-bf02-06f50fc7df01\") " Jul 31 21:36:41.555672 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.555659 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w856\" (UniqueName: \"kubernetes.io/projected/bebe6941-0dba-4a33-bf02-06f50fc7df01-kube-api-access-6w856\") pod \"bebe6941-0dba-4a33-bf02-06f50fc7df01\" (UID: \"bebe6941-0dba-4a33-bf02-06f50fc7df01\") " Jul 31 21:36:41.556055 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.556028 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bebe6941-0dba-4a33-bf02-06f50fc7df01-config-file" (OuterVolumeSpecName: "config-file") pod "bebe6941-0dba-4a33-bf02-06f50fc7df01" (UID: "bebe6941-0dba-4a33-bf02-06f50fc7df01"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:36:41.557881 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.557855 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bebe6941-0dba-4a33-bf02-06f50fc7df01-kube-api-access-6w856" (OuterVolumeSpecName: "kube-api-access-6w856") pod "bebe6941-0dba-4a33-bf02-06f50fc7df01" (UID: "bebe6941-0dba-4a33-bf02-06f50fc7df01"). InnerVolumeSpecName "kube-api-access-6w856". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:36:41.657308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.657275 2548 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bebe6941-0dba-4a33-bf02-06f50fc7df01-config-file\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:36:41.657308 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.657306 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w856\" (UniqueName: \"kubernetes.io/projected/bebe6941-0dba-4a33-bf02-06f50fc7df01-kube-api-access-6w856\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:36:41.953552 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.953510 2548 generic.go:356] "Generic (PLEG): container finished" podID="bebe6941-0dba-4a33-bf02-06f50fc7df01" containerID="42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883" exitCode=0 Jul 31 21:36:41.954004 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.953563 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" Jul 31 21:36:41.954004 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.953598 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" event={"ID":"bebe6941-0dba-4a33-bf02-06f50fc7df01","Type":"ContainerDied","Data":"42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883"} Jul 31 21:36:41.954004 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.953672 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-x54fl" event={"ID":"bebe6941-0dba-4a33-bf02-06f50fc7df01","Type":"ContainerDied","Data":"f117ec2249a4e17726dd2e1244fc5c13e6cbc172fabb212247e9a7eb70a79c8f"} Jul 31 21:36:41.954004 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.953694 2548 scope.go:117] "RemoveContainer" containerID="42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883" Jul 31 21:36:41.963105 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.963088 2548 scope.go:117] "RemoveContainer" containerID="42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883" Jul 31 21:36:41.963338 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:36:41.963322 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883\": container with ID starting with 42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883 not found: ID does not exist" containerID="42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883" Jul 31 21:36:41.963383 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.963348 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883"} err="failed to get container status \"42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883\": rpc error: code = NotFound desc = could not find container \"42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883\": container with ID starting with 42331d355aa7e5039919b18cbc4a9a90a019d7165dde039422b577574c071883 not found: ID does not exist" Jul 31 21:36:41.979059 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.979038 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-x54fl"] Jul 31 21:36:41.982507 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:41.982477 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-x54fl"] Jul 31 21:36:42.175618 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:42.175581 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bebe6941-0dba-4a33-bf02-06f50fc7df01" path="/var/lib/kubelet/pods/bebe6941-0dba-4a33-bf02-06f50fc7df01/volumes" Jul 31 21:36:47.505333 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.505295 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2"] Jul 31 21:36:47.505963 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.505946 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bebe6941-0dba-4a33-bf02-06f50fc7df01" containerName="limitador" Jul 31 21:36:47.506019 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.505966 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="bebe6941-0dba-4a33-bf02-06f50fc7df01" containerName="limitador" Jul 31 21:36:47.506065 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.506055 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="bebe6941-0dba-4a33-bf02-06f50fc7df01" containerName="limitador" Jul 31 21:36:47.511134 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.511111 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" Jul 31 21:36:47.516648 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.516626 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 31 21:36:47.517127 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.517110 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zqq8d\"" Jul 31 21:36:47.518398 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.518380 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 31 21:36:47.521595 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.521576 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 31 21:36:47.527965 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.527946 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2"] Jul 31 21:36:47.612929 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.612880 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aee983bc-f547-474f-86ab-b31190dbf6fe-data\") pod \"postgres-69fb4594cf-gpkq2\" (UID: \"aee983bc-f547-474f-86ab-b31190dbf6fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" Jul 31 21:36:47.613123 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.613041 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl7dt\" (UniqueName: \"kubernetes.io/projected/aee983bc-f547-474f-86ab-b31190dbf6fe-kube-api-access-wl7dt\") pod \"postgres-69fb4594cf-gpkq2\" (UID: \"aee983bc-f547-474f-86ab-b31190dbf6fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" Jul 31 21:36:47.714341 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.714296 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl7dt\" (UniqueName: \"kubernetes.io/projected/aee983bc-f547-474f-86ab-b31190dbf6fe-kube-api-access-wl7dt\") pod \"postgres-69fb4594cf-gpkq2\" (UID: \"aee983bc-f547-474f-86ab-b31190dbf6fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" Jul 31 21:36:47.714531 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.714365 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aee983bc-f547-474f-86ab-b31190dbf6fe-data\") pod \"postgres-69fb4594cf-gpkq2\" (UID: \"aee983bc-f547-474f-86ab-b31190dbf6fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" Jul 31 21:36:47.714692 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.714677 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aee983bc-f547-474f-86ab-b31190dbf6fe-data\") pod \"postgres-69fb4594cf-gpkq2\" (UID: \"aee983bc-f547-474f-86ab-b31190dbf6fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" Jul 31 21:36:47.723892 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.723864 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl7dt\" (UniqueName: \"kubernetes.io/projected/aee983bc-f547-474f-86ab-b31190dbf6fe-kube-api-access-wl7dt\") pod \"postgres-69fb4594cf-gpkq2\" (UID: \"aee983bc-f547-474f-86ab-b31190dbf6fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" Jul 31 21:36:47.823205 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.823177 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" Jul 31 21:36:47.960618 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.960594 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2"] Jul 31 21:36:47.962594 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:36:47.962552 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee983bc_f547_474f_86ab_b31190dbf6fe.slice/crio-23869b316ef9ebb13f3ca0280021df180b0981a5ad9ae59d35490489eaebd827 WatchSource:0}: Error finding container 23869b316ef9ebb13f3ca0280021df180b0981a5ad9ae59d35490489eaebd827: Status 404 returned error can't find the container with id 23869b316ef9ebb13f3ca0280021df180b0981a5ad9ae59d35490489eaebd827 Jul 31 21:36:47.986007 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:47.985972 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" event={"ID":"aee983bc-f547-474f-86ab-b31190dbf6fe","Type":"ContainerStarted","Data":"23869b316ef9ebb13f3ca0280021df180b0981a5ad9ae59d35490489eaebd827"} Jul 31 21:36:53.023757 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:53.023669 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" event={"ID":"aee983bc-f547-474f-86ab-b31190dbf6fe","Type":"ContainerStarted","Data":"37e97db4fde6a862ba28cbed4842ca5781ff4357b2e758b62b6779f6054b0c97"} Jul 31 21:36:53.024142 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:53.023768 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" Jul 31 21:36:53.042581 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:53.042528 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" podStartSLOduration=1.392200089 podStartE2EDuration="6.042508879s" totalImagesPullingTime="4.65030879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:53.041593602 +0000 UTC m=+673.275825643" watchObservedRunningTime="2026-07-31 21:36:53.042508879 +0000 UTC m=+673.276740919" Jul 31 21:36:59.058470 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:36:59.058440 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gpkq2" Jul 31 21:37:06.283358 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.283317 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85dff98fcb-n7nkw"] Jul 31 21:37:06.286852 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.286835 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:06.289782 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.289762 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 31 21:37:06.290432 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.290413 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 31 21:37:06.291304 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.291287 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6jm5p\"" Jul 31 21:37:06.305844 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.305822 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85dff98fcb-n7nkw"] Jul 31 21:37:06.394267 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.394234 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d6f84dc-7932-426a-b5d9-20323459eac5-webhook-cert\") pod \"maas-controller-85dff98fcb-n7nkw\" (UID: \"3d6f84dc-7932-426a-b5d9-20323459eac5\") " pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:06.394448 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.394340 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdjml\" (UniqueName: \"kubernetes.io/projected/3d6f84dc-7932-426a-b5d9-20323459eac5-kube-api-access-gdjml\") pod \"maas-controller-85dff98fcb-n7nkw\" (UID: \"3d6f84dc-7932-426a-b5d9-20323459eac5\") " pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:06.458376 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.458345 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d6d84bc6c-rqv7k"] Jul 31 21:37:06.461995 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.461976 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:37:06.472013 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.471986 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d6d84bc6c-rqv7k"] Jul 31 21:37:06.495077 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.495050 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjml\" (UniqueName: \"kubernetes.io/projected/3d6f84dc-7932-426a-b5d9-20323459eac5-kube-api-access-gdjml\") pod \"maas-controller-85dff98fcb-n7nkw\" (UID: \"3d6f84dc-7932-426a-b5d9-20323459eac5\") " pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:06.495248 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.495122 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d6f84dc-7932-426a-b5d9-20323459eac5-webhook-cert\") pod \"maas-controller-85dff98fcb-n7nkw\" (UID: \"3d6f84dc-7932-426a-b5d9-20323459eac5\") " pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:06.497644 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.497621 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d6f84dc-7932-426a-b5d9-20323459eac5-webhook-cert\") pod \"maas-controller-85dff98fcb-n7nkw\" (UID: \"3d6f84dc-7932-426a-b5d9-20323459eac5\") " pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:06.503894 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.503875 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdjml\" (UniqueName: \"kubernetes.io/projected/3d6f84dc-7932-426a-b5d9-20323459eac5-kube-api-access-gdjml\") pod \"maas-controller-85dff98fcb-n7nkw\" (UID: \"3d6f84dc-7932-426a-b5d9-20323459eac5\") " pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:06.596072 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.596041 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/185c7517-b692-4d98-9376-7f482772735f-webhook-cert\") pod \"maas-controller-d6d84bc6c-rqv7k\" (UID: \"185c7517-b692-4d98-9376-7f482772735f\") " pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:37:06.596258 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.596117 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2697n\" (UniqueName: \"kubernetes.io/projected/185c7517-b692-4d98-9376-7f482772735f-kube-api-access-2697n\") pod \"maas-controller-d6d84bc6c-rqv7k\" (UID: \"185c7517-b692-4d98-9376-7f482772735f\") " pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:37:06.596779 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.596761 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:06.697091 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.697059 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2697n\" (UniqueName: \"kubernetes.io/projected/185c7517-b692-4d98-9376-7f482772735f-kube-api-access-2697n\") pod \"maas-controller-d6d84bc6c-rqv7k\" (UID: \"185c7517-b692-4d98-9376-7f482772735f\") " pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:37:06.697262 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.697146 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/185c7517-b692-4d98-9376-7f482772735f-webhook-cert\") pod \"maas-controller-d6d84bc6c-rqv7k\" (UID: \"185c7517-b692-4d98-9376-7f482772735f\") " pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:37:06.700016 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.699989 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/185c7517-b692-4d98-9376-7f482772735f-webhook-cert\") pod \"maas-controller-d6d84bc6c-rqv7k\" (UID: \"185c7517-b692-4d98-9376-7f482772735f\") " pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:37:06.706689 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.706662 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2697n\" (UniqueName: \"kubernetes.io/projected/185c7517-b692-4d98-9376-7f482772735f-kube-api-access-2697n\") pod \"maas-controller-d6d84bc6c-rqv7k\" (UID: \"185c7517-b692-4d98-9376-7f482772735f\") " pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:37:06.736577 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.736552 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85dff98fcb-n7nkw"] Jul 31 21:37:06.738430 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:37:06.738402 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6f84dc_7932_426a_b5d9_20323459eac5.slice/crio-247541ec91948098153b3e6678a34bf86b0d2a0881d5d265e300091db646b542 WatchSource:0}: Error finding container 247541ec91948098153b3e6678a34bf86b0d2a0881d5d265e300091db646b542: Status 404 returned error can't find the container with id 247541ec91948098153b3e6678a34bf86b0d2a0881d5d265e300091db646b542 Jul 31 21:37:06.740042 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.740024 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 21:37:06.772809 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.772773 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:37:06.903986 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:06.903960 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d6d84bc6c-rqv7k"] Jul 31 21:37:06.905671 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:37:06.905648 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185c7517_b692_4d98_9376_7f482772735f.slice/crio-8478a2130818757baea54cae475fddd4834214f0435ee0ba05804ffeebf6b279 WatchSource:0}: Error finding container 8478a2130818757baea54cae475fddd4834214f0435ee0ba05804ffeebf6b279: Status 404 returned error can't find the container with id 8478a2130818757baea54cae475fddd4834214f0435ee0ba05804ffeebf6b279 Jul 31 21:37:07.096510 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:07.096468 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" event={"ID":"185c7517-b692-4d98-9376-7f482772735f","Type":"ContainerStarted","Data":"8478a2130818757baea54cae475fddd4834214f0435ee0ba05804ffeebf6b279"} Jul 31 21:37:07.097583 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:07.097562 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" event={"ID":"3d6f84dc-7932-426a-b5d9-20323459eac5","Type":"ContainerStarted","Data":"247541ec91948098153b3e6678a34bf86b0d2a0881d5d265e300091db646b542"} Jul 31 21:37:09.110314 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:09.110278 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" event={"ID":"185c7517-b692-4d98-9376-7f482772735f","Type":"ContainerStarted","Data":"93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25"} Jul 31 21:37:09.110812 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:09.110344 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:37:09.111970 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:09.111935 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" event={"ID":"3d6f84dc-7932-426a-b5d9-20323459eac5","Type":"ContainerStarted","Data":"0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773"} Jul 31 21:37:09.112078 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:09.112015 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:09.129235 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:09.129187 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" podStartSLOduration=1.676810661 podStartE2EDuration="3.129172954s" totalImagesPullingTime="1.452362293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:09.12834046 +0000 UTC m=+689.362572499" watchObservedRunningTime="2026-07-31 21:37:09.129172954 +0000 UTC m=+689.363404993" Jul 31 21:37:09.147784 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:09.147727 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" podStartSLOduration=1.531634871 podStartE2EDuration="3.147703924s" totalImagesPullingTime="1.616069053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:09.14543378 +0000 UTC m=+689.379665843" watchObservedRunningTime="2026-07-31 21:37:09.147703924 +0000 UTC m=+689.381935965" Jul 31 21:37:20.119640 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:20.119611 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:37:20.120109 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:20.119740 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:20.167231 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:20.167200 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85dff98fcb-n7nkw"] Jul 31 21:37:20.173356 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:20.173079 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" podUID="3d6f84dc-7932-426a-b5d9-20323459eac5" containerName="manager" containerID="cri-o://0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773" gracePeriod=30 Jul 31 21:37:20.426858 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:20.426835 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:20.527704 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:20.527675 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdjml\" (UniqueName: \"kubernetes.io/projected/3d6f84dc-7932-426a-b5d9-20323459eac5-kube-api-access-gdjml\") pod \"3d6f84dc-7932-426a-b5d9-20323459eac5\" (UID: \"3d6f84dc-7932-426a-b5d9-20323459eac5\") " Jul 31 21:37:20.527883 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:20.527732 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d6f84dc-7932-426a-b5d9-20323459eac5-webhook-cert\") pod \"3d6f84dc-7932-426a-b5d9-20323459eac5\" (UID: \"3d6f84dc-7932-426a-b5d9-20323459eac5\") " Jul 31 21:37:20.530023 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:20.530000 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d6f84dc-7932-426a-b5d9-20323459eac5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3d6f84dc-7932-426a-b5d9-20323459eac5" (UID: "3d6f84dc-7932-426a-b5d9-20323459eac5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:37:20.530112 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:20.530039 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d6f84dc-7932-426a-b5d9-20323459eac5-kube-api-access-gdjml" (OuterVolumeSpecName: "kube-api-access-gdjml") pod "3d6f84dc-7932-426a-b5d9-20323459eac5" (UID: "3d6f84dc-7932-426a-b5d9-20323459eac5"). InnerVolumeSpecName "kube-api-access-gdjml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:37:20.628686 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:20.628655 2548 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d6f84dc-7932-426a-b5d9-20323459eac5-webhook-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:37:20.628686 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:20.628680 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdjml\" (UniqueName: \"kubernetes.io/projected/3d6f84dc-7932-426a-b5d9-20323459eac5-kube-api-access-gdjml\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:37:21.176068 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:21.176035 2548 generic.go:356] "Generic (PLEG): container finished" podID="3d6f84dc-7932-426a-b5d9-20323459eac5" containerID="0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773" exitCode=0 Jul 31 21:37:21.176428 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:21.176077 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" Jul 31 21:37:21.176428 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:21.176125 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" event={"ID":"3d6f84dc-7932-426a-b5d9-20323459eac5","Type":"ContainerDied","Data":"0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773"} Jul 31 21:37:21.176428 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:21.176178 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85dff98fcb-n7nkw" event={"ID":"3d6f84dc-7932-426a-b5d9-20323459eac5","Type":"ContainerDied","Data":"247541ec91948098153b3e6678a34bf86b0d2a0881d5d265e300091db646b542"} Jul 31 21:37:21.176428 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:21.176200 2548 scope.go:117] "RemoveContainer" containerID="0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773" Jul 31 21:37:21.185491 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:21.185474 2548 scope.go:117] "RemoveContainer" containerID="0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773" Jul 31 21:37:21.185770 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:37:21.185752 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773\": container with ID starting with 0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773 not found: ID does not exist" containerID="0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773" Jul 31 21:37:21.185839 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:21.185779 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773"} err="failed to get container status \"0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773\": rpc error: code = NotFound desc = could not find container \"0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773\": container with ID starting with 0bcb2d2e780161bdd640b7499662768bb8cedd3fd85cadba39973d06cdf7b773 not found: ID does not exist" Jul 31 21:37:21.198358 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:21.198330 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85dff98fcb-n7nkw"] Jul 31 21:37:21.203990 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:21.203967 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85dff98fcb-n7nkw"] Jul 31 21:37:22.175335 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:22.175302 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d6f84dc-7932-426a-b5d9-20323459eac5" path="/var/lib/kubelet/pods/3d6f84dc-7932-426a-b5d9-20323459eac5/volumes" Jul 31 21:37:41.579139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.579105 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-c4944758f-n5fmp"] Jul 31 21:37:41.579604 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.579590 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6f84dc-7932-426a-b5d9-20323459eac5" containerName="manager" Jul 31 21:37:41.579654 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.579608 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6f84dc-7932-426a-b5d9-20323459eac5" containerName="manager" Jul 31 21:37:41.579689 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.579683 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d6f84dc-7932-426a-b5d9-20323459eac5" containerName="manager" Jul 31 21:37:41.584193 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.584175 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:41.587202 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.587182 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-524n8\"" Jul 31 21:37:41.587320 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.587219 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 31 21:37:41.593084 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.593062 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c4944758f-n5fmp"] Jul 31 21:37:41.733642 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.733608 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnb7x\" (UniqueName: \"kubernetes.io/projected/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-kube-api-access-qnb7x\") pod \"maas-api-c4944758f-n5fmp\" (UID: \"1a496ba5-0461-4eff-b8d9-20a3a8ca8109\") " pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:41.733642 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.733645 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-maas-api-tls\") pod \"maas-api-c4944758f-n5fmp\" (UID: \"1a496ba5-0461-4eff-b8d9-20a3a8ca8109\") " pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:41.733868 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.733669 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-openshift-service-ca\") pod \"maas-api-c4944758f-n5fmp\" (UID: \"1a496ba5-0461-4eff-b8d9-20a3a8ca8109\") " pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:41.834478 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.834404 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnb7x\" (UniqueName: \"kubernetes.io/projected/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-kube-api-access-qnb7x\") pod \"maas-api-c4944758f-n5fmp\" (UID: \"1a496ba5-0461-4eff-b8d9-20a3a8ca8109\") " pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:41.834478 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.834449 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-maas-api-tls\") pod \"maas-api-c4944758f-n5fmp\" (UID: \"1a496ba5-0461-4eff-b8d9-20a3a8ca8109\") " pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:41.834677 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:37:41.834540 2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 31 21:37:41.834677 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.834562 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-openshift-service-ca\") pod \"maas-api-c4944758f-n5fmp\" (UID: \"1a496ba5-0461-4eff-b8d9-20a3a8ca8109\") " pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:41.834677 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:37:41.834597 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-maas-api-tls podName:1a496ba5-0461-4eff-b8d9-20a3a8ca8109 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:42.334581842 +0000 UTC m=+722.568813863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-maas-api-tls") pod "maas-api-c4944758f-n5fmp" (UID: "1a496ba5-0461-4eff-b8d9-20a3a8ca8109") : secret "maas-api-serving-cert" not found Jul 31 21:37:41.835109 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.835092 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-openshift-service-ca\") pod \"maas-api-c4944758f-n5fmp\" (UID: \"1a496ba5-0461-4eff-b8d9-20a3a8ca8109\") " pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:41.843795 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:41.843768 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnb7x\" (UniqueName: \"kubernetes.io/projected/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-kube-api-access-qnb7x\") pod \"maas-api-c4944758f-n5fmp\" (UID: \"1a496ba5-0461-4eff-b8d9-20a3a8ca8109\") " pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:42.051127 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.051093 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6"] Jul 31 21:37:42.054987 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.054971 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" Jul 31 21:37:42.057661 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.057644 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 31 21:37:42.066479 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.066454 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6"] Jul 31 21:37:42.087247 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.087175 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8q8sh"] Jul 31 21:37:42.090851 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.090836 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" Jul 31 21:37:42.095128 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.095106 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b5dcg\"" Jul 31 21:37:42.107276 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.107250 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8q8sh"] Jul 31 21:37:42.137045 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.137009 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ckxm\" (UniqueName: \"kubernetes.io/projected/42e6a341-4514-4291-a19a-75a5e01a5942-kube-api-access-7ckxm\") pod \"payload-pre-processing-687dbb6cf6-sh2p6\" (UID: \"42e6a341-4514-4291-a19a-75a5e01a5942\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" Jul 31 21:37:42.137231 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.137049 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42e6a341-4514-4291-a19a-75a5e01a5942-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-sh2p6\" (UID: \"42e6a341-4514-4291-a19a-75a5e01a5942\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" Jul 31 21:37:42.238375 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.238343 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpj5b\" (UniqueName: \"kubernetes.io/projected/1f6e9bda-f084-4f91-a3cc-42b1cea95f16-kube-api-access-jpj5b\") pod \"payload-processing-5cc6cd444b-8q8sh\" (UID: \"1f6e9bda-f084-4f91-a3cc-42b1cea95f16\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" Jul 31 21:37:42.238550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.238395 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42e6a341-4514-4291-a19a-75a5e01a5942-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-sh2p6\" (UID: \"42e6a341-4514-4291-a19a-75a5e01a5942\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" Jul 31 21:37:42.238550 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.238514 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ckxm\" (UniqueName: \"kubernetes.io/projected/42e6a341-4514-4291-a19a-75a5e01a5942-kube-api-access-7ckxm\") pod \"payload-pre-processing-687dbb6cf6-sh2p6\" (UID: \"42e6a341-4514-4291-a19a-75a5e01a5942\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" Jul 31 21:37:42.238660 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.238556 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f6e9bda-f084-4f91-a3cc-42b1cea95f16-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8q8sh\" (UID: \"1f6e9bda-f084-4f91-a3cc-42b1cea95f16\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" Jul 31 21:37:42.239056 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.239038 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42e6a341-4514-4291-a19a-75a5e01a5942-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-sh2p6\" (UID: \"42e6a341-4514-4291-a19a-75a5e01a5942\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" Jul 31 21:37:42.248405 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.248375 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ckxm\" (UniqueName: \"kubernetes.io/projected/42e6a341-4514-4291-a19a-75a5e01a5942-kube-api-access-7ckxm\") pod \"payload-pre-processing-687dbb6cf6-sh2p6\" (UID: \"42e6a341-4514-4291-a19a-75a5e01a5942\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" Jul 31 21:37:42.340082 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.339989 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpj5b\" (UniqueName: \"kubernetes.io/projected/1f6e9bda-f084-4f91-a3cc-42b1cea95f16-kube-api-access-jpj5b\") pod \"payload-processing-5cc6cd444b-8q8sh\" (UID: \"1f6e9bda-f084-4f91-a3cc-42b1cea95f16\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" Jul 31 21:37:42.340230 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.340137 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-maas-api-tls\") pod \"maas-api-c4944758f-n5fmp\" (UID: \"1a496ba5-0461-4eff-b8d9-20a3a8ca8109\") " pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:42.340230 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.340200 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f6e9bda-f084-4f91-a3cc-42b1cea95f16-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8q8sh\" (UID: \"1f6e9bda-f084-4f91-a3cc-42b1cea95f16\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" Jul 31 21:37:42.341103 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.341081 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f6e9bda-f084-4f91-a3cc-42b1cea95f16-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8q8sh\" (UID: \"1f6e9bda-f084-4f91-a3cc-42b1cea95f16\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" Jul 31 21:37:42.342609 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.342591 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a496ba5-0461-4eff-b8d9-20a3a8ca8109-maas-api-tls\") pod \"maas-api-c4944758f-n5fmp\" (UID: \"1a496ba5-0461-4eff-b8d9-20a3a8ca8109\") " pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:42.352141 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.352118 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpj5b\" (UniqueName: \"kubernetes.io/projected/1f6e9bda-f084-4f91-a3cc-42b1cea95f16-kube-api-access-jpj5b\") pod \"payload-processing-5cc6cd444b-8q8sh\" (UID: \"1f6e9bda-f084-4f91-a3cc-42b1cea95f16\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" Jul 31 21:37:42.367956 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.367925 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" Jul 31 21:37:42.402333 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.402305 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" Jul 31 21:37:42.498304 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.498253 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:42.530783 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.530726 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6"] Jul 31 21:37:42.534056 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:37:42.534022 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e6a341_4514_4291_a19a_75a5e01a5942.slice/crio-5d3ec6bd01f4ab0ff97b9932c6e0e5ad6f88fbc1e46bb03b5e656684def7251c WatchSource:0}: Error finding container 5d3ec6bd01f4ab0ff97b9932c6e0e5ad6f88fbc1e46bb03b5e656684def7251c: Status 404 returned error can't find the container with id 5d3ec6bd01f4ab0ff97b9932c6e0e5ad6f88fbc1e46bb03b5e656684def7251c Jul 31 21:37:42.576834 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.576397 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8q8sh"] Jul 31 21:37:42.579890 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:37:42.579842 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6e9bda_f084_4f91_a3cc_42b1cea95f16.slice/crio-797547b3a027e64c6c06eb68f43ec0fe6c663df0634fa43b1cd5d6ff275d9a83 WatchSource:0}: Error finding container 797547b3a027e64c6c06eb68f43ec0fe6c663df0634fa43b1cd5d6ff275d9a83: Status 404 returned error can't find the container with id 797547b3a027e64c6c06eb68f43ec0fe6c663df0634fa43b1cd5d6ff275d9a83 Jul 31 21:37:42.668751 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:42.668717 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c4944758f-n5fmp"] Jul 31 21:37:42.672206 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:37:42.672180 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a496ba5_0461_4eff_b8d9_20a3a8ca8109.slice/crio-4aaffe4826af1b43d94153ff561101cbbbe9a6ed0789527f34d01902f526e402 WatchSource:0}: Error finding container 4aaffe4826af1b43d94153ff561101cbbbe9a6ed0789527f34d01902f526e402: Status 404 returned error can't find the container with id 4aaffe4826af1b43d94153ff561101cbbbe9a6ed0789527f34d01902f526e402 Jul 31 21:37:43.300356 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:43.300318 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" event={"ID":"1a496ba5-0461-4eff-b8d9-20a3a8ca8109","Type":"ContainerStarted","Data":"4aaffe4826af1b43d94153ff561101cbbbe9a6ed0789527f34d01902f526e402"} Jul 31 21:37:43.302800 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:43.302710 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" event={"ID":"42e6a341-4514-4291-a19a-75a5e01a5942","Type":"ContainerStarted","Data":"5d3ec6bd01f4ab0ff97b9932c6e0e5ad6f88fbc1e46bb03b5e656684def7251c"} Jul 31 21:37:43.304535 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:43.304400 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" event={"ID":"1f6e9bda-f084-4f91-a3cc-42b1cea95f16","Type":"ContainerStarted","Data":"797547b3a027e64c6c06eb68f43ec0fe6c663df0634fa43b1cd5d6ff275d9a83"} Jul 31 21:37:46.325597 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:46.325553 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" event={"ID":"1a496ba5-0461-4eff-b8d9-20a3a8ca8109","Type":"ContainerStarted","Data":"cf3bbee5b478562310c709d300fe04f78adedcc417310c360308031270fbece1"} Jul 31 21:37:46.326099 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:46.325631 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:46.327056 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:46.327033 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" event={"ID":"42e6a341-4514-4291-a19a-75a5e01a5942","Type":"ContainerStarted","Data":"32d3478c35f20dbdeb397e19288b2fb2fc69a09dbf86cb5758bd64ab5a67f2ce"} Jul 31 21:37:46.327170 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:46.327145 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" Jul 31 21:37:46.328489 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:46.328470 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" event={"ID":"1f6e9bda-f084-4f91-a3cc-42b1cea95f16","Type":"ContainerStarted","Data":"602b1b0683276ac75d45d805b66969a22ff09897f6fcfbc02788c2b8e38ea5ee"} Jul 31 21:37:46.328574 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:46.328510 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" Jul 31 21:37:46.364651 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:46.364596 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" podStartSLOduration=2.716678373 podStartE2EDuration="5.364578639s" totalImagesPullingTime="2.647900266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:46.346173752 +0000 UTC m=+726.580405791" watchObservedRunningTime="2026-07-31 21:37:46.364578639 +0000 UTC m=+726.598810678" Jul 31 21:37:46.364834 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:46.364680 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" podStartSLOduration=1.572643118 podStartE2EDuration="4.364675301s" totalImagesPullingTime="2.792032183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:46.362330157 +0000 UTC m=+726.596562197" watchObservedRunningTime="2026-07-31 21:37:46.364675301 +0000 UTC m=+726.598907338" Jul 31 21:37:46.380601 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:46.380550 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" podStartSLOduration=1.6417104710000001 podStartE2EDuration="4.380535093s" totalImagesPullingTime="2.738824622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:46.378056005 +0000 UTC m=+726.612288046" watchObservedRunningTime="2026-07-31 21:37:46.380535093 +0000 UTC m=+726.614767131" Jul 31 21:37:52.343564 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:52.343536 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-c4944758f-n5fmp" Jul 31 21:37:52.373222 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:52.373183 2548 generic.go:356] "Generic (PLEG): container finished" podID="6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152" containerID="cd89adc8b2a298e2053d68fc2c6de4eb8ffa2ced7ab79643901769e1878ad719" exitCode=0 Jul 31 21:37:52.373380 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:52.373265 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" event={"ID":"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152","Type":"ContainerDied","Data":"cd89adc8b2a298e2053d68fc2c6de4eb8ffa2ced7ab79643901769e1878ad719"} Jul 31 21:37:52.373789 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:52.373770 2548 scope.go:117] "RemoveContainer" containerID="cd89adc8b2a298e2053d68fc2c6de4eb8ffa2ced7ab79643901769e1878ad719" Jul 31 21:37:52.375140 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:52.375101 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 31 21:37:52.375253 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:52.375204 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 31 21:37:52.375508 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:52.375272 2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 31 21:37:53.381091 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:53.381061 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" event={"ID":"6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152","Type":"ContainerStarted","Data":"2aabf12f13e3623f5406cbc2e5a6915afb29d323baefe5030c8f155de4fcbc70"} Jul 31 21:37:53.547041 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:53.547009 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:37:53.548294 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:53.548260 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6mzmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 31 21:37:53.548502 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:53.548478 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" podUID="6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 31 21:37:54.547291 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:54.546819 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6mzmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 31 21:37:54.547291 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:54.546894 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" podUID="6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 31 21:37:55.546377 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:55.546333 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6mzmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 31 21:37:55.546580 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:55.546399 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" podUID="6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 31 21:37:55.864362 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:55.864326 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:37:56.546837 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:56.546790 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6mzmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 31 21:37:56.547078 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:56.546871 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" podUID="6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 31 21:37:57.339569 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:57.339512 2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" podUID="42e6a341-4514-4291-a19a-75a5e01a5942" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.48:9004: connect: connection refused" Jul 31 21:37:57.340119 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:57.340096 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8q8sh" Jul 31 21:37:57.546471 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:57.546432 2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6mzmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 31 21:37:57.546801 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:57.546768 2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" podUID="6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 31 21:37:58.551498 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:58.551466 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:37:58.553040 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:37:58.552975 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6mzmp" Jul 31 21:38:07.338098 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:07.338070 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sh2p6" Jul 31 21:38:10.746589 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.746554 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k"] Jul 31 21:38:10.755475 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.755428 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.759965 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.759940 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k"] Jul 31 21:38:10.760753 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.760730 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5zjwc\"" Jul 31 21:38:10.760970 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.760946 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 31 21:38:10.761104 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.760995 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 31 21:38:10.761104 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.760768 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 31 21:38:10.830604 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.830574 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.830778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.830617 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.830778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.830634 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c3bdc0-214e-4b82-a435-3ffde7839f89-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.830778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.830707 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq4bm\" (UniqueName: \"kubernetes.io/projected/d8c3bdc0-214e-4b82-a435-3ffde7839f89-kube-api-access-sq4bm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.830778 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.830770 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.830974 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.830840 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.932371 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.932333 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq4bm\" (UniqueName: \"kubernetes.io/projected/d8c3bdc0-214e-4b82-a435-3ffde7839f89-kube-api-access-sq4bm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.932552 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.932406 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.932552 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.932483 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.932552 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.932530 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.932723 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.932563 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.932723 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.932589 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c3bdc0-214e-4b82-a435-3ffde7839f89-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.932871 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.932845 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.933050 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.933029 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.933050 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.933046 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.934862 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.934836 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c3bdc0-214e-4b82-a435-3ffde7839f89-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.935122 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.935106 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c3bdc0-214e-4b82-a435-3ffde7839f89-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:10.941611 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:10.941591 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq4bm\" (UniqueName: \"kubernetes.io/projected/d8c3bdc0-214e-4b82-a435-3ffde7839f89-kube-api-access-sq4bm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fnf7k\" (UID: \"d8c3bdc0-214e-4b82-a435-3ffde7839f89\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:11.072371 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:11.072344 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:11.215568 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:11.215537 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k"] Jul 31 21:38:11.216982 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:38:11.216952 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c3bdc0_214e_4b82_a435_3ffde7839f89.slice/crio-2c8fca927ade6b7cbff59fe71200fb4bf244ad8e2011456da63b8e8d897e011a WatchSource:0}: Error finding container 2c8fca927ade6b7cbff59fe71200fb4bf244ad8e2011456da63b8e8d897e011a: Status 404 returned error can't find the container with id 2c8fca927ade6b7cbff59fe71200fb4bf244ad8e2011456da63b8e8d897e011a Jul 31 21:38:11.477454 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:11.477351 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" event={"ID":"d8c3bdc0-214e-4b82-a435-3ffde7839f89","Type":"ContainerStarted","Data":"2c8fca927ade6b7cbff59fe71200fb4bf244ad8e2011456da63b8e8d897e011a"} Jul 31 21:38:12.485111 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:12.485073 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" event={"ID":"d8c3bdc0-214e-4b82-a435-3ffde7839f89","Type":"ContainerStarted","Data":"9bd9761c4bcb9118ad2b538802e88b4edf2e45e56fc69693ab20c205ee2f8c9c"} Jul 31 21:38:12.504422 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:12.504326 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" podStartSLOduration=1.479051836 podStartE2EDuration="2.50431129s" totalImagesPullingTime="1.025259454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:38:12.503271608 +0000 UTC m=+752.737503657" watchObservedRunningTime="2026-07-31 21:38:12.50431129 +0000 UTC m=+752.738543370" Jul 31 21:38:21.073426 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:21.073393 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:21.074313 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:21.073458 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:21.085948 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:21.085895 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:21.543297 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:21.543216 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fnf7k" Jul 31 21:38:22.444737 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.444709 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk"] Jul 31 21:38:22.452622 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.452592 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.455514 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.455489 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 31 21:38:22.459139 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.459111 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk"] Jul 31 21:38:22.556311 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.556255 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.556311 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.556315 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.556595 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.556376 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.556595 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.556433 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2csft\" (UniqueName: \"kubernetes.io/projected/a48eba91-e156-4509-bcd5-bc01a60213f8-kube-api-access-2csft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.556595 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.556491 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.556595 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.556571 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a48eba91-e156-4509-bcd5-bc01a60213f8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.657686 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.657649 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.657686 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.657691 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.657943 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.657716 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.657943 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.657848 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2csft\" (UniqueName: \"kubernetes.io/projected/a48eba91-e156-4509-bcd5-bc01a60213f8-kube-api-access-2csft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.658038 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.657942 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.658038 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.657979 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a48eba91-e156-4509-bcd5-bc01a60213f8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.658152 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.658134 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.658217 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.658171 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.658293 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.658273 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.660163 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.660139 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a48eba91-e156-4509-bcd5-bc01a60213f8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.660431 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.660413 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a48eba91-e156-4509-bcd5-bc01a60213f8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.667258 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.667239 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2csft\" (UniqueName: \"kubernetes.io/projected/a48eba91-e156-4509-bcd5-bc01a60213f8-kube-api-access-2csft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j7ngk\" (UID: \"a48eba91-e156-4509-bcd5-bc01a60213f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.768066 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.767976 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:22.918024 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:22.917992 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk"] Jul 31 21:38:22.918947 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:38:22.918886 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48eba91_e156_4509_bcd5_bc01a60213f8.slice/crio-9c499bea82cb0706451d5aaf9f0c81373d6372f4cdd57281ae32079cb0f58ee1 WatchSource:0}: Error finding container 9c499bea82cb0706451d5aaf9f0c81373d6372f4cdd57281ae32079cb0f58ee1: Status 404 returned error can't find the container with id 9c499bea82cb0706451d5aaf9f0c81373d6372f4cdd57281ae32079cb0f58ee1 Jul 31 21:38:23.550896 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:23.550799 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" event={"ID":"a48eba91-e156-4509-bcd5-bc01a60213f8","Type":"ContainerStarted","Data":"06d604c989e56cee2ace19bca000d95c9830f4d33adf0b2208381bc69c191e09"} Jul 31 21:38:23.550896 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:23.550857 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" event={"ID":"a48eba91-e156-4509-bcd5-bc01a60213f8","Type":"ContainerStarted","Data":"9c499bea82cb0706451d5aaf9f0c81373d6372f4cdd57281ae32079cb0f58ee1"} Jul 31 21:38:23.578792 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:23.578741 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" podStartSLOduration=1.391681667 podStartE2EDuration="1.578726566s" totalImagesPullingTime="187.044899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:38:23.576182883 +0000 UTC m=+763.810414912" watchObservedRunningTime="2026-07-31 21:38:23.578726566 +0000 UTC m=+763.812958583" Jul 31 21:38:32.768098 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:32.768067 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:32.768515 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:32.768127 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:32.780502 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:32.780469 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:38:33.617209 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:38:33.617178 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j7ngk" Jul 31 21:40:33.325633 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:33.325549 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d6d84bc6c-rqv7k"] Jul 31 21:40:33.326270 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:33.325787 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" podUID="185c7517-b692-4d98-9376-7f482772735f" containerName="manager" containerID="cri-o://93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25" gracePeriod=30 Jul 31 21:40:33.585647 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:33.585572 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:40:33.730291 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:33.730257 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/185c7517-b692-4d98-9376-7f482772735f-webhook-cert\") pod \"185c7517-b692-4d98-9376-7f482772735f\" (UID: \"185c7517-b692-4d98-9376-7f482772735f\") " Jul 31 21:40:33.730490 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:33.730332 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2697n\" (UniqueName: \"kubernetes.io/projected/185c7517-b692-4d98-9376-7f482772735f-kube-api-access-2697n\") pod \"185c7517-b692-4d98-9376-7f482772735f\" (UID: \"185c7517-b692-4d98-9376-7f482772735f\") " Jul 31 21:40:33.732483 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:33.732457 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/185c7517-b692-4d98-9376-7f482772735f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "185c7517-b692-4d98-9376-7f482772735f" (UID: "185c7517-b692-4d98-9376-7f482772735f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:40:33.732583 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:33.732497 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/185c7517-b692-4d98-9376-7f482772735f-kube-api-access-2697n" (OuterVolumeSpecName: "kube-api-access-2697n") pod "185c7517-b692-4d98-9376-7f482772735f" (UID: "185c7517-b692-4d98-9376-7f482772735f"). InnerVolumeSpecName "kube-api-access-2697n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:40:33.831256 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:33.831219 2548 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/185c7517-b692-4d98-9376-7f482772735f-webhook-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:40:33.831256 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:33.831251 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2697n\" (UniqueName: \"kubernetes.io/projected/185c7517-b692-4d98-9376-7f482772735f-kube-api-access-2697n\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:40:34.270452 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:34.270421 2548 generic.go:356] "Generic (PLEG): container finished" podID="185c7517-b692-4d98-9376-7f482772735f" containerID="93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25" exitCode=0 Jul 31 21:40:34.270615 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:34.270523 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" Jul 31 21:40:34.270615 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:34.270558 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" event={"ID":"185c7517-b692-4d98-9376-7f482772735f","Type":"ContainerDied","Data":"93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25"} Jul 31 21:40:34.270615 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:34.270601 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d6d84bc6c-rqv7k" event={"ID":"185c7517-b692-4d98-9376-7f482772735f","Type":"ContainerDied","Data":"8478a2130818757baea54cae475fddd4834214f0435ee0ba05804ffeebf6b279"} Jul 31 21:40:34.270714 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:34.270622 2548 scope.go:117] "RemoveContainer" containerID="93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25" Jul 31 21:40:34.281175 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:34.281155 2548 scope.go:117] "RemoveContainer" containerID="93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25" Jul 31 21:40:34.281439 ip-10-0-135-32 kubenswrapper[2548]: E0731 21:40:34.281419 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25\": container with ID starting with 93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25 not found: ID does not exist" containerID="93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25" Jul 31 21:40:34.281487 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:34.281448 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25"} err="failed to get container status \"93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25\": rpc error: code = NotFound desc = could not find container \"93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25\": container with ID starting with 93e24021ff37a87053bea25ddd040aaa765a512518cad0f6e0e4de47fb485e25 not found: ID does not exist" Jul 31 21:40:34.292117 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:34.292092 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d6d84bc6c-rqv7k"] Jul 31 21:40:34.295670 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:34.295648 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d6d84bc6c-rqv7k"] Jul 31 21:40:36.176459 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:36.176424 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="185c7517-b692-4d98-9376-7f482772735f" path="/var/lib/kubelet/pods/185c7517-b692-4d98-9376-7f482772735f/volumes" Jul 31 21:40:41.413581 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:41.413548 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:40:41.415445 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:40:41.415425 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:45:41.447096 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:45:41.447054 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:45:41.449838 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:45:41.449816 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:48:22.753741 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:22.753696 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9"] Jul 31 21:48:22.754285 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:22.754016 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" podUID="ef568074-f1a4-4b5d-9b44-58749c9f01f5" containerName="manager" containerID="cri-o://7cb32e7d3bc024b82bdba5a57d55bf67a5d0b516948f85ec080999ba02eaaee6" gracePeriod=10 Jul 31 21:48:22.895039 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:22.895007 2548 generic.go:356] "Generic (PLEG): container finished" podID="ef568074-f1a4-4b5d-9b44-58749c9f01f5" containerID="7cb32e7d3bc024b82bdba5a57d55bf67a5d0b516948f85ec080999ba02eaaee6" exitCode=0 Jul 31 21:48:22.895205 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:22.895066 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" event={"ID":"ef568074-f1a4-4b5d-9b44-58749c9f01f5","Type":"ContainerDied","Data":"7cb32e7d3bc024b82bdba5a57d55bf67a5d0b516948f85ec080999ba02eaaee6"} Jul 31 21:48:23.015428 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.015367 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:48:23.107557 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.107521 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef568074-f1a4-4b5d-9b44-58749c9f01f5-extensions-socket-volume\") pod \"ef568074-f1a4-4b5d-9b44-58749c9f01f5\" (UID: \"ef568074-f1a4-4b5d-9b44-58749c9f01f5\") " Jul 31 21:48:23.107736 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.107585 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txn9w\" (UniqueName: \"kubernetes.io/projected/ef568074-f1a4-4b5d-9b44-58749c9f01f5-kube-api-access-txn9w\") pod \"ef568074-f1a4-4b5d-9b44-58749c9f01f5\" (UID: \"ef568074-f1a4-4b5d-9b44-58749c9f01f5\") " Jul 31 21:48:23.107960 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.107937 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef568074-f1a4-4b5d-9b44-58749c9f01f5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ef568074-f1a4-4b5d-9b44-58749c9f01f5" (UID: "ef568074-f1a4-4b5d-9b44-58749c9f01f5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:48:23.109708 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.109687 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef568074-f1a4-4b5d-9b44-58749c9f01f5-kube-api-access-txn9w" (OuterVolumeSpecName: "kube-api-access-txn9w") pod "ef568074-f1a4-4b5d-9b44-58749c9f01f5" (UID: "ef568074-f1a4-4b5d-9b44-58749c9f01f5"). InnerVolumeSpecName "kube-api-access-txn9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:48:23.209246 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.209212 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txn9w\" (UniqueName: \"kubernetes.io/projected/ef568074-f1a4-4b5d-9b44-58749c9f01f5-kube-api-access-txn9w\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:48:23.209246 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.209240 2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef568074-f1a4-4b5d-9b44-58749c9f01f5-extensions-socket-volume\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 21:48:23.901922 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.901893 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" Jul 31 21:48:23.902333 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.901900 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9" event={"ID":"ef568074-f1a4-4b5d-9b44-58749c9f01f5","Type":"ContainerDied","Data":"2ae6020a46af230134a4bbd8d292f559b683052ee96319bcfb6fff18419b84bf"} Jul 31 21:48:23.902333 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.901983 2548 scope.go:117] "RemoveContainer" containerID="7cb32e7d3bc024b82bdba5a57d55bf67a5d0b516948f85ec080999ba02eaaee6" Jul 31 21:48:23.923494 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.923467 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9"] Jul 31 21:48:23.927132 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:23.927108 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-v7wm9"] Jul 31 21:48:24.175569 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:48:24.175496 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef568074-f1a4-4b5d-9b44-58749c9f01f5" path="/var/lib/kubelet/pods/ef568074-f1a4-4b5d-9b44-58749c9f01f5/volumes" Jul 31 21:49:23.414975 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.414940 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2"] Jul 31 21:49:23.415442 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.415364 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="185c7517-b692-4d98-9376-7f482772735f" containerName="manager" Jul 31 21:49:23.415442 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.415374 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="185c7517-b692-4d98-9376-7f482772735f" containerName="manager" Jul 31 21:49:23.415442 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.415382 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef568074-f1a4-4b5d-9b44-58749c9f01f5" containerName="manager" Jul 31 21:49:23.415442 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.415387 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef568074-f1a4-4b5d-9b44-58749c9f01f5" containerName="manager" Jul 31 21:49:23.415575 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.415467 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef568074-f1a4-4b5d-9b44-58749c9f01f5" containerName="manager" Jul 31 21:49:23.415575 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.415479 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="185c7517-b692-4d98-9376-7f482772735f" containerName="manager" Jul 31 21:49:23.418674 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.418658 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" Jul 31 21:49:23.421735 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.421712 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zkvj5\"" Jul 31 21:49:23.432224 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.432202 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2"] Jul 31 21:49:23.496882 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.496851 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrpss\" (UniqueName: \"kubernetes.io/projected/87cb2852-241d-498d-ac2e-c418edd9ce31-kube-api-access-jrpss\") pod \"kuadrant-operator-controller-manager-68cf589589-wxkj2\" (UID: \"87cb2852-241d-498d-ac2e-c418edd9ce31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" Jul 31 21:49:23.497086 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.496886 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87cb2852-241d-498d-ac2e-c418edd9ce31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-wxkj2\" (UID: \"87cb2852-241d-498d-ac2e-c418edd9ce31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" Jul 31 21:49:23.597655 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.597620 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrpss\" (UniqueName: \"kubernetes.io/projected/87cb2852-241d-498d-ac2e-c418edd9ce31-kube-api-access-jrpss\") pod \"kuadrant-operator-controller-manager-68cf589589-wxkj2\" (UID: \"87cb2852-241d-498d-ac2e-c418edd9ce31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" Jul 31 21:49:23.597655 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.597656 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87cb2852-241d-498d-ac2e-c418edd9ce31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-wxkj2\" (UID: \"87cb2852-241d-498d-ac2e-c418edd9ce31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" Jul 31 21:49:23.598045 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.598026 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87cb2852-241d-498d-ac2e-c418edd9ce31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-wxkj2\" (UID: \"87cb2852-241d-498d-ac2e-c418edd9ce31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" Jul 31 21:49:23.606503 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.606481 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrpss\" (UniqueName: \"kubernetes.io/projected/87cb2852-241d-498d-ac2e-c418edd9ce31-kube-api-access-jrpss\") pod \"kuadrant-operator-controller-manager-68cf589589-wxkj2\" (UID: \"87cb2852-241d-498d-ac2e-c418edd9ce31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" Jul 31 21:49:23.728586 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.728507 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" Jul 31 21:49:23.875437 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:23.875413 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2"] Jul 31 21:49:23.877624 ip-10-0-135-32 kubenswrapper[2548]: W0731 21:49:23.877598 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cb2852_241d_498d_ac2e_c418edd9ce31.slice/crio-5a2701b3d0b261437347d5770f2bf6d7af5fa92602ece5aac78359f9b4ab8fb9 WatchSource:0}: Error finding container 5a2701b3d0b261437347d5770f2bf6d7af5fa92602ece5aac78359f9b4ab8fb9: Status 404 returned error can't find the container with id 5a2701b3d0b261437347d5770f2bf6d7af5fa92602ece5aac78359f9b4ab8fb9 Jul 31 21:49:24.232473 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:24.232432 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" event={"ID":"87cb2852-241d-498d-ac2e-c418edd9ce31","Type":"ContainerStarted","Data":"11bc705ccf66f73ef66c09efb3b560bd715a2680468e051fb02d4a634ac8ee64"} Jul 31 21:49:24.232663 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:24.232501 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" Jul 31 21:49:24.232663 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:24.232524 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" event={"ID":"87cb2852-241d-498d-ac2e-c418edd9ce31","Type":"ContainerStarted","Data":"5a2701b3d0b261437347d5770f2bf6d7af5fa92602ece5aac78359f9b4ab8fb9"} Jul 31 21:49:24.255412 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:24.255359 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" podStartSLOduration=1.255345742 podStartE2EDuration="1.255345742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:49:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:49:24.252001551 +0000 UTC m=+1424.486233592" watchObservedRunningTime="2026-07-31 21:49:24.255345742 +0000 UTC m=+1424.489577780" Jul 31 21:49:35.240889 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:49:35.240855 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-wxkj2" Jul 31 21:50:41.485211 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:50:41.485174 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:50:41.488327 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:50:41.488299 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:55:41.521930 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:55:41.521880 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 21:55:41.527333 ip-10-0-135-32 kubenswrapper[2548]: I0731 21:55:41.527310 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 22:00:41.556791 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:00:41.556758 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 22:00:41.574223 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:00:41.574193 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 22:05:41.598920 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:05:41.598874 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 22:05:41.612771 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:05:41.612744 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 22:08:20.193882 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.193828 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf"] Jul 31 22:08:20.197828 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.197805 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:20.200761 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.200739 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8ef214f7-serving-cert\"" Jul 31 22:08:20.206982 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.206954 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf"] Jul 31 22:08:20.262636 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.262597 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfmgs\" (UniqueName: \"kubernetes.io/projected/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-kube-api-access-gfmgs\") pod \"maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:20.262636 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.262647 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-openshift-service-ca\") pod \"maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:20.262877 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.262788 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-maas-api-tls\") pod \"maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:20.364006 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.363965 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-maas-api-tls\") pod \"maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:20.364229 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.364051 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfmgs\" (UniqueName: \"kubernetes.io/projected/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-kube-api-access-gfmgs\") pod \"maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:20.364229 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.364080 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-openshift-service-ca\") pod \"maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:20.364229 ip-10-0-135-32 kubenswrapper[2548]: E0731 22:08:20.364135 2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-serving-cert: secret "maas-api-e2e-ait-8ef214f7-serving-cert" not found Jul 31 22:08:20.364229 ip-10-0-135-32 kubenswrapper[2548]: E0731 22:08:20.364221 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-maas-api-tls podName:5af9ca7c-4650-4cbf-8549-d1ed0f0d436b nodeName:}" failed. No retries permitted until 2026-07-31 22:08:20.864198534 +0000 UTC m=+2561.098430559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-maas-api-tls") pod "maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" (UID: "5af9ca7c-4650-4cbf-8549-d1ed0f0d436b") : secret "maas-api-e2e-ait-8ef214f7-serving-cert" not found Jul 31 22:08:20.364724 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.364704 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-openshift-service-ca\") pod \"maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:20.376713 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.376681 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfmgs\" (UniqueName: \"kubernetes.io/projected/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-kube-api-access-gfmgs\") pod \"maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:20.792007 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.791972 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7"] Jul 31 22:08:20.795725 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.795706 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:08:20.798636 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.798598 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8ef214f7\"" Jul 31 22:08:20.806434 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.806405 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7"] Jul 31 22:08:20.810258 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.810227 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75"] Jul 31 22:08:20.815114 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.815085 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:08:20.818200 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.818171 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8ef214f7-dockercfg-mpcrr\"" Jul 31 22:08:20.822407 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.822339 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75"] Jul 31 22:08:20.869966 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.869925 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5070544e-d446-477b-9b2c-7c17208dbb22-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7\" (UID: \"5070544e-d446-477b-9b2c-7c17208dbb22\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:08:20.870143 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.869976 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j7gd\" (UniqueName: \"kubernetes.io/projected/f355e682-49f0-44c3-927a-0bf10bddc66b-kube-api-access-9j7gd\") pod \"payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75\" (UID: \"f355e682-49f0-44c3-927a-0bf10bddc66b\") " pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:08:20.870143 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.870041 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-maas-api-tls\") pod \"maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:20.870143 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.870060 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfdhj\" (UniqueName: \"kubernetes.io/projected/5070544e-d446-477b-9b2c-7c17208dbb22-kube-api-access-vfdhj\") pod \"payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7\" (UID: \"5070544e-d446-477b-9b2c-7c17208dbb22\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:08:20.870143 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.870117 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f355e682-49f0-44c3-927a-0bf10bddc66b-plugins-config-volume\") pod \"payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75\" (UID: \"f355e682-49f0-44c3-927a-0bf10bddc66b\") " pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:08:20.872738 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.872719 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-maas-api-tls\") pod \"maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:20.971673 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.971633 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5070544e-d446-477b-9b2c-7c17208dbb22-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7\" (UID: \"5070544e-d446-477b-9b2c-7c17208dbb22\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:08:20.971673 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.971682 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j7gd\" (UniqueName: \"kubernetes.io/projected/f355e682-49f0-44c3-927a-0bf10bddc66b-kube-api-access-9j7gd\") pod \"payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75\" (UID: \"f355e682-49f0-44c3-927a-0bf10bddc66b\") " pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:08:20.972001 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.971723 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfdhj\" (UniqueName: \"kubernetes.io/projected/5070544e-d446-477b-9b2c-7c17208dbb22-kube-api-access-vfdhj\") pod \"payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7\" (UID: \"5070544e-d446-477b-9b2c-7c17208dbb22\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:08:20.972001 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.971747 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f355e682-49f0-44c3-927a-0bf10bddc66b-plugins-config-volume\") pod \"payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75\" (UID: \"f355e682-49f0-44c3-927a-0bf10bddc66b\") " pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:08:20.972498 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.972473 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5070544e-d446-477b-9b2c-7c17208dbb22-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7\" (UID: \"5070544e-d446-477b-9b2c-7c17208dbb22\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:08:20.972591 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.972481 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f355e682-49f0-44c3-927a-0bf10bddc66b-plugins-config-volume\") pod \"payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75\" (UID: \"f355e682-49f0-44c3-927a-0bf10bddc66b\") " pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:08:20.980160 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.980136 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfdhj\" (UniqueName: \"kubernetes.io/projected/5070544e-d446-477b-9b2c-7c17208dbb22-kube-api-access-vfdhj\") pod \"payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7\" (UID: \"5070544e-d446-477b-9b2c-7c17208dbb22\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:08:20.980337 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:20.980312 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j7gd\" (UniqueName: \"kubernetes.io/projected/f355e682-49f0-44c3-927a-0bf10bddc66b-kube-api-access-9j7gd\") pod \"payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75\" (UID: \"f355e682-49f0-44c3-927a-0bf10bddc66b\") " pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:08:21.110893 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.110860 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:21.111096 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.111047 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:08:21.129476 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.129397 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:08:21.287933 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.287860 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf"] Jul 31 22:08:21.297547 ip-10-0-135-32 kubenswrapper[2548]: W0731 22:08:21.297471 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af9ca7c_4650_4cbf_8549_d1ed0f0d436b.slice/crio-d70815c7738abaa2331446d6291954142168a7714c0019506cfefaa76ba26cfd WatchSource:0}: Error finding container d70815c7738abaa2331446d6291954142168a7714c0019506cfefaa76ba26cfd: Status 404 returned error can't find the container with id d70815c7738abaa2331446d6291954142168a7714c0019506cfefaa76ba26cfd Jul 31 22:08:21.301638 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.299746 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 22:08:21.318619 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.318557 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7"] Jul 31 22:08:21.321572 ip-10-0-135-32 kubenswrapper[2548]: W0731 22:08:21.321532 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5070544e_d446_477b_9b2c_7c17208dbb22.slice/crio-7d391c494bd48847bf2a57d10a4fa1c37ac4ef43768ac0bd2d0738dfe0afc953 WatchSource:0}: Error finding container 7d391c494bd48847bf2a57d10a4fa1c37ac4ef43768ac0bd2d0738dfe0afc953: Status 404 returned error can't find the container with id 7d391c494bd48847bf2a57d10a4fa1c37ac4ef43768ac0bd2d0738dfe0afc953 Jul 31 22:08:21.340791 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.340759 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75"] Jul 31 22:08:21.341683 ip-10-0-135-32 kubenswrapper[2548]: W0731 22:08:21.341631 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf355e682_49f0_44c3_927a_0bf10bddc66b.slice/crio-09f1dd52e6d719d351b75b1fbc76be4bbdcc43b347d19bb6655c8a324ceaca73 WatchSource:0}: Error finding container 09f1dd52e6d719d351b75b1fbc76be4bbdcc43b347d19bb6655c8a324ceaca73: Status 404 returned error can't find the container with id 09f1dd52e6d719d351b75b1fbc76be4bbdcc43b347d19bb6655c8a324ceaca73 Jul 31 22:08:21.562017 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.561980 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" event={"ID":"f355e682-49f0-44c3-927a-0bf10bddc66b","Type":"ContainerStarted","Data":"da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5"} Jul 31 22:08:21.562213 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.562035 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" event={"ID":"f355e682-49f0-44c3-927a-0bf10bddc66b","Type":"ContainerStarted","Data":"09f1dd52e6d719d351b75b1fbc76be4bbdcc43b347d19bb6655c8a324ceaca73"} Jul 31 22:08:21.562213 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.562096 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:08:21.563360 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.563337 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" event={"ID":"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b","Type":"ContainerStarted","Data":"d70815c7738abaa2331446d6291954142168a7714c0019506cfefaa76ba26cfd"} Jul 31 22:08:21.564694 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.564674 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" event={"ID":"5070544e-d446-477b-9b2c-7c17208dbb22","Type":"ContainerStarted","Data":"65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08"} Jul 31 22:08:21.564801 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.564711 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" event={"ID":"5070544e-d446-477b-9b2c-7c17208dbb22","Type":"ContainerStarted","Data":"7d391c494bd48847bf2a57d10a4fa1c37ac4ef43768ac0bd2d0738dfe0afc953"} Jul 31 22:08:21.564801 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.564751 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:08:21.578594 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.578543 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" podStartSLOduration=1.578526367 podStartE2EDuration="1.578526367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:08:21.57741462 +0000 UTC m=+2561.811646682" watchObservedRunningTime="2026-07-31 22:08:21.578526367 +0000 UTC m=+2561.812758407" Jul 31 22:08:21.594084 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:21.594020 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" podStartSLOduration=1.5940036480000002 podStartE2EDuration="1.594003648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:08:21.592958071 +0000 UTC m=+2561.827190113" watchObservedRunningTime="2026-07-31 22:08:21.594003648 +0000 UTC m=+2561.828235687" Jul 31 22:08:22.572570 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:22.572513 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" event={"ID":"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b","Type":"ContainerStarted","Data":"3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe"} Jul 31 22:08:22.595553 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:22.595487 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" podStartSLOduration=2.211880093 podStartE2EDuration="2.595470747s" totalImagesPullingTime="383.590654ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:08:22.592953139 +0000 UTC m=+2562.827185200" watchObservedRunningTime="2026-07-31 22:08:22.595470747 +0000 UTC m=+2562.829702787" Jul 31 22:08:23.578994 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:23.578960 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:29.592018 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:29.591986 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:08:32.575102 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:32.575071 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:08:32.575527 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:08:32.575382 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:10:41.634411 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:10:41.634299 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 22:10:41.653242 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:10:41.653215 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 22:11:26.802666 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:26.802628 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf"] Jul 31 22:11:26.803326 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:26.802902 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" podUID="5af9ca7c-4650-4cbf-8549-d1ed0f0d436b" containerName="maas-api" containerID="cri-o://3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe" gracePeriod=30 Jul 31 22:11:26.863265 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:26.863229 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75"] Jul 31 22:11:26.863581 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:26.863526 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" podUID="f355e682-49f0-44c3-927a-0bf10bddc66b" containerName="payload-processing" containerID="cri-o://da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5" gracePeriod=30 Jul 31 22:11:26.872993 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:26.872957 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7"] Jul 31 22:11:26.873277 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:26.873215 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" podUID="5070544e-d446-477b-9b2c-7c17208dbb22" containerName="payload-pre-processing" containerID="cri-o://65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08" gracePeriod=30 Jul 31 22:11:27.146820 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.146787 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:11:27.170267 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.170236 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:11:27.188727 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.188700 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:11:27.267255 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.267216 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfmgs\" (UniqueName: \"kubernetes.io/projected/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-kube-api-access-gfmgs\") pod \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " Jul 31 22:11:27.267451 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.267276 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-maas-api-tls\") pod \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " Jul 31 22:11:27.267451 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.267372 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfdhj\" (UniqueName: \"kubernetes.io/projected/5070544e-d446-477b-9b2c-7c17208dbb22-kube-api-access-vfdhj\") pod \"5070544e-d446-477b-9b2c-7c17208dbb22\" (UID: \"5070544e-d446-477b-9b2c-7c17208dbb22\") " Jul 31 22:11:27.267451 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.267417 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j7gd\" (UniqueName: \"kubernetes.io/projected/f355e682-49f0-44c3-927a-0bf10bddc66b-kube-api-access-9j7gd\") pod \"f355e682-49f0-44c3-927a-0bf10bddc66b\" (UID: \"f355e682-49f0-44c3-927a-0bf10bddc66b\") " Jul 31 22:11:27.267451 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.267449 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f355e682-49f0-44c3-927a-0bf10bddc66b-plugins-config-volume\") pod \"f355e682-49f0-44c3-927a-0bf10bddc66b\" (UID: \"f355e682-49f0-44c3-927a-0bf10bddc66b\") " Jul 31 22:11:27.268391 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.267832 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f355e682-49f0-44c3-927a-0bf10bddc66b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f355e682-49f0-44c3-927a-0bf10bddc66b" (UID: "f355e682-49f0-44c3-927a-0bf10bddc66b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 22:11:27.268391 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.267962 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-openshift-service-ca\") pod \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\" (UID: \"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b\") " Jul 31 22:11:27.268391 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.268112 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5070544e-d446-477b-9b2c-7c17208dbb22-plugins-config-volume\") pod \"5070544e-d446-477b-9b2c-7c17208dbb22\" (UID: \"5070544e-d446-477b-9b2c-7c17208dbb22\") " Jul 31 22:11:27.268818 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.268656 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5af9ca7c-4650-4cbf-8549-d1ed0f0d436b" (UID: "5af9ca7c-4650-4cbf-8549-d1ed0f0d436b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 22:11:27.269153 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.269126 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5070544e-d446-477b-9b2c-7c17208dbb22-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5070544e-d446-477b-9b2c-7c17208dbb22" (UID: "5070544e-d446-477b-9b2c-7c17208dbb22"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 22:11:27.269575 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.269540 2548 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5070544e-d446-477b-9b2c-7c17208dbb22-plugins-config-volume\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 22:11:27.269658 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.269578 2548 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f355e682-49f0-44c3-927a-0bf10bddc66b-plugins-config-volume\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 22:11:27.269658 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.269594 2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-openshift-service-ca\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 22:11:27.270268 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.270234 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5070544e-d446-477b-9b2c-7c17208dbb22-kube-api-access-vfdhj" (OuterVolumeSpecName: "kube-api-access-vfdhj") pod "5070544e-d446-477b-9b2c-7c17208dbb22" (UID: "5070544e-d446-477b-9b2c-7c17208dbb22"). InnerVolumeSpecName "kube-api-access-vfdhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 22:11:27.270494 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.270466 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5af9ca7c-4650-4cbf-8549-d1ed0f0d436b" (UID: "5af9ca7c-4650-4cbf-8549-d1ed0f0d436b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 22:11:27.270698 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.270676 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-kube-api-access-gfmgs" (OuterVolumeSpecName: "kube-api-access-gfmgs") pod "5af9ca7c-4650-4cbf-8549-d1ed0f0d436b" (UID: "5af9ca7c-4650-4cbf-8549-d1ed0f0d436b"). InnerVolumeSpecName "kube-api-access-gfmgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 22:11:27.270756 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.270701 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f355e682-49f0-44c3-927a-0bf10bddc66b-kube-api-access-9j7gd" (OuterVolumeSpecName: "kube-api-access-9j7gd") pod "f355e682-49f0-44c3-927a-0bf10bddc66b" (UID: "f355e682-49f0-44c3-927a-0bf10bddc66b"). InnerVolumeSpecName "kube-api-access-9j7gd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 22:11:27.370844 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.370801 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfmgs\" (UniqueName: \"kubernetes.io/projected/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-kube-api-access-gfmgs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 22:11:27.370844 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.370837 2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b-maas-api-tls\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 22:11:27.370844 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.370850 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfdhj\" (UniqueName: \"kubernetes.io/projected/5070544e-d446-477b-9b2c-7c17208dbb22-kube-api-access-vfdhj\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 22:11:27.371154 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.370862 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j7gd\" (UniqueName: \"kubernetes.io/projected/f355e682-49f0-44c3-927a-0bf10bddc66b-kube-api-access-9j7gd\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 31 22:11:27.634589 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.634499 2548 generic.go:356] "Generic (PLEG): container finished" podID="f355e682-49f0-44c3-927a-0bf10bddc66b" containerID="da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5" exitCode=0 Jul 31 22:11:27.634589 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.634546 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" Jul 31 22:11:27.634850 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.634587 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" event={"ID":"f355e682-49f0-44c3-927a-0bf10bddc66b","Type":"ContainerDied","Data":"da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5"} Jul 31 22:11:27.634850 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.634656 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75" event={"ID":"f355e682-49f0-44c3-927a-0bf10bddc66b","Type":"ContainerDied","Data":"09f1dd52e6d719d351b75b1fbc76be4bbdcc43b347d19bb6655c8a324ceaca73"} Jul 31 22:11:27.634850 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.634685 2548 scope.go:117] "RemoveContainer" containerID="da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5" Jul 31 22:11:27.636114 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.636089 2548 generic.go:356] "Generic (PLEG): container finished" podID="5af9ca7c-4650-4cbf-8549-d1ed0f0d436b" containerID="3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe" exitCode=0 Jul 31 22:11:27.636200 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.636141 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" Jul 31 22:11:27.636271 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.636218 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" event={"ID":"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b","Type":"ContainerDied","Data":"3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe"} Jul 31 22:11:27.636325 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.636276 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf" event={"ID":"5af9ca7c-4650-4cbf-8549-d1ed0f0d436b","Type":"ContainerDied","Data":"d70815c7738abaa2331446d6291954142168a7714c0019506cfefaa76ba26cfd"} Jul 31 22:11:27.638318 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.638294 2548 generic.go:356] "Generic (PLEG): container finished" podID="5070544e-d446-477b-9b2c-7c17208dbb22" containerID="65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08" exitCode=0 Jul 31 22:11:27.638638 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.638340 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" Jul 31 22:11:27.638638 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.638375 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" event={"ID":"5070544e-d446-477b-9b2c-7c17208dbb22","Type":"ContainerDied","Data":"65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08"} Jul 31 22:11:27.638638 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.638419 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7" event={"ID":"5070544e-d446-477b-9b2c-7c17208dbb22","Type":"ContainerDied","Data":"7d391c494bd48847bf2a57d10a4fa1c37ac4ef43768ac0bd2d0738dfe0afc953"} Jul 31 22:11:27.647254 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.646982 2548 scope.go:117] "RemoveContainer" containerID="da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5" Jul 31 22:11:27.647343 ip-10-0-135-32 kubenswrapper[2548]: E0731 22:11:27.647323 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5\": container with ID starting with da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5 not found: ID does not exist" containerID="da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5" Jul 31 22:11:27.647400 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.647354 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5"} err="failed to get container status \"da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5\": rpc error: code = NotFound desc = could not find container \"da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5\": container with ID starting with da3085df888b51a3c8a0b2ce22c02d587e36465e9ac242a7eaaaa7955f5c0ea5 not found: ID does not exist" Jul 31 22:11:27.647400 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.647375 2548 scope.go:117] "RemoveContainer" containerID="3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe" Jul 31 22:11:27.656834 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.656811 2548 scope.go:117] "RemoveContainer" containerID="3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe" Jul 31 22:11:27.657125 ip-10-0-135-32 kubenswrapper[2548]: E0731 22:11:27.657105 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe\": container with ID starting with 3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe not found: ID does not exist" containerID="3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe" Jul 31 22:11:27.657177 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.657134 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe"} err="failed to get container status \"3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe\": rpc error: code = NotFound desc = could not find container \"3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe\": container with ID starting with 3904d0d84af6d87f9ee1df83bb49fa140031c22331b5c7397d61e46a774ef6fe not found: ID does not exist" Jul 31 22:11:27.657177 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.657150 2548 scope.go:117] "RemoveContainer" containerID="65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08" Jul 31 22:11:27.665042 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.665017 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf"] Jul 31 22:11:27.666194 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.666147 2548 scope.go:117] "RemoveContainer" containerID="65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08" Jul 31 22:11:27.666531 ip-10-0-135-32 kubenswrapper[2548]: E0731 22:11:27.666507 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08\": container with ID starting with 65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08 not found: ID does not exist" containerID="65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08" Jul 31 22:11:27.666611 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.666536 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08"} err="failed to get container status \"65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08\": rpc error: code = NotFound desc = could not find container \"65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08\": container with ID starting with 65d02806a4e51db16402280e0dd24e219fa01fc03f67b97cf6859c0ad7b24f08 not found: ID does not exist" Jul 31 22:11:27.669040 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.669023 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ef214f7-7bddc9dbf5-sjgsf"] Jul 31 22:11:27.679509 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.679483 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7"] Jul 31 22:11:27.685888 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.685867 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ef214f7-7dd6d46896-qxgg7"] Jul 31 22:11:27.697358 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.697329 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75"] Jul 31 22:11:27.701332 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:27.701306 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ef214f7-66b5ffb8b6-cdn75"] Jul 31 22:11:28.176563 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:28.176530 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5070544e-d446-477b-9b2c-7c17208dbb22" path="/var/lib/kubelet/pods/5070544e-d446-477b-9b2c-7c17208dbb22/volumes" Jul 31 22:11:28.176977 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:28.176949 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5af9ca7c-4650-4cbf-8549-d1ed0f0d436b" path="/var/lib/kubelet/pods/5af9ca7c-4650-4cbf-8549-d1ed0f0d436b/volumes" Jul 31 22:11:28.177265 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:28.177252 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f355e682-49f0-44c3-927a-0bf10bddc66b" path="/var/lib/kubelet/pods/f355e682-49f0-44c3-927a-0bf10bddc66b/volumes" Jul 31 22:11:32.964895 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:32.964858 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gh8tp_4135e118-1cf3-407a-87d5-dc88aa9d0efb/manager/0.log" Jul 31 22:11:33.313631 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:33.313551 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-s66v6_e88a7ba5-37cc-41c6-9258-24abeb2a4403/server/0.log" Jul 31 22:11:33.424446 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:33.424399 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z6xdq_71dd4988-ddca-40cc-a95f-257c537256f5/manager/0.log" Jul 31 22:11:33.767990 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:33.767958 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b88b5667d-lvhph_293dbfff-da0a-4f7f-98ae-878863606cc3/manager/0.log" Jul 31 22:11:33.775027 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:33.775008 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b88b5667d-lvhph_293dbfff-da0a-4f7f-98ae-878863606cc3/copy-manifests/0.log" Jul 31 22:11:34.105719 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:34.105685 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-c4944758f-n5fmp_1a496ba5-0461-4eff-b8d9-20a3a8ca8109/maas-api/0.log" Jul 31 22:11:34.439657 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:34.439577 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-gpkq2_aee983bc-f547-474f-86ab-b31190dbf6fe/postgres/0.log" Jul 31 22:11:35.290086 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:35.290059 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-mz8gv_cc25a677-b40a-45c3-97b6-b9967e482701/manager/0.log" Jul 31 22:11:35.396952 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:35.396891 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-9fb59_b084ff8f-dcd2-4cf9-bf34-75b5d036f0e3/manager/0.log" Jul 31 22:11:35.615284 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:35.615249 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-wxkj2_87cb2852-241d-498d-ac2e-c418edd9ce31/manager/0.log" Jul 31 22:11:35.845229 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:35.845193 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-rrz5t_d4fecfa4-6d09-459a-a128-eca0d9567256/manager/0.log" Jul 31 22:11:36.170007 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:36.169978 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f_8c25e75c-15b6-404d-999f-81f25af54d38/istio-proxy/0.log" Jul 31 22:11:36.502703 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:36.502618 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77494cc5-z4krc_623c95ff-891f-45e7-8d14-5b4453a1e996/kube-auth-proxy/0.log" Jul 31 22:11:36.615432 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:36.615394 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6mzmp_6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152/istio-proxy/1.log" Jul 31 22:11:36.722281 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:36.722246 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sh2p6_42e6a341-4514-4291-a19a-75a5e01a5942/payload-pre-processing/0.log" Jul 31 22:11:36.833286 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:36.833249 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8q8sh_1f6e9bda-f084-4f91-a3cc-42b1cea95f16/payload-processing/0.log" Jul 31 22:11:37.388582 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:37.388553 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fnf7k_d8c3bdc0-214e-4b82-a435-3ffde7839f89/main/0.log" Jul 31 22:11:37.502624 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:37.502595 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-j7ngk_a48eba91-e156-4509-bcd5-bc01a60213f8/main/0.log" Jul 31 22:11:45.839664 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:45.839634 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fvtj7_fe28664a-22c1-4e57-aac2-08f4b0cc7d14/global-pull-secret-syncer/0.log" Jul 31 22:11:45.972886 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:45.972856 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gx76h_5d66c8d3-47f5-4b6f-bc26-61372efd4add/konnectivity-agent/0.log" Jul 31 22:11:46.051716 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:46.051679 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-32.ec2.internal_bf037baff33e107bd6b6137eaa0bdb4e/haproxy/0.log" Jul 31 22:11:50.697709 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:50.697674 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-mz8gv_cc25a677-b40a-45c3-97b6-b9967e482701/manager/0.log" Jul 31 22:11:50.724920 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:50.724887 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-9fb59_b084ff8f-dcd2-4cf9-bf34-75b5d036f0e3/manager/0.log" Jul 31 22:11:50.890219 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:50.890189 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-wxkj2_87cb2852-241d-498d-ac2e-c418edd9ce31/manager/0.log" Jul 31 22:11:51.010348 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:51.010260 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-rrz5t_d4fecfa4-6d09-459a-a128-eca0d9567256/manager/0.log" Jul 31 22:11:52.725004 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:52.724896 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-x8ckw_9e65bb6a-9887-4ae8-9f1c-dae7cdc55ca5/cluster-monitoring-operator/0.log" Jul 31 22:11:52.754758 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:52.754720 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lhnrf_dc151d83-10a0-4c9d-aa65-dd1519228c66/kube-state-metrics/0.log" Jul 31 22:11:52.774399 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:52.774369 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lhnrf_dc151d83-10a0-4c9d-aa65-dd1519228c66/kube-rbac-proxy-main/0.log" Jul 31 22:11:52.801275 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:52.801250 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-lhnrf_dc151d83-10a0-4c9d-aa65-dd1519228c66/kube-rbac-proxy-self/0.log" Jul 31 22:11:52.872431 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:52.872403 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-m8d6s_7958b689-9278-49c3-b59d-df78ffc03d24/monitoring-plugin/0.log" Jul 31 22:11:53.110815 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.110787 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpl7c_1939eb9a-abc4-45a1-8ba9-804771b89fe2/node-exporter/0.log" Jul 31 22:11:53.133475 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.133452 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpl7c_1939eb9a-abc4-45a1-8ba9-804771b89fe2/kube-rbac-proxy/0.log" Jul 31 22:11:53.164449 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.164424 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xpl7c_1939eb9a-abc4-45a1-8ba9-804771b89fe2/init-textfile/0.log" Jul 31 22:11:53.197242 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.197217 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bdbm6_41631157-646d-4883-aee8-c52119ba1256/kube-rbac-proxy-main/0.log" Jul 31 22:11:53.219771 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.219747 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bdbm6_41631157-646d-4883-aee8-c52119ba1256/kube-rbac-proxy-self/0.log" Jul 31 22:11:53.243507 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.243481 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bdbm6_41631157-646d-4883-aee8-c52119ba1256/openshift-state-metrics/0.log" Jul 31 22:11:53.284804 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.284780 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1acec3-d263-4c6e-92ac-88311bea75f2/prometheus/0.log" Jul 31 22:11:53.312142 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.312113 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1acec3-d263-4c6e-92ac-88311bea75f2/config-reloader/0.log" Jul 31 22:11:53.338567 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.338540 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1acec3-d263-4c6e-92ac-88311bea75f2/thanos-sidecar/0.log" Jul 31 22:11:53.365710 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.365633 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1acec3-d263-4c6e-92ac-88311bea75f2/kube-rbac-proxy-web/0.log" Jul 31 22:11:53.395112 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.395072 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1acec3-d263-4c6e-92ac-88311bea75f2/kube-rbac-proxy/0.log" Jul 31 22:11:53.423528 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.423500 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1acec3-d263-4c6e-92ac-88311bea75f2/kube-rbac-proxy-thanos/0.log" Jul 31 22:11:53.447925 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.447879 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1acec3-d263-4c6e-92ac-88311bea75f2/init-config-reloader/0.log" Jul 31 22:11:53.526935 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.526885 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-vrv48_4106e60c-f5ab-46b2-bff7-af24b62d42ac/prometheus-operator-admission-webhook/0.log" Jul 31 22:11:53.561873 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.561844 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f7c996b8-jzgnp_ffefe97c-f63d-4857-9eaf-67a6ac49c3c0/telemeter-client/0.log" Jul 31 22:11:53.589609 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.589582 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f7c996b8-jzgnp_ffefe97c-f63d-4857-9eaf-67a6ac49c3c0/reload/0.log" Jul 31 22:11:53.615362 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:53.615324 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f7c996b8-jzgnp_ffefe97c-f63d-4857-9eaf-67a6ac49c3c0/kube-rbac-proxy/0.log" Jul 31 22:11:54.994360 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:54.994330 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-nz24j_c3474ee1-309d-4eb7-98c8-b2ef3f8a37ef/networking-console-plugin/0.log" Jul 31 22:11:55.648307 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.648236 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/2.log" Jul 31 22:11:55.653331 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.653308 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-l9tz9_9fceeaf4-4903-437b-950b-7b10ec3b2991/console-operator/3.log" Jul 31 22:11:55.758742 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.758701 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h"] Jul 31 22:11:55.759354 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.759333 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f355e682-49f0-44c3-927a-0bf10bddc66b" containerName="payload-processing" Jul 31 22:11:55.759354 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.759354 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="f355e682-49f0-44c3-927a-0bf10bddc66b" containerName="payload-processing" Jul 31 22:11:55.759520 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.759365 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af9ca7c-4650-4cbf-8549-d1ed0f0d436b" containerName="maas-api" Jul 31 22:11:55.759520 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.759371 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af9ca7c-4650-4cbf-8549-d1ed0f0d436b" containerName="maas-api" Jul 31 22:11:55.759520 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.759385 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5070544e-d446-477b-9b2c-7c17208dbb22" containerName="payload-pre-processing" Jul 31 22:11:55.759520 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.759394 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5070544e-d446-477b-9b2c-7c17208dbb22" containerName="payload-pre-processing" Jul 31 22:11:55.759520 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.759500 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af9ca7c-4650-4cbf-8549-d1ed0f0d436b" containerName="maas-api" Jul 31 22:11:55.759520 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.759510 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="f355e682-49f0-44c3-927a-0bf10bddc66b" containerName="payload-processing" Jul 31 22:11:55.759520 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.759517 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5070544e-d446-477b-9b2c-7c17208dbb22" containerName="payload-pre-processing" Jul 31 22:11:55.762843 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.762827 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.765764 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.765734 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5gz77\"/\"kube-root-ca.crt\"" Jul 31 22:11:55.765883 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.765795 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5gz77\"/\"openshift-service-ca.crt\"" Jul 31 22:11:55.767138 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.767120 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5gz77\"/\"default-dockercfg-67wlj\"" Jul 31 22:11:55.774060 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.774038 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h"] Jul 31 22:11:55.836654 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.836612 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-sys\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.836841 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.836690 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzjr9\" (UniqueName: \"kubernetes.io/projected/085081bf-3a86-44aa-b098-72430cebd298-kube-api-access-qzjr9\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.836841 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.836737 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-podres\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.836841 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.836790 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-lib-modules\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.836995 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.836843 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-proc\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.938099 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.938001 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzjr9\" (UniqueName: \"kubernetes.io/projected/085081bf-3a86-44aa-b098-72430cebd298-kube-api-access-qzjr9\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.938099 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.938079 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-podres\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.938099 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.938103 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-lib-modules\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.938346 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.938132 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-proc\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.938346 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.938155 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-sys\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.938346 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.938233 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-proc\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.938346 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.938238 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-sys\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.938346 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.938271 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-lib-modules\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.938346 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.938271 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/085081bf-3a86-44aa-b098-72430cebd298-podres\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:55.946523 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:55.946492 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzjr9\" (UniqueName: \"kubernetes.io/projected/085081bf-3a86-44aa-b098-72430cebd298-kube-api-access-qzjr9\") pod \"perf-node-gather-daemonset-4hq8h\" (UID: \"085081bf-3a86-44aa-b098-72430cebd298\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:56.075011 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:56.074967 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:56.224991 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:56.224962 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h"] Jul 31 22:11:56.227178 ip-10-0-135-32 kubenswrapper[2548]: W0731 22:11:56.227150 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod085081bf_3a86_44aa_b098_72430cebd298.slice/crio-6b782e11f827dcd462e0981c2a2b61d5e9a2dc9a72f0c5cd9dba8aa098454e72 WatchSource:0}: Error finding container 6b782e11f827dcd462e0981c2a2b61d5e9a2dc9a72f0c5cd9dba8aa098454e72: Status 404 returned error can't find the container with id 6b782e11f827dcd462e0981c2a2b61d5e9a2dc9a72f0c5cd9dba8aa098454e72 Jul 31 22:11:56.803579 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:56.803541 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" event={"ID":"085081bf-3a86-44aa-b098-72430cebd298","Type":"ContainerStarted","Data":"e9e071eaf447187a2f0bbe188ea8d67589112837cf18807ff4df1ce5159a20f9"} Jul 31 22:11:56.803789 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:56.803602 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" event={"ID":"085081bf-3a86-44aa-b098-72430cebd298","Type":"ContainerStarted","Data":"6b782e11f827dcd462e0981c2a2b61d5e9a2dc9a72f0c5cd9dba8aa098454e72"} Jul 31 22:11:56.803789 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:56.803643 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:11:56.820723 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:56.820668 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" podStartSLOduration=1.820652202 podStartE2EDuration="1.820652202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:11:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:11:56.819406732 +0000 UTC m=+2777.053638774" watchObservedRunningTime="2026-07-31 22:11:56.820652202 +0000 UTC m=+2777.054884242" Jul 31 22:11:56.994197 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:56.994161 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-cv4cz_a731d5f3-12c2-4b18-9158-373cd4c95585/volume-data-source-validator/0.log" Jul 31 22:11:58.095893 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:58.095843 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dgz6v_ef50ba85-4e8d-4793-bc88-a4cedb14bb0c/dns/0.log" Jul 31 22:11:58.118890 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:58.118858 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dgz6v_ef50ba85-4e8d-4793-bc88-a4cedb14bb0c/kube-rbac-proxy/0.log" Jul 31 22:11:58.240239 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:58.240208 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t7rln_7a782591-1f18-4512-b13c-8e1e8f522b75/dns-node-resolver/0.log" Jul 31 22:11:58.789952 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:58.789894 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gtjxs_5ee371d3-576a-413b-b19f-4849899c2559/node-ca/0.log" Jul 31 22:11:59.759541 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:59.759513 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f_8c25e75c-15b6-404d-999f-81f25af54d38/istio-proxy/0.log" Jul 31 22:11:59.900606 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:59.900576 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77494cc5-z4krc_623c95ff-891f-45e7-8d14-5b4453a1e996/kube-auth-proxy/0.log" Jul 31 22:11:59.931967 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:59.931939 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6mzmp_6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152/istio-proxy/0.log" Jul 31 22:11:59.938094 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:59.938070 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6mzmp_6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152/istio-proxy/1.log" Jul 31 22:11:59.970028 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:11:59.969995 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sh2p6_42e6a341-4514-4291-a19a-75a5e01a5942/payload-pre-processing/0.log" Jul 31 22:12:00.002833 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:00.002806 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8q8sh_1f6e9bda-f084-4f91-a3cc-42b1cea95f16/payload-processing/0.log" Jul 31 22:12:00.712789 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:00.712755 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vpn9n_a77b984c-43b1-4cf6-b5d1-359e19752c35/serve-healthcheck-canary/0.log" Jul 31 22:12:01.163865 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:01.163824 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-nrx4s_219f26b6-ed10-4303-8377-dcc2fb015902/insights-operator/0.log" Jul 31 22:12:01.166229 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:01.166198 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-nrx4s_219f26b6-ed10-4303-8377-dcc2fb015902/insights-operator/1.log" Jul 31 22:12:01.266250 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:01.266222 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvm6m_acb59409-232c-4e00-88c2-516280ca9169/kube-rbac-proxy/0.log" Jul 31 22:12:01.289558 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:01.289526 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvm6m_acb59409-232c-4e00-88c2-516280ca9169/exporter/0.log" Jul 31 22:12:01.313130 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:01.313082 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvm6m_acb59409-232c-4e00-88c2-516280ca9169/extractor/0.log" Jul 31 22:12:02.820575 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:02.820543 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-4hq8h" Jul 31 22:12:03.471225 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:03.471194 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gh8tp_4135e118-1cf3-407a-87d5-dc88aa9d0efb/manager/0.log" Jul 31 22:12:03.707853 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:03.707829 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-s66v6_e88a7ba5-37cc-41c6-9258-24abeb2a4403/server/0.log" Jul 31 22:12:03.760536 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:03.760433 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z6xdq_71dd4988-ddca-40cc-a95f-257c537256f5/manager/0.log" Jul 31 22:12:03.963309 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:03.963279 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b88b5667d-lvhph_293dbfff-da0a-4f7f-98ae-878863606cc3/manager/0.log" Jul 31 22:12:03.985414 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:03.985391 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b88b5667d-lvhph_293dbfff-da0a-4f7f-98ae-878863606cc3/copy-manifests/0.log" Jul 31 22:12:05.429489 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:05.429457 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vtbhn_a87fdd3d-d86a-43b0-a542-346d7d8a50df/openshift-lws-operator/0.log" Jul 31 22:12:06.056632 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:06.056552 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f_8c25e75c-15b6-404d-999f-81f25af54d38/istio-proxy/0.log" Jul 31 22:12:06.141924 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:06.141889 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77494cc5-z4krc_623c95ff-891f-45e7-8d14-5b4453a1e996/kube-auth-proxy/0.log" Jul 31 22:12:06.159642 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:06.159612 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6mzmp_6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152/istio-proxy/0.log" Jul 31 22:12:06.165843 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:06.165789 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6mzmp_6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152/istio-proxy/1.log" Jul 31 22:12:06.185040 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:06.185013 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sh2p6_42e6a341-4514-4291-a19a-75a5e01a5942/payload-pre-processing/0.log" Jul 31 22:12:06.204927 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:06.204880 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8q8sh_1f6e9bda-f084-4f91-a3cc-42b1cea95f16/payload-processing/0.log" Jul 31 22:12:07.339324 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:07.339293 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-v6x8f_8c25e75c-15b6-404d-999f-81f25af54d38/istio-proxy/0.log" Jul 31 22:12:07.435693 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:07.435607 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77494cc5-z4krc_623c95ff-891f-45e7-8d14-5b4453a1e996/kube-auth-proxy/0.log" Jul 31 22:12:07.455367 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:07.455338 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6mzmp_6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152/istio-proxy/0.log" Jul 31 22:12:07.460255 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:07.460235 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6mzmp_6fc8c5ae-cae3-46d7-8f2b-e6a1257ad152/istio-proxy/1.log" Jul 31 22:12:07.485078 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:07.485049 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sh2p6_42e6a341-4514-4291-a19a-75a5e01a5942/payload-pre-processing/0.log" Jul 31 22:12:07.506647 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:07.506616 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8q8sh_1f6e9bda-f084-4f91-a3cc-42b1cea95f16/payload-processing/0.log" Jul 31 22:12:10.874001 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:10.873964 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-4ckf8_df0856c9-b2d9-4ced-a894-76e04d2878fe/kube-storage-version-migrator-operator/1.log" Jul 31 22:12:10.875174 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:10.874894 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-4ckf8_df0856c9-b2d9-4ced-a894-76e04d2878fe/kube-storage-version-migrator-operator/0.log" Jul 31 22:12:11.813177 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:11.813145 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ns8z_768ae4f9-da78-48e2-bbea-ec89315b45b3/kube-multus-additional-cni-plugins/0.log" Jul 31 22:12:11.836446 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:11.836419 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ns8z_768ae4f9-da78-48e2-bbea-ec89315b45b3/egress-router-binary-copy/0.log" Jul 31 22:12:11.859574 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:11.859542 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ns8z_768ae4f9-da78-48e2-bbea-ec89315b45b3/cni-plugins/0.log" Jul 31 22:12:11.884754 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:11.884729 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ns8z_768ae4f9-da78-48e2-bbea-ec89315b45b3/bond-cni-plugin/0.log" Jul 31 22:12:11.910122 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:11.910099 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ns8z_768ae4f9-da78-48e2-bbea-ec89315b45b3/routeoverride-cni/0.log" Jul 31 22:12:11.931832 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:11.931807 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ns8z_768ae4f9-da78-48e2-bbea-ec89315b45b3/whereabouts-cni-bincopy/0.log" Jul 31 22:12:11.953376 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:11.953350 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ns8z_768ae4f9-da78-48e2-bbea-ec89315b45b3/whereabouts-cni/0.log" Jul 31 22:12:12.368738 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:12.368711 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ctskt_ed93ff1d-8caf-444e-a7b9-70bd146a7f59/kube-multus/0.log" Jul 31 22:12:12.421596 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:12.421567 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-brfzt_a359de99-657c-4c35-bf34-31ef06ddfbc6/network-metrics-daemon/0.log" Jul 31 22:12:12.447246 ip-10-0-135-32 kubenswrapper[2548]: I0731 22:12:12.447220 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-brfzt_a359de99-657c-4c35-bf34-31ef06ddfbc6/kube-rbac-proxy/0.log"