Jul 08 18:14:26.059332 ip-10-0-130-26 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 18:14:26.059342 ip-10-0-130-26 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 18:14:26.059350 ip-10-0-130-26 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 18:14:26.059594 ip-10-0-130-26 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 18:14:36.126387 ip-10-0-130-26 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 18:14:36.126406 ip-10-0-130-26 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e96e8667c0874fccbc29dec3677165dd -- Jul 08 18:16:40.862712 ip-10-0-130-26 systemd[1]: Starting Kubernetes Kubelet... Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.305392 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309445 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309468 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309472 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309476 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309479 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309482 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309485 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:41.392351 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309488 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:41.384621 ip-10-0-130-26 systemd[1]: Started Kubernetes Kubelet. Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309491 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309500 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309505 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309508 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309511 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309513 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309517 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309520 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309523 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309526 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309529 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309533 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309535 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309540 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309543 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309546 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309549 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309551 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309555 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:41.394118 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309557 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309560 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309563 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309566 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309570 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309572 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309575 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309578 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309581 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309583 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309586 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309589 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309592 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309594 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309597 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309600 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309604 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309606 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309609 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:41.395790 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309612 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309617 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309621 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309624 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309628 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309631 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309634 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309637 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309640 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309644 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309646 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309649 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309653 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309655 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309658 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309661 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309664 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309668 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309671 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:41.396725 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309674 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309677 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309680 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309683 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309686 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309689 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309692 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309694 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309697 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309700 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309704 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309709 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309713 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309717 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309720 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309723 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309728 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309731 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309734 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309738 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:41.397976 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309741 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309743 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309746 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309750 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309754 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309757 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309760 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309772 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309777 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309781 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309788 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309794 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309799 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.309802 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.310983 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.310991 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.310996 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311001 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311005 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311009 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:41.399000 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311013 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311017 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311022 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311026 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311031 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311035 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311039 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311043 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311048 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311052 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311057 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311062 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311066 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311070 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311074 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311079 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311083 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311087 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311092 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311096 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:41.399812 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311101 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311105 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311109 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311114 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311118 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311124 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311128 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311134 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311140 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311148 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311153 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311157 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311162 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311167 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311172 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311176 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311180 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311184 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311189 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:41.400863 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311193 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311198 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311202 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311206 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311210 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311213 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311217 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311221 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311225 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311229 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311233 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311239 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311246 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311250 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311255 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311258 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311264 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311270 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311275 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:41.401885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311280 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311285 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311289 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311293 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311298 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311303 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311307 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311311 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311316 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311320 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311324 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311328 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311332 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311336 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311342 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311346 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311350 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311354 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311358 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311362 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:41.402641 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311367 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311371 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311375 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311380 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311384 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311389 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311393 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311398 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311402 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311406 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311410 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311415 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311419 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311424 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.311446 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312112 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312119 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312124 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312128 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312132 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:41.403383 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312136 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312139 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312142 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312147 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312151 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312154 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312157 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312161 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312164 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312168 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312172 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312176 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312179 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312181 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312185 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312189 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312192 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312198 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312201 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312204 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:41.404151 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312207 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312211 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312214 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312217 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312222 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312226 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312230 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312235 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312238 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312242 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312246 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312250 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312253 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312256 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312260 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312263 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312268 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312273 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312276 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:41.406940 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312280 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312284 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312288 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312291 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312293 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312298 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312301 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312303 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312307 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312312 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312319 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312322 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312325 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312328 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312331 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312333 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312338 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312350 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312355 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:41.407659 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312359 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312362 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312366 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312396 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312400 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312406 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312409 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312412 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312415 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312419 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312422 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312425 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312447 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312450 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312453 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312457 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312460 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312462 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312466 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312471 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:41.408364 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312474 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312476 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312480 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312485 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312488 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312492 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312496 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312499 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312502 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312508 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312511 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312521 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312525 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312528 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312532 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.312534 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312622 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312633 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312643 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312650 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312656 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 18:16:41.409887 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312660 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312676 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312681 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312685 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312691 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312695 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312699 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312704 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312708 2576 flags.go:64] FLAG: --cgroup-root="" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312712 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312716 2576 flags.go:64] FLAG: --client-ca-file="" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312720 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312724 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312730 2576 flags.go:64] FLAG: --cluster-domain="" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312735 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312740 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312744 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312748 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312754 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312758 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312765 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312768 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312772 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312776 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 18:16:41.410629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312780 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312785 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312788 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312793 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312798 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312801 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312804 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312809 2576 flags.go:64] FLAG: --enable-server="true" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312813 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312819 2576 flags.go:64] FLAG: --event-burst="100" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312824 2576 flags.go:64] FLAG: --event-qps="50" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312828 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312832 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312837 2576 flags.go:64] FLAG: --eviction-hard="" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312842 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312846 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312850 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312854 2576 flags.go:64] FLAG: --eviction-soft="" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312858 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312862 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312865 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312868 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312874 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312877 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312880 2576 flags.go:64] FLAG: --feature-gates="" Jul 08 18:16:41.411796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312886 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312892 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312896 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312903 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312908 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312912 2576 flags.go:64] FLAG: --help="false" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312915 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312921 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312925 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312928 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312933 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312937 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312940 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312944 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312949 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312952 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312956 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312961 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312964 2576 flags.go:64] FLAG: --kube-reserved="" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312968 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312973 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312976 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312980 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312984 2576 flags.go:64] FLAG: --lock-file="" Jul 08 18:16:41.412882 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312987 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312990 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312994 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.312999 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313004 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313009 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313012 2576 flags.go:64] FLAG: --logging-format="text" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313016 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313020 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313023 2576 flags.go:64] FLAG: --manifest-url="" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313027 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313034 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313039 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313044 2576 flags.go:64] FLAG: --max-pods="110" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313048 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313052 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313057 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313061 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313065 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313069 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313073 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313083 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313087 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313091 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 18:16:41.413756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313095 2576 flags.go:64] FLAG: --pod-cidr="" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313098 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313107 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313111 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313115 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313119 2576 flags.go:64] FLAG: --port="10250" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313122 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313126 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b5059f2886f9f3ef" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313131 2576 flags.go:64] FLAG: --qos-reserved="" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313134 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313138 2576 flags.go:64] FLAG: --register-node="true" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313143 2576 flags.go:64] FLAG: --register-with-taints="" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313147 2576 flags.go:64] FLAG: --registry-burst="10" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313152 2576 flags.go:64] FLAG: --registry-qps="5" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313156 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313159 2576 flags.go:64] FLAG: --reserved-memory="" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313165 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313168 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313171 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313176 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313181 2576 flags.go:64] FLAG: --runonce="false" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313185 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313189 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313193 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313197 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 18:16:41.415407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313203 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313207 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313210 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313214 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313218 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313222 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313226 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313229 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313234 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313238 2576 flags.go:64] FLAG: --system-cgroups="" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313241 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313249 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313252 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313256 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313262 2576 flags.go:64] FLAG: --tls-min-version="" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313265 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313269 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313274 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313279 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313284 2576 flags.go:64] FLAG: --v="2" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313290 2576 flags.go:64] FLAG: --version="false" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313296 2576 flags.go:64] FLAG: --vmodule="" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313300 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313304 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313477 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:41.417081 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313482 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313485 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313492 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313497 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313502 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313505 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313508 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313513 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313521 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313525 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313529 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313532 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313535 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313539 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313542 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313545 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313549 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313553 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313556 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:41.418957 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313559 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313563 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313566 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313571 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313576 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313579 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313583 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313588 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313593 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313596 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313601 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313604 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313607 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313611 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313614 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313618 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313623 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313626 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313630 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313634 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:41.420152 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313637 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313640 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313645 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313648 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313651 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313654 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313658 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313661 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313664 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313667 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313671 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313675 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313677 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313683 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313686 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313690 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313695 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313698 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313701 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313704 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:41.421262 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313709 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313712 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313715 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313719 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313722 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313725 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313729 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313734 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313737 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313740 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313745 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313748 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313751 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313756 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313759 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313764 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313768 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313773 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313777 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:41.421921 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313782 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313785 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313788 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313791 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313795 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313797 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313802 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313806 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313809 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313812 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313816 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313819 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313822 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313828 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313832 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313835 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313839 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313843 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313846 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:41.422811 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.313850 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.313858 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.323063 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.323091 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.323116 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.323125 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.323194 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.323301 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.323310 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.323314 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.323318 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.323321 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.323325 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324332 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:41.423481 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324344 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324352 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324358 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324364 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324369 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324384 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324388 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324400 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324405 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324410 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324414 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324420 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324425 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324443 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324448 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324453 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324458 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324465 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324475 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:41.424149 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324486 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324491 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324500 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324504 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324509 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324514 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324521 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324528 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324533 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324538 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324543 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324553 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324559 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324563 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324569 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324574 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324579 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324583 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324589 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:41.425066 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324593 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324598 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324604 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324609 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324614 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324624 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324627 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324632 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324635 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324638 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324641 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324644 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324647 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324652 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324655 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324662 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324666 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324673 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324676 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324680 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:41.426045 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324683 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324686 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324689 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324692 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324695 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324698 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324701 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324705 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324707 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324710 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324719 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324885 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324911 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324917 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324921 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324926 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324929 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324932 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324936 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324939 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:41.427030 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324942 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324945 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324948 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324951 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324954 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324957 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324963 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324968 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324972 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324976 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324980 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324985 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.324988 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.324994 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325170 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:41.428393 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325177 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325180 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325184 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325187 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325190 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325193 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325199 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325202 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325207 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325211 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325215 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325219 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325223 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325226 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325229 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325232 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325235 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325238 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325240 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325243 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:41.429483 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325246 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325249 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325252 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325254 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325257 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325262 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325266 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325270 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325273 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325276 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325280 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325283 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325286 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325289 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325292 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325295 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325298 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325301 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325305 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325308 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:41.542117 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325311 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325315 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325317 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325320 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325324 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325327 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325330 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325333 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325336 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325339 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325342 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325345 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325348 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325351 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325354 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325358 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325362 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325366 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325370 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:41.558644 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325373 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325377 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325380 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325383 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325386 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325389 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325391 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325394 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325397 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325400 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325403 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325407 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325410 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325413 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325416 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325419 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325422 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325449 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325453 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325456 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:41.559384 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325460 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325463 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325466 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325469 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325472 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325475 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325478 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325481 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325484 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325487 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325491 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325494 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325498 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325501 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325504 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325507 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325510 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325513 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:41.560129 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:41.325516 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.325522 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.325691 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.328325 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.329741 2576 server.go:1019] "Starting client certificate rotation" Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.332797 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.333328 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.333379 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.334248 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.345307 2576 log.go:25] "Validated CRI v1 runtime API" Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.349912 2576 log.go:25] "Validated CRI v1 image API" Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.351068 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 18:16:41.561078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.353832 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9a06c6a4-a500-4ef2-8aad-915bd889c60b:/dev/nvme0n1p4 a579f0c9-4a6f-4ee7-b722-afa58a99ff0a:/dev/nvme0n1p3] Jul 08 18:16:41.561685 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.353861 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 18:16:41.561902 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.360586 2576 manager.go:216] Machine: {Timestamp:2026-07-08 18:16:41.358037593 +0000 UTC m=+0.372264663 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105240 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22d683bf158cbdab7fc8ede38ed4fa SystemUUID:ec22d683-bf15-8cbd-ab7f-c8ede38ed4fa BootID:e96e8667-c087-4fcc-bc29-dec3677165dd Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f2:c2:c4:3d:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f2:c2:c4:3d:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:99:fa:5d:66:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 18:16:41.561902 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.360727 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 18:16:41.561902 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.360933 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 18:16:41.561902 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.364284 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:16:41.561902 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.364307 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 18:16:41.561902 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.364353 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 18:16:41.561902 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.365204 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.365223 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.365235 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.366195 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.367625 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.370884 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.371043 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.371078 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.371089 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.371107 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.371118 2576 kubelet.go:398] "Adding apiserver pod source" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.371133 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.371560 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.371579 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.375099 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.377192 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.377228 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378319 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378337 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378343 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378352 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378366 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378374 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378383 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378390 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378397 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378403 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378413 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.378419 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.379187 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.379206 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.383261 2576 server.go:1268] "Started kubelet" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.383346 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.383863 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.384053 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.384839 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.384905 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.384994 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.385966 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.386264 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 18:16:41.562235 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.389164 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.388810 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-26.ec2.internal.18c063453810a019 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-26.ec2.internal,UID:ip-10-0-130-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-26.ec2.internal,},FirstTimestamp:2026-07-08 18:16:41.383223321 +0000 UTC m=+0.397450391,LastTimestamp:2026-07-08 18:16:41.383223321 +0000 UTC m=+0.397450391,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-26.ec2.internal,}" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.392035 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.392646 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.394454 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.395007 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.395026 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.395176 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.395348 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.395359 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.396201 2576 factory.go:55] Registering systemd factory Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.396243 2576 factory.go:223] Registration of the systemd container factory successfully Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.396564 2576 factory.go:153] Registering CRI-O factory Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.396580 2576 factory.go:223] Registration of the crio container factory successfully Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.396638 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.396668 2576 factory.go:103] Registering Raw factory Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.396689 2576 manager.go:1196] Started watching for new ooms in manager Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.397204 2576 manager.go:349] Starting recovery of all containers Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.407217 2576 manager.go:354] Recovery completed Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.414800 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.414914 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.419564 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.429862 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.429912 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.429932 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.430865 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.430884 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.430888 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:41.564548 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.430906 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.432152 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-26.ec2.internal.18c063453ad8b22c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-26.ec2.internal,UID:ip-10-0-130-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-26.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-26.ec2.internal,},FirstTimestamp:2026-07-08 18:16:41.42988958 +0000 UTC m=+0.444116654,LastTimestamp:2026-07-08 18:16:41.42988958 +0000 UTC m=+0.444116654,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-26.ec2.internal,}" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.432318 2576 policy_none.go:49] "None policy: Start" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.432340 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.432356 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.432734 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.432768 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.432784 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.433327 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-26qq6" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.433630 2576 policy_none.go:47] "Start" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.440667 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-26qq6" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.441192 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-26.ec2.internal.18c063453ad930a8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-26.ec2.internal,UID:ip-10-0-130-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-26.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-26.ec2.internal,},FirstTimestamp:2026-07-08 18:16:41.42992196 +0000 UTC m=+0.444149031,LastTimestamp:2026-07-08 18:16:41.42992196 +0000 UTC m=+0.444149031,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-26.ec2.internal,}" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.482325 2576 manager.go:337] "Starting Device Plugin manager" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.482632 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.482645 2576 server.go:87] "Starting device plugin registration server" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.482923 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.482937 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.483060 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.483178 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.483187 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.483748 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 18:16:41.565510 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.483794 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.583087 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.584288 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.584336 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.584348 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.584396 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.591585 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.591632 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-26.ec2.internal\": node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.603422 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.649872 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.651246 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.651291 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.651315 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.651357 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.654329 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:16:41.745872 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.704457 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.754433 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-26.ec2.internal"] Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.754538 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.755793 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.755835 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.755851 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.757280 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.757407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.757448 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.758277 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.758311 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.758323 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.758277 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.758400 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.758415 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.759663 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.759695 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.760707 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.760735 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.760750 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.800874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f5506128a4bbd1572e3fc77d9f9f209-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal\" (UID: \"7f5506128a4bbd1572e3fc77d9f9f209\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.804944 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.806782 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-26.ec2.internal\" not found" node="ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.811842 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-26.ec2.internal\" not found" node="ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.902634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f5506128a4bbd1572e3fc77d9f9f209-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal\" (UID: \"7f5506128a4bbd1572e3fc77d9f9f209\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.938776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.902683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5506128a4bbd1572e3fc77d9f9f209-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal\" (UID: \"7f5506128a4bbd1572e3fc77d9f9f209\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.939694 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.902706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/537b291d55a88c57e658b0d66fcf4efc-config\") pod \"kube-apiserver-proxy-ip-10-0-130-26.ec2.internal\" (UID: \"537b291d55a88c57e658b0d66fcf4efc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.939694 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:41.902768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f5506128a4bbd1572e3fc77d9f9f209-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal\" (UID: \"7f5506128a4bbd1572e3fc77d9f9f209\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" Jul 08 18:16:41.939694 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:41.905682 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:42.144817 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.003897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5506128a4bbd1572e3fc77d9f9f209-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal\" (UID: \"7f5506128a4bbd1572e3fc77d9f9f209\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" Jul 08 18:16:42.144817 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.003957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/537b291d55a88c57e658b0d66fcf4efc-config\") pod \"kube-apiserver-proxy-ip-10-0-130-26.ec2.internal\" (UID: \"537b291d55a88c57e658b0d66fcf4efc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-26.ec2.internal" Jul 08 18:16:42.144817 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.004026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5506128a4bbd1572e3fc77d9f9f209-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal\" (UID: \"7f5506128a4bbd1572e3fc77d9f9f209\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" Jul 08 18:16:42.144817 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.004029 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/537b291d55a88c57e658b0d66fcf4efc-config\") pod \"kube-apiserver-proxy-ip-10-0-130-26.ec2.internal\" (UID: \"537b291d55a88c57e658b0d66fcf4efc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-26.ec2.internal" Jul 08 18:16:42.144817 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:42.006167 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:42.144817 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:42.106975 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:42.144817 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.110289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" Jul 08 18:16:42.144817 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.115524 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-26.ec2.internal" Jul 08 18:16:42.335690 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:42.207870 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:42.335690 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:42.309074 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:42.335690 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.334259 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 18:16:42.335690 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.334509 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 18:16:42.511201 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:42.410183 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:42.511201 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.443760 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 18:11:42 +0000 UTC" deadline="2028-03-18 07:29:21.647167998 +0000 UTC" Jul 08 18:16:42.511201 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.443811 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14845h12m39.203360499s" Jul 08 18:16:42.511201 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:42.510324 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:42.610020 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.609979 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:42.610530 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:42.610508 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:42.611296 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.611275 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:42.611435 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.611309 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:42.611435 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.611320 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:42.615870 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.615844 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:16:42.711165 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:42.711117 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:42.771874 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:42.771796 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5506128a4bbd1572e3fc77d9f9f209.slice/crio-b22c2088546447585e3409a1fdd219e80e72629b37fb1cf81bfdf1dd6d7e9a8f WatchSource:0}: Error finding container b22c2088546447585e3409a1fdd219e80e72629b37fb1cf81bfdf1dd6d7e9a8f: Status 404 returned error can't find the container with id b22c2088546447585e3409a1fdd219e80e72629b37fb1cf81bfdf1dd6d7e9a8f Jul 08 18:16:42.777559 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.777535 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:16:42.811916 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:42.811878 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-26.ec2.internal\" not found" Jul 08 18:16:42.836652 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.836624 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:16:42.849370 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:42.849329 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537b291d55a88c57e658b0d66fcf4efc.slice/crio-c005f8836c42e7b7cbdde64da8000a71854abf2f5c957a07342a5b17c8b6979c WatchSource:0}: Error finding container c005f8836c42e7b7cbdde64da8000a71854abf2f5c957a07342a5b17c8b6979c: Status 404 returned error can't find the container with id c005f8836c42e7b7cbdde64da8000a71854abf2f5c957a07342a5b17c8b6979c Jul 08 18:16:42.857837 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.857804 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:16:42.896157 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.896103 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" Jul 08 18:16:42.909933 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.909903 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:16:42.910905 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.910889 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-26.ec2.internal" Jul 08 18:16:42.920649 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:42.920621 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:16:43.372918 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.372883 2576 apiserver.go:52] "Watching apiserver" Jul 08 18:16:43.380598 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.380562 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 18:16:43.381009 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.380980 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-26.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wx5bs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal","openshift-multus/multus-additional-cni-plugins-4ws4q","openshift-multus/network-metrics-daemon-tngjv","openshift-ovn-kubernetes/ovnkube-node-8rl42","kube-system/global-pull-secret-syncer-4tl96","kube-system/konnectivity-agent-rc4kr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw","openshift-dns/node-resolver-8dmgl","openshift-image-registry/node-ca-zbmxw","openshift-multus/multus-v8sfq","openshift-network-diagnostics/network-check-target-cssf9","openshift-network-operator/iptables-alerter-gt9cd"] Jul 08 18:16:43.382686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.382658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:43.382839 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:43.382758 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:16:43.383827 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.383805 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:43.383955 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:43.383879 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:16:43.385011 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.384981 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gt9cd" Jul 08 18:16:43.386515 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.386493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.387450 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.387352 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:16:43.387450 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.387439 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 18:16:43.387619 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.387485 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 18:16:43.387700 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.387674 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qf2rs\"" Jul 08 18:16:43.387858 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.387836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:43.387980 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:43.387937 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:16:43.388586 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.388565 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 18:16:43.388854 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.388839 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 18:16:43.388960 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.388842 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hbx49\"" Jul 08 18:16:43.389232 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.389211 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 18:16:43.389232 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.389234 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 18:16:43.389472 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.389356 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 18:16:43.389584 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.389563 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.391231 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.391212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.391654 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.391630 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 18:16:43.391914 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.391869 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 18:16:43.392282 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.392264 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 18:16:43.392408 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.392390 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 18:16:43.392504 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.392491 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 18:16:43.392601 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.392585 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p2zt4\"" Jul 08 18:16:43.392667 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.392653 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 18:16:43.393064 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.392899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:16:43.393634 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.393610 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 18:16:43.394081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.394049 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 18:16:43.394185 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.394118 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 18:16:43.394407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.394374 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.394772 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.394752 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7mvwc\"" Jul 08 18:16:43.395281 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.395261 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vrxsc\"" Jul 08 18:16:43.395402 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.395261 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 18:16:43.395402 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.395342 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 18:16:43.395841 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.395578 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 18:16:43.396186 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.396146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8dmgl" Jul 08 18:16:43.396794 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.396778 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 18:16:43.396916 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.396816 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2np8g\"" Jul 08 18:16:43.397176 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.397156 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:16:43.397866 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.397847 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zbmxw" Jul 08 18:16:43.398467 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.398419 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-42bvq\"" Jul 08 18:16:43.398572 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.398518 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 18:16:43.399129 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.399104 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 18:16:43.399771 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.399619 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.400183 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.400162 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 18:16:43.400515 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.400481 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 18:16:43.400515 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.400489 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 18:16:43.401170 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.401135 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m22tp\"" Jul 08 18:16:43.402414 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.402150 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4slbl\"" Jul 08 18:16:43.402414 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.402334 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 18:16:43.406690 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.406485 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:16:43.413145 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-run-netns\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.413317 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.413317 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cff52718-1619-4071-af70-b7a6d040bcb8-ovnkube-config\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.413317 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-lib-modules\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.413317 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7662b55-a0d9-457d-a19f-8b2b1db85a6f-hosts-file\") pod \"node-resolver-8dmgl\" (UID: \"b7662b55-a0d9-457d-a19f-8b2b1db85a6f\") " pod="openshift-dns/node-resolver-8dmgl" Jul 08 18:16:43.413317 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cff52718-1619-4071-af70-b7a6d040bcb8-ovn-node-metrics-cert\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.413317 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cff52718-1619-4071-af70-b7a6d040bcb8-ovnkube-script-lib\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.413317 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2brs\" (UniqueName: \"kubernetes.io/projected/cff52718-1619-4071-af70-b7a6d040bcb8-kube-api-access-g2brs\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.413693 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-device-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.413693 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.413693 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-sys-fs\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.413693 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-sysctl-d\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.413693 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-kubelet-config\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:43.413693 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.413693 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.413582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxmg8\" (UniqueName: \"kubernetes.io/projected/f4fa372f-98c3-4c68-8bea-da69a6550422-kube-api-access-lxmg8\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:43.414274 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-slash\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.414381 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:43.414381 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-system-cni-dir\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.414381 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-os-release\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.414554 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.414554 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-cni-bin\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.414554 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.414554 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-node-log\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.414554 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-socket-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.414554 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-modprobe-d\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.414803 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnj2l\" (UniqueName: \"kubernetes.io/projected/27c9b907-2658-4851-bbd2-00734ceaecdd-kube-api-access-nnj2l\") pod \"iptables-alerter-gt9cd\" (UID: \"27c9b907-2658-4851-bbd2-00734ceaecdd\") " pod="openshift-network-operator/iptables-alerter-gt9cd" Jul 08 18:16:43.414803 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68g77\" (UniqueName: \"kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77\") pod \"network-check-target-cssf9\" (UID: \"3597d6aa-69d3-4e61-80b0-57c304ca013c\") " pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:43.414803 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27c9b907-2658-4851-bbd2-00734ceaecdd-iptables-alerter-script\") pod \"iptables-alerter-gt9cd\" (UID: \"27c9b907-2658-4851-bbd2-00734ceaecdd\") " pod="openshift-network-operator/iptables-alerter-gt9cd" Jul 08 18:16:43.414803 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-cnibin\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.414803 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-kubelet\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.414803 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-run-ovn\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.415061 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-sysconfig\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.415061 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-tuned\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.415061 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-dbus\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:43.415061 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.415061 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.415061 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.414983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3e63b4f-08bb-4fa9-8581-3bc863976c06-konnectivity-ca\") pod \"konnectivity-agent-rc4kr\" (UID: \"e3e63b4f-08bb-4fa9-8581-3bc863976c06\") " pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:16:43.415061 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7486cfff-3439-4288-83c5-f9bdb1d23977-tmp\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.415061 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brgx8\" (UniqueName: \"kubernetes.io/projected/b7662b55-a0d9-457d-a19f-8b2b1db85a6f-kube-api-access-brgx8\") pod \"node-resolver-8dmgl\" (UID: \"b7662b55-a0d9-457d-a19f-8b2b1db85a6f\") " pod="openshift-dns/node-resolver-8dmgl" Jul 08 18:16:43.415345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:43.415345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-run-systemd\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.415345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-run\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.415345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-var-lib-openvswitch\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.415345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-registration-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.415345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-sys\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.415345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7j5j\" (UniqueName: \"kubernetes.io/projected/7486cfff-3439-4288-83c5-f9bdb1d23977-kube-api-access-g7j5j\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.415345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7662b55-a0d9-457d-a19f-8b2b1db85a6f-tmp-dir\") pod \"node-resolver-8dmgl\" (UID: \"b7662b55-a0d9-457d-a19f-8b2b1db85a6f\") " pod="openshift-dns/node-resolver-8dmgl" Jul 08 18:16:43.415345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx7tw\" (UniqueName: \"kubernetes.io/projected/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-kube-api-access-bx7tw\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.415345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm5bd\" (UniqueName: \"kubernetes.io/projected/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-kube-api-access-gm5bd\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.415345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cff52718-1619-4071-af70-b7a6d040bcb8-env-overrides\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-systemd-units\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-log-socket\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-host\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415451 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-sysctl-conf\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-run-openvswitch\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-cni-netd\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3e63b4f-08bb-4fa9-8581-3bc863976c06-agent-certs\") pod \"konnectivity-agent-rc4kr\" (UID: \"e3e63b4f-08bb-4fa9-8581-3bc863976c06\") " pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-systemd\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-etc-openvswitch\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-kubernetes\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-var-lib-kubelet\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.415910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.415830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27c9b907-2658-4851-bbd2-00734ceaecdd-host-slash\") pod \"iptables-alerter-gt9cd\" (UID: \"27c9b907-2658-4851-bbd2-00734ceaecdd\") " pod="openshift-network-operator/iptables-alerter-gt9cd" Jul 08 18:16:43.429421 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.429368 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5s6cm" Jul 08 18:16:43.433557 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.433524 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:16:43.437873 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.437843 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5s6cm" Jul 08 18:16:43.496271 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.496236 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 18:16:43.516898 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.516849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5bd\" (UniqueName: \"kubernetes.io/projected/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-kube-api-access-gm5bd\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.516904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-socket-dir-parent\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.516933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cff52718-1619-4071-af70-b7a6d040bcb8-env-overrides\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.516987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-cnibin\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-cni-binary-copy\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-systemd-units\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-log-socket\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-host\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-run-multus-certs\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517144 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-systemd-units\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-etc-kubernetes\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-log-socket\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517187 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-host\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-sysctl-conf\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-run-openvswitch\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.517728 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-cni-netd\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3e63b4f-08bb-4fa9-8581-3bc863976c06-agent-certs\") pod \"konnectivity-agent-rc4kr\" (UID: \"e3e63b4f-08bb-4fa9-8581-3bc863976c06\") " pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517327 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-cni-netd\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517326 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-run-openvswitch\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-sysctl-conf\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-system-cni-dir\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-systemd\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-etc-openvswitch\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-kubernetes\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-var-lib-kubelet\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517502 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-systemd\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27c9b907-2658-4851-bbd2-00734ceaecdd-host-slash\") pod \"iptables-alerter-gt9cd\" (UID: \"27c9b907-2658-4851-bbd2-00734ceaecdd\") " pod="openshift-network-operator/iptables-alerter-gt9cd" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-kubernetes\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.518495 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-run-netns\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-etc-openvswitch\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517557 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cff52718-1619-4071-af70-b7a6d040bcb8-env-overrides\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517558 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-var-lib-kubelet\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27c9b907-2658-4851-bbd2-00734ceaecdd-host-slash\") pod \"iptables-alerter-gt9cd\" (UID: \"27c9b907-2658-4851-bbd2-00734ceaecdd\") " pod="openshift-network-operator/iptables-alerter-gt9cd" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-run-netns\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cff52718-1619-4071-af70-b7a6d040bcb8-ovnkube-config\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-lib-modules\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7662b55-a0d9-457d-a19f-8b2b1db85a6f-hosts-file\") pod \"node-resolver-8dmgl\" (UID: \"b7662b55-a0d9-457d-a19f-8b2b1db85a6f\") " pod="openshift-dns/node-resolver-8dmgl" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517706 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72892583-5a63-47ab-bb5c-957e69be5460-host\") pod \"node-ca-zbmxw\" (UID: \"72892583-5a63-47ab-bb5c-957e69be5460\") " pod="openshift-image-registry/node-ca-zbmxw" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-cni-dir\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517779 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7662b55-a0d9-457d-a19f-8b2b1db85a6f-hosts-file\") pod \"node-resolver-8dmgl\" (UID: \"b7662b55-a0d9-457d-a19f-8b2b1db85a6f\") " pod="openshift-dns/node-resolver-8dmgl" Jul 08 18:16:43.519180 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cff52718-1619-4071-af70-b7a6d040bcb8-ovn-node-metrics-cert\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cff52718-1619-4071-af70-b7a6d040bcb8-ovnkube-script-lib\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517846 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-lib-modules\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2brs\" (UniqueName: \"kubernetes.io/projected/cff52718-1619-4071-af70-b7a6d040bcb8-kube-api-access-g2brs\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-device-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-sys-fs\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.517992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-sysctl-d\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72892583-5a63-47ab-bb5c-957e69be5460-serviceca\") pod \"node-ca-zbmxw\" (UID: \"72892583-5a63-47ab-bb5c-957e69be5460\") " pod="openshift-image-registry/node-ca-zbmxw" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-kubelet-config\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518054 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxmg8\" (UniqueName: \"kubernetes.io/projected/f4fa372f-98c3-4c68-8bea-da69a6550422-kube-api-access-lxmg8\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-slash\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.519966 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518141 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-sys-fs\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-run-netns\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518187 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-var-lib-cni-multus\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-device-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518197 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cff52718-1619-4071-af70-b7a6d040bcb8-ovnkube-config\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518267 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-sysctl-d\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-system-cni-dir\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-os-release\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-kubelet-config\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-cni-bin\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-system-cni-dir\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.520725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cff52718-1619-4071-af70-b7a6d040bcb8-ovnkube-script-lib\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-slash\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-node-log\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:43.518533 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-os-release\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518567 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-cni-bin\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-socket-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-modprobe-d\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:43.518620 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs podName:f4fa372f-98c3-4c68-8bea-da69a6550422 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:44.018597857 +0000 UTC m=+3.032824929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs") pod "network-metrics-daemon-tngjv" (UID: "f4fa372f-98c3-4c68-8bea-da69a6550422") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-socket-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-node-log\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.521459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4zgn\" (UniqueName: \"kubernetes.io/projected/72892583-5a63-47ab-bb5c-957e69be5460-kube-api-access-t4zgn\") pod \"node-ca-zbmxw\" (UID: \"72892583-5a63-47ab-bb5c-957e69be5460\") " pod="openshift-image-registry/node-ca-zbmxw" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-os-release\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518689 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-modprobe-d\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnj2l\" (UniqueName: \"kubernetes.io/projected/27c9b907-2658-4851-bbd2-00734ceaecdd-kube-api-access-nnj2l\") pod \"iptables-alerter-gt9cd\" (UID: \"27c9b907-2658-4851-bbd2-00734ceaecdd\") " pod="openshift-network-operator/iptables-alerter-gt9cd" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-var-lib-kubelet\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68g77\" (UniqueName: \"kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77\") pod \"network-check-target-cssf9\" (UID: \"3597d6aa-69d3-4e61-80b0-57c304ca013c\") " pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27c9b907-2658-4851-bbd2-00734ceaecdd-iptables-alerter-script\") pod \"iptables-alerter-gt9cd\" (UID: \"27c9b907-2658-4851-bbd2-00734ceaecdd\") " pod="openshift-network-operator/iptables-alerter-gt9cd" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-cnibin\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-kubelet\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-run-ovn\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-sysconfig\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518881 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-cnibin\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-tuned\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-run-k8s-cni-cncf-io\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.522105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-dbus\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.518990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3e63b4f-08bb-4fa9-8581-3bc863976c06-konnectivity-ca\") pod \"konnectivity-agent-rc4kr\" (UID: \"e3e63b4f-08bb-4fa9-8581-3bc863976c06\") " pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7486cfff-3439-4288-83c5-f9bdb1d23977-tmp\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-var-lib-cni-bin\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-conf-dir\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brgx8\" (UniqueName: \"kubernetes.io/projected/b7662b55-a0d9-457d-a19f-8b2b1db85a6f-kube-api-access-brgx8\") pod \"node-resolver-8dmgl\" (UID: \"b7662b55-a0d9-457d-a19f-8b2b1db85a6f\") " pod="openshift-dns/node-resolver-8dmgl" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519144 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-host-kubelet\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-dbus\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-daemon-config\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-sysconfig\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.522686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-run-systemd\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-run\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-var-lib-openvswitch\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-registration-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-sys\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27c9b907-2658-4851-bbd2-00734ceaecdd-iptables-alerter-script\") pod \"iptables-alerter-gt9cd\" (UID: \"27c9b907-2658-4851-bbd2-00734ceaecdd\") " pod="openshift-network-operator/iptables-alerter-gt9cd" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7j5j\" (UniqueName: \"kubernetes.io/projected/7486cfff-3439-4288-83c5-f9bdb1d23977-kube-api-access-g7j5j\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519397 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7662b55-a0d9-457d-a19f-8b2b1db85a6f-tmp-dir\") pod \"node-resolver-8dmgl\" (UID: \"b7662b55-a0d9-457d-a19f-8b2b1db85a6f\") " pod="openshift-dns/node-resolver-8dmgl" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-hostroot\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzv6m\" (UniqueName: \"kubernetes.io/projected/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-kube-api-access-mzv6m\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:43.519468 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx7tw\" (UniqueName: \"kubernetes.io/projected/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-kube-api-access-bx7tw\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:43.519524 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret podName:ff0b27c4-6651-41d5-bbb0-9d13194da0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:16:44.019506855 +0000 UTC m=+3.033733929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret") pod "global-pull-secret-syncer-4tl96" (UID: "ff0b27c4-6651-41d5-bbb0-9d13194da0ce") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519575 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-run-systemd\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.523096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-registration-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519719 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-sys\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519756 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-var-lib-openvswitch\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7486cfff-3439-4288-83c5-f9bdb1d23977-run\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.519878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.520061 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7662b55-a0d9-457d-a19f-8b2b1db85a6f-tmp-dir\") pod \"node-resolver-8dmgl\" (UID: \"b7662b55-a0d9-457d-a19f-8b2b1db85a6f\") " pod="openshift-dns/node-resolver-8dmgl" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.520139 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cff52718-1619-4071-af70-b7a6d040bcb8-run-ovn\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.520449 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3e63b4f-08bb-4fa9-8581-3bc863976c06-konnectivity-ca\") pod \"konnectivity-agent-rc4kr\" (UID: \"e3e63b4f-08bb-4fa9-8581-3bc863976c06\") " pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.520447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.521868 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cff52718-1619-4071-af70-b7a6d040bcb8-ovn-node-metrics-cert\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.521876 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7486cfff-3439-4288-83c5-f9bdb1d23977-tmp\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.521965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3e63b4f-08bb-4fa9-8581-3bc863976c06-agent-certs\") pod \"konnectivity-agent-rc4kr\" (UID: \"e3e63b4f-08bb-4fa9-8581-3bc863976c06\") " pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:16:43.523582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.522052 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7486cfff-3439-4288-83c5-f9bdb1d23977-etc-tuned\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.526654 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:43.526627 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:43.526880 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:43.526857 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:43.526880 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:43.526883 2576 projected.go:196] Error preparing data for projected volume kube-api-access-68g77 for pod openshift-network-diagnostics/network-check-target-cssf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:43.527073 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.526687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5bd\" (UniqueName: \"kubernetes.io/projected/ea29abcb-b6ea-4f2c-b45b-a18c05d072d1-kube-api-access-gm5bd\") pod \"aws-ebs-csi-driver-node-8gchw\" (UID: \"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.527073 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:43.526956 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77 podName:3597d6aa-69d3-4e61-80b0-57c304ca013c nodeName:}" failed. No retries permitted until 2026-07-08 18:16:44.026932768 +0000 UTC m=+3.041159847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-68g77" (UniqueName: "kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77") pod "network-check-target-cssf9" (UID: "3597d6aa-69d3-4e61-80b0-57c304ca013c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:43.527073 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.526784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxmg8\" (UniqueName: \"kubernetes.io/projected/f4fa372f-98c3-4c68-8bea-da69a6550422-kube-api-access-lxmg8\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:43.527248 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.527167 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2brs\" (UniqueName: \"kubernetes.io/projected/cff52718-1619-4071-af70-b7a6d040bcb8-kube-api-access-g2brs\") pod \"ovnkube-node-8rl42\" (UID: \"cff52718-1619-4071-af70-b7a6d040bcb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.527970 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.527947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnj2l\" (UniqueName: \"kubernetes.io/projected/27c9b907-2658-4851-bbd2-00734ceaecdd-kube-api-access-nnj2l\") pod \"iptables-alerter-gt9cd\" (UID: \"27c9b907-2658-4851-bbd2-00734ceaecdd\") " pod="openshift-network-operator/iptables-alerter-gt9cd" Jul 08 18:16:43.528198 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.528179 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7j5j\" (UniqueName: \"kubernetes.io/projected/7486cfff-3439-4288-83c5-f9bdb1d23977-kube-api-access-g7j5j\") pod \"tuned-wx5bs\" (UID: \"7486cfff-3439-4288-83c5-f9bdb1d23977\") " pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.528423 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.528399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx7tw\" (UniqueName: \"kubernetes.io/projected/c2e66deb-ce72-4b79-b05f-2a60a0c18c51-kube-api-access-bx7tw\") pod \"multus-additional-cni-plugins-4ws4q\" (UID: \"c2e66deb-ce72-4b79-b05f-2a60a0c18c51\") " pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.529003 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.528987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brgx8\" (UniqueName: \"kubernetes.io/projected/b7662b55-a0d9-457d-a19f-8b2b1db85a6f-kube-api-access-brgx8\") pod \"node-resolver-8dmgl\" (UID: \"b7662b55-a0d9-457d-a19f-8b2b1db85a6f\") " pod="openshift-dns/node-resolver-8dmgl" Jul 08 18:16:43.620197 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4zgn\" (UniqueName: \"kubernetes.io/projected/72892583-5a63-47ab-bb5c-957e69be5460-kube-api-access-t4zgn\") pod \"node-ca-zbmxw\" (UID: \"72892583-5a63-47ab-bb5c-957e69be5460\") " pod="openshift-image-registry/node-ca-zbmxw" Jul 08 18:16:43.620197 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-os-release\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620443 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-var-lib-kubelet\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620443 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-var-lib-kubelet\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620443 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-os-release\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620443 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-run-k8s-cni-cncf-io\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620443 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620409 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-run-k8s-cni-cncf-io\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620443 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-var-lib-cni-bin\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620448 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-var-lib-cni-bin\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-conf-dir\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-daemon-config\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620494 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-conf-dir\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-hostroot\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzv6m\" (UniqueName: \"kubernetes.io/projected/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-kube-api-access-mzv6m\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-socket-dir-parent\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-cnibin\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620632 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-hostroot\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.620660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-cni-binary-copy\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-run-multus-certs\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-cnibin\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-etc-kubernetes\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-socket-dir-parent\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-system-cni-dir\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-system-cni-dir\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72892583-5a63-47ab-bb5c-957e69be5460-host\") pod \"node-ca-zbmxw\" (UID: \"72892583-5a63-47ab-bb5c-957e69be5460\") " pod="openshift-image-registry/node-ca-zbmxw" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620786 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-run-multus-certs\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72892583-5a63-47ab-bb5c-957e69be5460-host\") pod \"node-ca-zbmxw\" (UID: \"72892583-5a63-47ab-bb5c-957e69be5460\") " pod="openshift-image-registry/node-ca-zbmxw" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-cni-dir\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-etc-kubernetes\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72892583-5a63-47ab-bb5c-957e69be5460-serviceca\") pod \"node-ca-zbmxw\" (UID: \"72892583-5a63-47ab-bb5c-957e69be5460\") " pod="openshift-image-registry/node-ca-zbmxw" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-cni-dir\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-run-netns\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.620976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-var-lib-cni-multus\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621630 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.621045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-run-netns\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621630 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.621062 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-host-var-lib-cni-multus\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621630 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.621127 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-multus-daemon-config\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621630 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.621138 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-cni-binary-copy\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.621630 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.621251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72892583-5a63-47ab-bb5c-957e69be5460-serviceca\") pod \"node-ca-zbmxw\" (UID: \"72892583-5a63-47ab-bb5c-957e69be5460\") " pod="openshift-image-registry/node-ca-zbmxw" Jul 08 18:16:43.628621 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.628549 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzv6m\" (UniqueName: \"kubernetes.io/projected/10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58-kube-api-access-mzv6m\") pod \"multus-v8sfq\" (UID: \"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58\") " pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.628621 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.628548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4zgn\" (UniqueName: \"kubernetes.io/projected/72892583-5a63-47ab-bb5c-957e69be5460-kube-api-access-t4zgn\") pod \"node-ca-zbmxw\" (UID: \"72892583-5a63-47ab-bb5c-957e69be5460\") " pod="openshift-image-registry/node-ca-zbmxw" Jul 08 18:16:43.657776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.657709 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" event={"ID":"7f5506128a4bbd1572e3fc77d9f9f209","Type":"ContainerStarted","Data":"b22c2088546447585e3409a1fdd219e80e72629b37fb1cf81bfdf1dd6d7e9a8f"} Jul 08 18:16:43.659272 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.659240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-26.ec2.internal" event={"ID":"537b291d55a88c57e658b0d66fcf4efc","Type":"ContainerStarted","Data":"c005f8836c42e7b7cbdde64da8000a71854abf2f5c957a07342a5b17c8b6979c"} Jul 08 18:16:43.700788 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.700744 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gt9cd" Jul 08 18:16:43.710382 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.710349 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" Jul 08 18:16:43.712537 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:43.712498 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c9b907_2658_4851_bbd2_00734ceaecdd.slice/crio-dafc92e94a7bf62074a4be2fbf32feff8e676c807b03ef68f02d139ff1f8a4c0 WatchSource:0}: Error finding container dafc92e94a7bf62074a4be2fbf32feff8e676c807b03ef68f02d139ff1f8a4c0: Status 404 returned error can't find the container with id dafc92e94a7bf62074a4be2fbf32feff8e676c807b03ef68f02d139ff1f8a4c0 Jul 08 18:16:43.721114 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.721070 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:16:43.726619 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:43.726587 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e66deb_ce72_4b79_b05f_2a60a0c18c51.slice/crio-e552ce943f4cc1d68be39d20e810d714f1cf14e27b991a5c02f479e8e280831f WatchSource:0}: Error finding container e552ce943f4cc1d68be39d20e810d714f1cf14e27b991a5c02f479e8e280831f: Status 404 returned error can't find the container with id e552ce943f4cc1d68be39d20e810d714f1cf14e27b991a5c02f479e8e280831f Jul 08 18:16:43.726788 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.726689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" Jul 08 18:16:43.734386 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:43.734346 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff52718_1619_4071_af70_b7a6d040bcb8.slice/crio-2aa7871721569b4c4a486360d96e8c00843caaf307c8071051e92a2868972811 WatchSource:0}: Error finding container 2aa7871721569b4c4a486360d96e8c00843caaf307c8071051e92a2868972811: Status 404 returned error can't find the container with id 2aa7871721569b4c4a486360d96e8c00843caaf307c8071051e92a2868972811 Jul 08 18:16:43.734729 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.734693 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:16:43.742046 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:43.742003 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea29abcb_b6ea_4f2c_b45b_a18c05d072d1.slice/crio-4ed1fd6e7ac10a2f9326720ff2bddb6d560d92dbc95dc7707d78d7d174281d42 WatchSource:0}: Error finding container 4ed1fd6e7ac10a2f9326720ff2bddb6d560d92dbc95dc7707d78d7d174281d42: Status 404 returned error can't find the container with id 4ed1fd6e7ac10a2f9326720ff2bddb6d560d92dbc95dc7707d78d7d174281d42 Jul 08 18:16:43.744369 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.744329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" Jul 08 18:16:43.745834 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:43.745802 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e63b4f_08bb_4fa9_8581_3bc863976c06.slice/crio-25d28f7ff6084928e22a31b1e2f7ab917bf253b9defc27a9edf354e679b1577a WatchSource:0}: Error finding container 25d28f7ff6084928e22a31b1e2f7ab917bf253b9defc27a9edf354e679b1577a: Status 404 returned error can't find the container with id 25d28f7ff6084928e22a31b1e2f7ab917bf253b9defc27a9edf354e679b1577a Jul 08 18:16:43.750645 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.750617 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8dmgl" Jul 08 18:16:43.754512 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:43.754479 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7486cfff_3439_4288_83c5_f9bdb1d23977.slice/crio-0f4aeb97f10c1f3e9f7671cd2ecce31210c8889224d4783b26cecafde489eb04 WatchSource:0}: Error finding container 0f4aeb97f10c1f3e9f7671cd2ecce31210c8889224d4783b26cecafde489eb04: Status 404 returned error can't find the container with id 0f4aeb97f10c1f3e9f7671cd2ecce31210c8889224d4783b26cecafde489eb04 Jul 08 18:16:43.757259 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.757148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zbmxw" Jul 08 18:16:43.760835 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:43.760798 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7662b55_a0d9_457d_a19f_8b2b1db85a6f.slice/crio-bace23ef5423f586694e00f257a076c2af37591d0736df12db6e1d6a041bde2e WatchSource:0}: Error finding container bace23ef5423f586694e00f257a076c2af37591d0736df12db6e1d6a041bde2e: Status 404 returned error can't find the container with id bace23ef5423f586694e00f257a076c2af37591d0736df12db6e1d6a041bde2e Jul 08 18:16:43.764775 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:43.764749 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v8sfq" Jul 08 18:16:43.767458 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:43.767397 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72892583_5a63_47ab_bb5c_957e69be5460.slice/crio-67346daa2378f84ae71b784799c75637b7138795806ff5a0e489361c36cc3fb6 WatchSource:0}: Error finding container 67346daa2378f84ae71b784799c75637b7138795806ff5a0e489361c36cc3fb6: Status 404 returned error can't find the container with id 67346daa2378f84ae71b784799c75637b7138795806ff5a0e489361c36cc3fb6 Jul 08 18:16:43.775887 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:16:43.775844 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c1a5fd_6fd7_42ca_9b8a_ffedce7d0c58.slice/crio-708fc1a3db2d98a7da90c767713b992efd2063c5a321d6f1a6acfdf2aaf11efb WatchSource:0}: Error finding container 708fc1a3db2d98a7da90c767713b992efd2063c5a321d6f1a6acfdf2aaf11efb: Status 404 returned error can't find the container with id 708fc1a3db2d98a7da90c767713b992efd2063c5a321d6f1a6acfdf2aaf11efb Jul 08 18:16:44.024199 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.024086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:44.024199 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.024177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:44.024426 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:44.024279 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:44.024426 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:44.024351 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret podName:ff0b27c4-6651-41d5-bbb0-9d13194da0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:16:45.024330728 +0000 UTC m=+4.038557802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret") pod "global-pull-secret-syncer-4tl96" (UID: "ff0b27c4-6651-41d5-bbb0-9d13194da0ce") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:44.024426 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:44.024280 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:44.024554 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:44.024438 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs podName:f4fa372f-98c3-4c68-8bea-da69a6550422 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:45.024412722 +0000 UTC m=+4.038639785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs") pod "network-metrics-daemon-tngjv" (UID: "f4fa372f-98c3-4c68-8bea-da69a6550422") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:44.125481 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.125437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68g77\" (UniqueName: \"kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77\") pod \"network-check-target-cssf9\" (UID: \"3597d6aa-69d3-4e61-80b0-57c304ca013c\") " pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:44.125673 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:44.125624 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:44.125673 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:44.125652 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:44.125673 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:44.125663 2576 projected.go:196] Error preparing data for projected volume kube-api-access-68g77 for pod openshift-network-diagnostics/network-check-target-cssf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:44.125835 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:44.125721 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77 podName:3597d6aa-69d3-4e61-80b0-57c304ca013c nodeName:}" failed. No retries permitted until 2026-07-08 18:16:45.12570564 +0000 UTC m=+4.139932696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-68g77" (UniqueName: "kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77") pod "network-check-target-cssf9" (UID: "3597d6aa-69d3-4e61-80b0-57c304ca013c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:44.440497 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.440450 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:11:44 +0000 UTC" deadline="2028-02-29 04:40:14.450761817 +0000 UTC" Jul 08 18:16:44.440497 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.440493 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14410h23m30.010274335s" Jul 08 18:16:44.652521 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.652407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:44.653331 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:44.652578 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:16:44.653331 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.653050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:44.653331 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:44.653151 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:16:44.682896 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.682260 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zbmxw" event={"ID":"72892583-5a63-47ab-bb5c-957e69be5460","Type":"ContainerStarted","Data":"67346daa2378f84ae71b784799c75637b7138795806ff5a0e489361c36cc3fb6"} Jul 08 18:16:44.692141 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.692095 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" event={"ID":"7486cfff-3439-4288-83c5-f9bdb1d23977","Type":"ContainerStarted","Data":"0f4aeb97f10c1f3e9f7671cd2ecce31210c8889224d4783b26cecafde489eb04"} Jul 08 18:16:44.694539 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.694425 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" event={"ID":"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1","Type":"ContainerStarted","Data":"4ed1fd6e7ac10a2f9326720ff2bddb6d560d92dbc95dc7707d78d7d174281d42"} Jul 08 18:16:44.707761 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.707689 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" event={"ID":"c2e66deb-ce72-4b79-b05f-2a60a0c18c51","Type":"ContainerStarted","Data":"e552ce943f4cc1d68be39d20e810d714f1cf14e27b991a5c02f479e8e280831f"} Jul 08 18:16:44.724508 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.724400 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gt9cd" event={"ID":"27c9b907-2658-4851-bbd2-00734ceaecdd","Type":"ContainerStarted","Data":"dafc92e94a7bf62074a4be2fbf32feff8e676c807b03ef68f02d139ff1f8a4c0"} Jul 08 18:16:44.735812 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.735762 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v8sfq" event={"ID":"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58","Type":"ContainerStarted","Data":"708fc1a3db2d98a7da90c767713b992efd2063c5a321d6f1a6acfdf2aaf11efb"} Jul 08 18:16:44.742058 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.741720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8dmgl" event={"ID":"b7662b55-a0d9-457d-a19f-8b2b1db85a6f","Type":"ContainerStarted","Data":"bace23ef5423f586694e00f257a076c2af37591d0736df12db6e1d6a041bde2e"} Jul 08 18:16:44.747390 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.747340 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rc4kr" event={"ID":"e3e63b4f-08bb-4fa9-8581-3bc863976c06","Type":"ContainerStarted","Data":"25d28f7ff6084928e22a31b1e2f7ab917bf253b9defc27a9edf354e679b1577a"} Jul 08 18:16:44.749196 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:44.749158 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" event={"ID":"cff52718-1619-4071-af70-b7a6d040bcb8","Type":"ContainerStarted","Data":"2aa7871721569b4c4a486360d96e8c00843caaf307c8071051e92a2868972811"} Jul 08 18:16:45.034518 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:45.033575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:45.034518 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:45.033663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:45.034518 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:45.033823 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:45.034518 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:45.033894 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret podName:ff0b27c4-6651-41d5-bbb0-9d13194da0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:16:47.033873806 +0000 UTC m=+6.048100862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret") pod "global-pull-secret-syncer-4tl96" (UID: "ff0b27c4-6651-41d5-bbb0-9d13194da0ce") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:45.034518 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:45.034316 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:45.034518 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:45.034372 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs podName:f4fa372f-98c3-4c68-8bea-da69a6550422 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:47.034353357 +0000 UTC m=+6.048580418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs") pod "network-metrics-daemon-tngjv" (UID: "f4fa372f-98c3-4c68-8bea-da69a6550422") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:45.134713 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:45.134671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68g77\" (UniqueName: \"kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77\") pod \"network-check-target-cssf9\" (UID: \"3597d6aa-69d3-4e61-80b0-57c304ca013c\") " pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:45.134913 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:45.134843 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:45.134913 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:45.134864 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:45.134913 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:45.134876 2576 projected.go:196] Error preparing data for projected volume kube-api-access-68g77 for pod openshift-network-diagnostics/network-check-target-cssf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:45.135067 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:45.134952 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77 podName:3597d6aa-69d3-4e61-80b0-57c304ca013c nodeName:}" failed. No retries permitted until 2026-07-08 18:16:47.13493122 +0000 UTC m=+6.149158306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-68g77" (UniqueName: "kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77") pod "network-check-target-cssf9" (UID: "3597d6aa-69d3-4e61-80b0-57c304ca013c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:45.441613 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:45.441532 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:11:44 +0000 UTC" deadline="2028-03-29 10:38:01.211414348 +0000 UTC" Jul 08 18:16:45.441613 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:45.441611 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15112h21m15.769808653s" Jul 08 18:16:45.658491 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:45.657612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:45.658491 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:45.657840 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:16:45.783911 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:45.783068 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f5506128a4bbd1572e3fc77d9f9f209" containerID="fbe21f3a75e638b2f551efb3d1d64cdb1eb8068401e734a203933ce02b119d45" exitCode=0 Jul 08 18:16:45.783911 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:45.783133 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" event={"ID":"7f5506128a4bbd1572e3fc77d9f9f209","Type":"ContainerDied","Data":"fbe21f3a75e638b2f551efb3d1d64cdb1eb8068401e734a203933ce02b119d45"} Jul 08 18:16:46.651975 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:46.651935 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:46.652194 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:46.652092 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:16:46.652606 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:46.652581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:46.652800 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:46.652771 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:16:46.815398 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:46.814544 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" event={"ID":"7f5506128a4bbd1572e3fc77d9f9f209","Type":"ContainerStarted","Data":"be4fae1ee037c66aeb3dd7394ef09977b9af29b09ea79005f31b435c2d200ba8"} Jul 08 18:16:47.053765 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:47.053658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:47.053969 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:47.053767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:47.053969 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:47.053939 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:47.054085 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:47.054012 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs podName:f4fa372f-98c3-4c68-8bea-da69a6550422 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:51.053990429 +0000 UTC m=+10.068217527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs") pod "network-metrics-daemon-tngjv" (UID: "f4fa372f-98c3-4c68-8bea-da69a6550422") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:47.054590 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:47.054558 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:47.054724 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:47.054639 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret podName:ff0b27c4-6651-41d5-bbb0-9d13194da0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:16:51.054618126 +0000 UTC m=+10.068845198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret") pod "global-pull-secret-syncer-4tl96" (UID: "ff0b27c4-6651-41d5-bbb0-9d13194da0ce") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:47.154602 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:47.154553 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68g77\" (UniqueName: \"kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77\") pod \"network-check-target-cssf9\" (UID: \"3597d6aa-69d3-4e61-80b0-57c304ca013c\") " pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:47.154863 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:47.154804 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:47.154863 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:47.154835 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:47.154981 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:47.154927 2576 projected.go:196] Error preparing data for projected volume kube-api-access-68g77 for pod openshift-network-diagnostics/network-check-target-cssf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:47.155039 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:47.154998 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77 podName:3597d6aa-69d3-4e61-80b0-57c304ca013c nodeName:}" failed. No retries permitted until 2026-07-08 18:16:51.154976397 +0000 UTC m=+10.169203458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-68g77" (UniqueName: "kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77") pod "network-check-target-cssf9" (UID: "3597d6aa-69d3-4e61-80b0-57c304ca013c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:47.655253 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:47.655213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:47.655492 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:47.655392 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:16:48.652227 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:48.652144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:48.652789 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:48.652302 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:16:48.652789 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:48.652324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:48.652789 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:48.652497 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:16:49.653103 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:49.652483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:49.653103 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:49.652661 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:16:50.652209 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:50.652168 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:50.652444 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:50.652176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:50.652444 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:50.652332 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:16:50.652444 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:50.652414 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:16:51.094540 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:51.094498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:51.095064 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:51.094572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:51.095064 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:51.094695 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:51.095064 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:51.094711 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:51.095064 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:51.094780 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret podName:ff0b27c4-6651-41d5-bbb0-9d13194da0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:16:59.094756713 +0000 UTC m=+18.108983795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret") pod "global-pull-secret-syncer-4tl96" (UID: "ff0b27c4-6651-41d5-bbb0-9d13194da0ce") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:51.095064 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:51.094804 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs podName:f4fa372f-98c3-4c68-8bea-da69a6550422 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:59.094792158 +0000 UTC m=+18.109019218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs") pod "network-metrics-daemon-tngjv" (UID: "f4fa372f-98c3-4c68-8bea-da69a6550422") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:51.195892 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:51.195849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68g77\" (UniqueName: \"kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77\") pod \"network-check-target-cssf9\" (UID: \"3597d6aa-69d3-4e61-80b0-57c304ca013c\") " pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:51.196113 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:51.196067 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:51.196113 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:51.196097 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:51.196113 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:51.196115 2576 projected.go:196] Error preparing data for projected volume kube-api-access-68g77 for pod openshift-network-diagnostics/network-check-target-cssf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:51.196286 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:51.196185 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77 podName:3597d6aa-69d3-4e61-80b0-57c304ca013c nodeName:}" failed. No retries permitted until 2026-07-08 18:16:59.196163305 +0000 UTC m=+18.210390399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-68g77" (UniqueName: "kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77") pod "network-check-target-cssf9" (UID: "3597d6aa-69d3-4e61-80b0-57c304ca013c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:51.654157 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:51.653557 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:51.654157 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:51.653698 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:16:52.652366 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:52.651973 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:52.652366 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:52.652126 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:16:52.652366 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:52.652318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:52.653031 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:52.652458 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:16:53.654404 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:53.652715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:53.654404 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:53.652871 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:16:54.651812 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:54.651774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:54.652043 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:54.651826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:54.652043 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:54.651916 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:16:54.652203 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:54.652055 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:16:55.652654 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:55.652614 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:55.653096 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:55.652781 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:16:56.652429 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:56.652325 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:56.652606 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:56.652477 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:16:56.652606 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:56.652550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:56.652713 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:56.652656 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:16:57.652596 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:57.652557 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:57.652771 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:57.652718 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:16:58.652421 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:58.652381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:58.652663 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:58.652381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:58.652663 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:58.652518 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:16:58.652663 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:58.652588 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:16:59.159222 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:59.159181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:59.159696 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:59.159251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:16:59.159696 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:59.159372 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:59.159696 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:59.159449 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs podName:f4fa372f-98c3-4c68-8bea-da69a6550422 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:15.15942767 +0000 UTC m=+34.173654730 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs") pod "network-metrics-daemon-tngjv" (UID: "f4fa372f-98c3-4c68-8bea-da69a6550422") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:59.159696 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:59.159374 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:59.159696 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:59.159539 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret podName:ff0b27c4-6651-41d5-bbb0-9d13194da0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:17:15.159519371 +0000 UTC m=+34.173746425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret") pod "global-pull-secret-syncer-4tl96" (UID: "ff0b27c4-6651-41d5-bbb0-9d13194da0ce") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:59.260362 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:59.260310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68g77\" (UniqueName: \"kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77\") pod \"network-check-target-cssf9\" (UID: \"3597d6aa-69d3-4e61-80b0-57c304ca013c\") " pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:16:59.260534 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:59.260497 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:59.260534 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:59.260523 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:59.260648 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:59.260539 2576 projected.go:196] Error preparing data for projected volume kube-api-access-68g77 for pod openshift-network-diagnostics/network-check-target-cssf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:59.260648 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:59.260605 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77 podName:3597d6aa-69d3-4e61-80b0-57c304ca013c nodeName:}" failed. No retries permitted until 2026-07-08 18:17:15.260589132 +0000 UTC m=+34.274816200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-68g77" (UniqueName: "kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77") pod "network-check-target-cssf9" (UID: "3597d6aa-69d3-4e61-80b0-57c304ca013c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:59.651628 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:16:59.651591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:16:59.651820 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:16:59.651748 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:17:00.651713 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:00.651669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:00.652147 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:00.651669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:00.652147 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:00.651818 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:17:00.652147 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:00.651929 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:17:01.652958 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:01.652924 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:01.653399 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:01.653029 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:17:02.652285 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:02.652243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:02.652515 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:02.652243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:02.652515 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:02.652404 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:17:02.652515 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:02.652482 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:17:03.651846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:03.651808 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:03.652470 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:03.651975 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:17:04.654572 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.652598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:04.654572 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:04.652733 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:17:04.654572 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.653150 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:04.654572 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:04.653246 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:17:04.854210 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.854011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rc4kr" event={"ID":"e3e63b4f-08bb-4fa9-8581-3bc863976c06","Type":"ContainerStarted","Data":"7354b2718b37b9813ee4c822a8257d7329f6a5c7ab218684f7a63b49c56b70df"} Jul 08 18:17:04.855835 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.855805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" event={"ID":"cff52718-1619-4071-af70-b7a6d040bcb8","Type":"ContainerStarted","Data":"ca661fe18a785490303ab531ea68d6d65485705d4f6e1a7c550442b12e70fed1"} Jul 08 18:17:04.858194 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.858165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zbmxw" event={"ID":"72892583-5a63-47ab-bb5c-957e69be5460","Type":"ContainerStarted","Data":"c0c1a2730357f8efc631d07895720948e4051d8d76f1e0f826217cc387a2d1b8"} Jul 08 18:17:04.859901 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.859870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" event={"ID":"7486cfff-3439-4288-83c5-f9bdb1d23977","Type":"ContainerStarted","Data":"9ec10165e8a2c4f060802201e6ebf8a97813ec9a159218cb4821996e324d1d59"} Jul 08 18:17:04.861437 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.861379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" event={"ID":"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1","Type":"ContainerStarted","Data":"8267062a7d7c1a9c5ccc2be96b58bb465ec6a9c85a0e6693d2c89afe93cd6241"} Jul 08 18:17:04.862580 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.862555 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" event={"ID":"c2e66deb-ce72-4b79-b05f-2a60a0c18c51","Type":"ContainerStarted","Data":"2217fd9c0d0fa54c818f4ba673122f192a62b3ce4ab6a28bf4784e719fa932c3"} Jul 08 18:17:04.864031 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.864004 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-26.ec2.internal" event={"ID":"537b291d55a88c57e658b0d66fcf4efc","Type":"ContainerStarted","Data":"b7e75700f115657a58ed55fd99e229df4e5e5fa6df945c65556630e2305602ca"} Jul 08 18:17:04.865740 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.865713 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v8sfq" event={"ID":"10c1a5fd-6fd7-42ca-9b8a-ffedce7d0c58","Type":"ContainerStarted","Data":"a90f4abb8fb07789963625ca9f3b24faf9a6aba7e22302a852e6cb36d6e1a7ad"} Jul 08 18:17:04.867420 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.867396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8dmgl" event={"ID":"b7662b55-a0d9-457d-a19f-8b2b1db85a6f","Type":"ContainerStarted","Data":"5956d8a346e0c3473ec71020df93e62349997bf449f23b544c389b75dd2fa6fe"} Jul 08 18:17:04.870133 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.870085 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-26.ec2.internal" podStartSLOduration=21.870071453 podStartE2EDuration="21.870071453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:46.834369254 +0000 UTC m=+5.848596335" watchObservedRunningTime="2026-07-08 18:17:04.870071453 +0000 UTC m=+23.884298528" Jul 08 18:17:04.870448 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.870418 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rc4kr" podStartSLOduration=2.067036759 podStartE2EDuration="22.870413015s" totalImagesPullingTime="20.803376256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:04.870378475 +0000 UTC m=+23.884605551" watchObservedRunningTime="2026-07-08 18:17:04.870413015 +0000 UTC m=+23.884640090" Jul 08 18:17:04.885126 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.885066 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-26.ec2.internal" podStartSLOduration=21.885048505 podStartE2EDuration="21.885048505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:04.885022064 +0000 UTC m=+23.899249140" watchObservedRunningTime="2026-07-08 18:17:04.885048505 +0000 UTC m=+23.899275578" Jul 08 18:17:04.902018 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.901962 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wx5bs" podStartSLOduration=2.098920916 podStartE2EDuration="22.901945791s" totalImagesPullingTime="20.803024875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:04.901529433 +0000 UTC m=+23.915756508" watchObservedRunningTime="2026-07-08 18:17:04.901945791 +0000 UTC m=+23.916172867" Jul 08 18:17:04.917645 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.917600 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8dmgl" podStartSLOduration=2.129368536 podStartE2EDuration="22.917587911s" totalImagesPullingTime="20.788219375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:04.917174614 +0000 UTC m=+23.931401691" watchObservedRunningTime="2026-07-08 18:17:04.917587911 +0000 UTC m=+23.931814986" Jul 08 18:17:04.931292 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.931234 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zbmxw" podStartSLOduration=2.145474883 podStartE2EDuration="22.931211523s" totalImagesPullingTime="20.78573664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:04.930731374 +0000 UTC m=+23.944958450" watchObservedRunningTime="2026-07-08 18:17:04.931211523 +0000 UTC m=+23.945438599" Jul 08 18:17:04.947760 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:04.947711 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v8sfq" podStartSLOduration=2.116050018 podStartE2EDuration="22.947694304s" totalImagesPullingTime="20.831644286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:04.947423835 +0000 UTC m=+23.961650910" watchObservedRunningTime="2026-07-08 18:17:04.947694304 +0000 UTC m=+23.961921379" Jul 08 18:17:05.652888 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:05.652606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:05.653073 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:05.653024 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:17:05.872691 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:05.872601 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:17:05.873571 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:05.872937 2576 generic.go:356] "Generic (PLEG): container finished" podID="cff52718-1619-4071-af70-b7a6d040bcb8" containerID="3f4ba8126bf8a44ac5c41d73032cb9e68912ab72a9e78d663a43ede50e5a72e3" exitCode=1 Jul 08 18:17:05.873571 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:05.873011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" event={"ID":"cff52718-1619-4071-af70-b7a6d040bcb8","Type":"ContainerStarted","Data":"a3645fb9024653365f99f01cfc84a4715731744686cc0686eb3ee60c9bb4b73f"} Jul 08 18:17:05.873571 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:05.873114 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" event={"ID":"cff52718-1619-4071-af70-b7a6d040bcb8","Type":"ContainerStarted","Data":"6ef2e54fb99fb35065e6e5fee2722eb3df7919bdbf52bddc7e524e2ba471039f"} Jul 08 18:17:05.873571 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:05.873151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" event={"ID":"cff52718-1619-4071-af70-b7a6d040bcb8","Type":"ContainerStarted","Data":"be3a61d08cc8bef837d68cf14b9c29a56ca0cbd7adde4d9a69afcf827d4d91c6"} Jul 08 18:17:05.873571 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:05.873198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" event={"ID":"cff52718-1619-4071-af70-b7a6d040bcb8","Type":"ContainerStarted","Data":"a0b4ded66f3a3f9a48450d2e875ad215631f763babcedb41e8a047391e2914a9"} Jul 08 18:17:05.873571 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:05.873228 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" event={"ID":"cff52718-1619-4071-af70-b7a6d040bcb8","Type":"ContainerDied","Data":"3f4ba8126bf8a44ac5c41d73032cb9e68912ab72a9e78d663a43ede50e5a72e3"} Jul 08 18:17:05.874579 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:05.874552 2576 generic.go:356] "Generic (PLEG): container finished" podID="c2e66deb-ce72-4b79-b05f-2a60a0c18c51" containerID="2217fd9c0d0fa54c818f4ba673122f192a62b3ce4ab6a28bf4784e719fa932c3" exitCode=0 Jul 08 18:17:05.874722 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:05.874682 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" event={"ID":"c2e66deb-ce72-4b79-b05f-2a60a0c18c51","Type":"ContainerDied","Data":"2217fd9c0d0fa54c818f4ba673122f192a62b3ce4ab6a28bf4784e719fa932c3"} Jul 08 18:17:06.161215 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:06.161183 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 18:17:06.499242 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:06.499091 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T18:17:06.161203848Z","UUID":"dc1d1987-6d05-405c-96ba-b78f6c305be1","Handler":null,"Name":"","Endpoint":""} Jul 08 18:17:06.500599 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:06.500570 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 18:17:06.500767 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:06.500614 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 18:17:06.652572 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:06.652538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:06.652769 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:06.652670 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:17:06.652769 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:06.652758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:06.652880 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:06.652853 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:17:06.879014 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:06.878975 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" event={"ID":"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1","Type":"ContainerStarted","Data":"feeb7f44c73a65f7444f77108ad90efa12a3933735b6800ae3a28915df6e1d7f"} Jul 08 18:17:06.880747 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:06.880709 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gt9cd" event={"ID":"27c9b907-2658-4851-bbd2-00734ceaecdd","Type":"ContainerStarted","Data":"8889775c1ca8cbf632fc9c41d6ffa4ff3a5b0a279df8dc65178a1fe026daa983"} Jul 08 18:17:06.894740 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:06.894680 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gt9cd" podStartSLOduration=4.053460221 podStartE2EDuration="24.894658594s" totalImagesPullingTime="20.841198373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:06.894116826 +0000 UTC m=+25.908343904" watchObservedRunningTime="2026-07-08 18:17:06.894658594 +0000 UTC m=+25.908885672" Jul 08 18:17:06.905394 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:06.905340 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:17:06.906451 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:06.906428 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:17:07.652112 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:07.651836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:07.652329 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:07.652243 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:17:07.886137 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:07.886047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" event={"ID":"ea29abcb-b6ea-4f2c-b45b-a18c05d072d1","Type":"ContainerStarted","Data":"35e43f66657165991e6a943d3e130beb3104fe017359b047ebe6eec1c1179a2a"} Jul 08 18:17:07.889660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:07.889632 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:17:07.890058 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:07.890028 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" event={"ID":"cff52718-1619-4071-af70-b7a6d040bcb8","Type":"ContainerStarted","Data":"62fd2641481fd89a4470cb99dd3ec8b3b6a39d6e4da78227200815951691ef72"} Jul 08 18:17:07.890409 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:07.890316 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:17:07.890953 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:07.890929 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rc4kr" Jul 08 18:17:07.903322 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:07.903270 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gchw" podStartSLOduration=2.857827362 podStartE2EDuration="25.903255012s" totalImagesPullingTime="23.04542765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:07.903068603 +0000 UTC m=+26.917295680" watchObservedRunningTime="2026-07-08 18:17:07.903255012 +0000 UTC m=+26.917482085" Jul 08 18:17:08.652407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:08.652375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:08.652610 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:08.652480 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:17:08.652610 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:08.652531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:08.652687 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:08.652642 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:17:09.652421 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:09.652381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:09.653143 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:09.652520 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:17:09.899387 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:09.899365 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:17:09.899970 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:09.899839 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" event={"ID":"cff52718-1619-4071-af70-b7a6d040bcb8","Type":"ContainerStarted","Data":"7a81a141eb7ecc90f14cbf6715f7409590acf78ddc24cd59d12ada11459c1b36"} Jul 08 18:17:09.900546 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:09.900340 2576 scope.go:117] "RemoveContainer" containerID="3f4ba8126bf8a44ac5c41d73032cb9e68912ab72a9e78d663a43ede50e5a72e3" Jul 08 18:17:10.652558 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:10.652294 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:10.653286 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:10.652365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:10.653286 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:10.652672 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:17:10.653286 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:10.652750 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:17:10.908678 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:10.908599 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:17:10.909070 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:10.909042 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" event={"ID":"cff52718-1619-4071-af70-b7a6d040bcb8","Type":"ContainerStarted","Data":"27f4634bf45d27ca6a167b56edc574f70fb1b5f264c01621eec14d24c2e253a8"} Jul 08 18:17:10.909499 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:10.909476 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:17:10.909627 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:10.909600 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:17:10.909714 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:10.909650 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:17:10.927147 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:10.927115 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:17:10.927304 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:10.927266 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:17:10.936492 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:10.936435 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" podStartSLOduration=8.050874732 podStartE2EDuration="28.93641865s" totalImagesPullingTime="20.885543918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:10.935131399 +0000 UTC m=+29.949358508" watchObservedRunningTime="2026-07-08 18:17:10.93641865 +0000 UTC m=+29.950645781" Jul 08 18:17:11.652839 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:11.652805 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:11.653439 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:11.652906 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:17:12.049626 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:12.049587 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4tl96"] Jul 08 18:17:12.049788 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:12.049686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:12.049853 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:12.049783 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:17:12.053423 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:12.053299 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cssf9"] Jul 08 18:17:12.053691 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:12.053489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:12.053691 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:12.053644 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:17:12.054084 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:12.054056 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tngjv"] Jul 08 18:17:12.054198 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:12.054181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:12.054334 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:12.054301 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:17:12.917027 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:12.916795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" event={"ID":"c2e66deb-ce72-4b79-b05f-2a60a0c18c51","Type":"ContainerStarted","Data":"90533ce3caddd5e282ac29af21e7a97bcf5a6997446e990547a6b6c13ee2c927"} Jul 08 18:17:13.652258 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:13.652212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:13.652454 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:13.652342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:13.652454 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:13.652395 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:17:13.652553 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:13.652506 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:17:13.652553 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:13.652539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:13.652647 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:13.652593 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:17:13.921416 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:13.921298 2576 generic.go:356] "Generic (PLEG): container finished" podID="c2e66deb-ce72-4b79-b05f-2a60a0c18c51" containerID="90533ce3caddd5e282ac29af21e7a97bcf5a6997446e990547a6b6c13ee2c927" exitCode=0 Jul 08 18:17:13.921416 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:13.921373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" event={"ID":"c2e66deb-ce72-4b79-b05f-2a60a0c18c51","Type":"ContainerDied","Data":"90533ce3caddd5e282ac29af21e7a97bcf5a6997446e990547a6b6c13ee2c927"} Jul 08 18:17:14.925261 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:14.925222 2576 generic.go:356] "Generic (PLEG): container finished" podID="c2e66deb-ce72-4b79-b05f-2a60a0c18c51" containerID="836c482a4961bc6fa67d96e08c0523c97f85804b1e1b32172188f70b2432ee95" exitCode=0 Jul 08 18:17:14.925828 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:14.925285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" event={"ID":"c2e66deb-ce72-4b79-b05f-2a60a0c18c51","Type":"ContainerDied","Data":"836c482a4961bc6fa67d96e08c0523c97f85804b1e1b32172188f70b2432ee95"} Jul 08 18:17:15.178687 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:15.178638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:15.178834 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:15.178702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:15.178834 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:15.178798 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:17:15.178834 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:15.178806 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:17:15.178918 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:15.178855 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret podName:ff0b27c4-6651-41d5-bbb0-9d13194da0ce nodeName:}" failed. No retries permitted until 2026-07-08 18:17:47.178839976 +0000 UTC m=+66.193067035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret") pod "global-pull-secret-syncer-4tl96" (UID: "ff0b27c4-6651-41d5-bbb0-9d13194da0ce") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:17:15.178918 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:15.178870 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs podName:f4fa372f-98c3-4c68-8bea-da69a6550422 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:47.178863459 +0000 UTC m=+66.193090513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs") pod "network-metrics-daemon-tngjv" (UID: "f4fa372f-98c3-4c68-8bea-da69a6550422") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:17:15.279788 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:15.279751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68g77\" (UniqueName: \"kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77\") pod \"network-check-target-cssf9\" (UID: \"3597d6aa-69d3-4e61-80b0-57c304ca013c\") " pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:15.279927 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:15.279888 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:17:15.279927 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:15.279904 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:17:15.279927 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:15.279913 2576 projected.go:196] Error preparing data for projected volume kube-api-access-68g77 for pod openshift-network-diagnostics/network-check-target-cssf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:17:15.280036 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:15.279963 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77 podName:3597d6aa-69d3-4e61-80b0-57c304ca013c nodeName:}" failed. No retries permitted until 2026-07-08 18:17:47.279951893 +0000 UTC m=+66.294178947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-68g77" (UniqueName: "kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77") pod "network-check-target-cssf9" (UID: "3597d6aa-69d3-4e61-80b0-57c304ca013c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:17:15.652381 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:15.652317 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:15.652584 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:15.652330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:15.652584 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:15.652467 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:17:15.652584 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:15.652477 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:15.652697 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:15.652575 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:17:15.652735 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:15.652694 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:17:15.930090 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:15.929994 2576 generic.go:356] "Generic (PLEG): container finished" podID="c2e66deb-ce72-4b79-b05f-2a60a0c18c51" containerID="b36876f6e213e040f0f51a36fc5850c37843b4cc4147e1a924057b42270f458c" exitCode=0 Jul 08 18:17:15.930090 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:15.930056 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" event={"ID":"c2e66deb-ce72-4b79-b05f-2a60a0c18c51","Type":"ContainerDied","Data":"b36876f6e213e040f0f51a36fc5850c37843b4cc4147e1a924057b42270f458c"} Jul 08 18:17:17.652254 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:17.652216 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:17.652726 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:17.652217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:17.652726 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:17.652345 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cssf9" podUID="3597d6aa-69d3-4e61-80b0-57c304ca013c" Jul 08 18:17:17.652726 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:17.652380 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:17.652726 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:17.652475 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tl96" podUID="ff0b27c4-6651-41d5-bbb0-9d13194da0ce" Jul 08 18:17:17.652726 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:17.652574 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tngjv" podUID="f4fa372f-98c3-4c68-8bea-da69a6550422" Jul 08 18:17:18.756764 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.756734 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-26.ec2.internal" event="NodeReady" Jul 08 18:17:18.757206 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.756881 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 18:17:18.804913 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.804875 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lqqxz"] Jul 08 18:17:18.830151 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.830118 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rg8rh"] Jul 08 18:17:18.830348 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.830276 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:18.832979 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.832944 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 18:17:18.833151 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.833031 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 18:17:18.833151 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.833053 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d7khc\"" Jul 08 18:17:18.852224 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.852186 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lqqxz"] Jul 08 18:17:18.852224 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.852240 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rg8rh"] Jul 08 18:17:18.852462 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.852291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rg8rh" Jul 08 18:17:18.854786 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.854762 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-75wcg\"" Jul 08 18:17:18.854938 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.854765 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 18:17:18.855017 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.855008 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 18:17:18.855113 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:18.855094 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 18:17:19.010393 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.010253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6350e06-e68e-4d24-94d5-785a4e570bb6-cert\") pod \"ingress-canary-rg8rh\" (UID: \"c6350e06-e68e-4d24-94d5-785a4e570bb6\") " pod="openshift-ingress-canary/ingress-canary-rg8rh" Jul 08 18:17:19.010393 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.010315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs5gn\" (UniqueName: \"kubernetes.io/projected/c6350e06-e68e-4d24-94d5-785a4e570bb6-kube-api-access-fs5gn\") pod \"ingress-canary-rg8rh\" (UID: \"c6350e06-e68e-4d24-94d5-785a4e570bb6\") " pod="openshift-ingress-canary/ingress-canary-rg8rh" Jul 08 18:17:19.010393 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.010346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-tmp-dir\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.010695 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.010431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlsvk\" (UniqueName: \"kubernetes.io/projected/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-kube-api-access-wlsvk\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.010695 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.010485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.010695 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.010524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-config-volume\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.111615 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.111572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6350e06-e68e-4d24-94d5-785a4e570bb6-cert\") pod \"ingress-canary-rg8rh\" (UID: \"c6350e06-e68e-4d24-94d5-785a4e570bb6\") " pod="openshift-ingress-canary/ingress-canary-rg8rh" Jul 08 18:17:19.111615 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.111622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs5gn\" (UniqueName: \"kubernetes.io/projected/c6350e06-e68e-4d24-94d5-785a4e570bb6-kube-api-access-fs5gn\") pod \"ingress-canary-rg8rh\" (UID: \"c6350e06-e68e-4d24-94d5-785a4e570bb6\") " pod="openshift-ingress-canary/ingress-canary-rg8rh" Jul 08 18:17:19.111872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.111642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-tmp-dir\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.111872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.111705 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlsvk\" (UniqueName: \"kubernetes.io/projected/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-kube-api-access-wlsvk\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.111872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.111741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.111872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.111768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-config-volume\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.112107 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:19.111892 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:19.112107 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:19.111960 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls podName:13a2bd72-57a5-4ee5-9ad4-b74f4702e655 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:19.611940771 +0000 UTC m=+38.626167833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls") pod "dns-default-lqqxz" (UID: "13a2bd72-57a5-4ee5-9ad4-b74f4702e655") : secret "dns-default-metrics-tls" not found Jul 08 18:17:19.112204 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.112112 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-tmp-dir\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.112418 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.112391 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-config-volume\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.117089 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.117060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6350e06-e68e-4d24-94d5-785a4e570bb6-cert\") pod \"ingress-canary-rg8rh\" (UID: \"c6350e06-e68e-4d24-94d5-785a4e570bb6\") " pod="openshift-ingress-canary/ingress-canary-rg8rh" Jul 08 18:17:19.120601 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.120567 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlsvk\" (UniqueName: \"kubernetes.io/projected/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-kube-api-access-wlsvk\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.120787 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.120763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs5gn\" (UniqueName: \"kubernetes.io/projected/c6350e06-e68e-4d24-94d5-785a4e570bb6-kube-api-access-fs5gn\") pod \"ingress-canary-rg8rh\" (UID: \"c6350e06-e68e-4d24-94d5-785a4e570bb6\") " pod="openshift-ingress-canary/ingress-canary-rg8rh" Jul 08 18:17:19.162678 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.162643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rg8rh" Jul 08 18:17:19.616084 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.616037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:19.616278 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:19.616198 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:19.616341 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:19.616280 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls podName:13a2bd72-57a5-4ee5-9ad4-b74f4702e655 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:20.616258494 +0000 UTC m=+39.630485561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls") pod "dns-default-lqqxz" (UID: "13a2bd72-57a5-4ee5-9ad4-b74f4702e655") : secret "dns-default-metrics-tls" not found Jul 08 18:17:19.652426 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.652384 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:19.652426 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.652418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:19.652660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.652393 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:19.656114 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.656080 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:17:19.656265 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.656139 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c4rm5\"" Jul 08 18:17:19.656265 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.656222 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 18:17:19.656411 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.656320 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 18:17:19.656486 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.656462 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hn7hw\"" Jul 08 18:17:19.656486 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:19.656461 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:17:20.101788 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:20.101562 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rg8rh"] Jul 08 18:17:20.173885 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:17:20.173847 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6350e06_e68e_4d24_94d5_785a4e570bb6.slice/crio-177ca4b4280c96a8ee33b4ae0ed1eca24c3e9faee72f888452aaefe0594be0e1 WatchSource:0}: Error finding container 177ca4b4280c96a8ee33b4ae0ed1eca24c3e9faee72f888452aaefe0594be0e1: Status 404 returned error can't find the container with id 177ca4b4280c96a8ee33b4ae0ed1eca24c3e9faee72f888452aaefe0594be0e1 Jul 08 18:17:20.623929 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:20.623891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:20.624081 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:20.624038 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:20.624137 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:20.624098 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls podName:13a2bd72-57a5-4ee5-9ad4-b74f4702e655 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:22.624083997 +0000 UTC m=+41.638311056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls") pod "dns-default-lqqxz" (UID: "13a2bd72-57a5-4ee5-9ad4-b74f4702e655") : secret "dns-default-metrics-tls" not found Jul 08 18:17:20.945838 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:20.945748 2576 generic.go:356] "Generic (PLEG): container finished" podID="c2e66deb-ce72-4b79-b05f-2a60a0c18c51" containerID="915f41a6dad221c83beb8713fe9ce659b9f88fb521e2dfe63116611890b7fb8b" exitCode=0 Jul 08 18:17:20.946014 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:20.945828 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" event={"ID":"c2e66deb-ce72-4b79-b05f-2a60a0c18c51","Type":"ContainerDied","Data":"915f41a6dad221c83beb8713fe9ce659b9f88fb521e2dfe63116611890b7fb8b"} Jul 08 18:17:20.947042 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:20.947009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rg8rh" event={"ID":"c6350e06-e68e-4d24-94d5-785a4e570bb6","Type":"ContainerStarted","Data":"177ca4b4280c96a8ee33b4ae0ed1eca24c3e9faee72f888452aaefe0594be0e1"} Jul 08 18:17:21.952692 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:21.952492 2576 generic.go:356] "Generic (PLEG): container finished" podID="c2e66deb-ce72-4b79-b05f-2a60a0c18c51" containerID="5c32486f4c319921cff2e41537a27caf6a4918d8c10f3310ebbee0ac6e5a3625" exitCode=0 Jul 08 18:17:21.952692 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:21.952583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" event={"ID":"c2e66deb-ce72-4b79-b05f-2a60a0c18c51","Type":"ContainerDied","Data":"5c32486f4c319921cff2e41537a27caf6a4918d8c10f3310ebbee0ac6e5a3625"} Jul 08 18:17:22.640899 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:22.640853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:22.641078 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:22.641017 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:22.641124 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:22.641090 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls podName:13a2bd72-57a5-4ee5-9ad4-b74f4702e655 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:26.641068707 +0000 UTC m=+45.655295781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls") pod "dns-default-lqqxz" (UID: "13a2bd72-57a5-4ee5-9ad4-b74f4702e655") : secret "dns-default-metrics-tls" not found Jul 08 18:17:22.958201 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:22.958118 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" event={"ID":"c2e66deb-ce72-4b79-b05f-2a60a0c18c51","Type":"ContainerStarted","Data":"284ccb2f24860f5f91489c9bab48d44cf35f0b89d61bc91a80d99cc68b362392"} Jul 08 18:17:22.981673 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:22.981609 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4ws4q" podStartSLOduration=7.524802814 podStartE2EDuration="40.981588211s" totalImagesPullingTime="33.456785397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:22.981285624 +0000 UTC m=+41.995512701" watchObservedRunningTime="2026-07-08 18:17:22.981588211 +0000 UTC m=+41.995815292" Jul 08 18:17:24.964962 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:24.964921 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rg8rh" event={"ID":"c6350e06-e68e-4d24-94d5-785a4e570bb6","Type":"ContainerStarted","Data":"fccd22e708a5c7b0058a45134a2309196b07ba6fb47d76a4ace6b6f16d1634d3"} Jul 08 18:17:24.980997 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:24.980934 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rg8rh" podStartSLOduration=2.986005644 podStartE2EDuration="6.980917501s" totalImagesPullingTime="3.994911857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:24.980326059 +0000 UTC m=+43.994553137" watchObservedRunningTime="2026-07-08 18:17:24.980917501 +0000 UTC m=+43.995144554" Jul 08 18:17:26.672044 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:26.671995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:26.672481 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:26.672148 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:26.672481 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:26.672210 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls podName:13a2bd72-57a5-4ee5-9ad4-b74f4702e655 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:34.672194611 +0000 UTC m=+53.686421664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls") pod "dns-default-lqqxz" (UID: "13a2bd72-57a5-4ee5-9ad4-b74f4702e655") : secret "dns-default-metrics-tls" not found Jul 08 18:17:34.719858 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:34.719807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:34.720424 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:34.719948 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:34.720424 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:34.720013 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls podName:13a2bd72-57a5-4ee5-9ad4-b74f4702e655 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:50.719997517 +0000 UTC m=+69.734224571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls") pod "dns-default-lqqxz" (UID: "13a2bd72-57a5-4ee5-9ad4-b74f4702e655") : secret "dns-default-metrics-tls" not found Jul 08 18:17:42.928920 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:42.928885 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rl42" Jul 08 18:17:47.206727 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.206670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:17:47.206727 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.206747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:47.209414 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.209391 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:17:47.209487 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.209469 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:17:47.217435 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:47.217406 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 18:17:47.217517 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:47.217506 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs podName:f4fa372f-98c3-4c68-8bea-da69a6550422 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:51.217479024 +0000 UTC m=+130.231706078 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs") pod "network-metrics-daemon-tngjv" (UID: "f4fa372f-98c3-4c68-8bea-da69a6550422") : secret "metrics-daemon-secret" not found Jul 08 18:17:47.221664 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.221623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff0b27c4-6651-41d5-bbb0-9d13194da0ce-original-pull-secret\") pod \"global-pull-secret-syncer-4tl96\" (UID: \"ff0b27c4-6651-41d5-bbb0-9d13194da0ce\") " pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:47.266290 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.266245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tl96" Jul 08 18:17:47.307977 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.307931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68g77\" (UniqueName: \"kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77\") pod \"network-check-target-cssf9\" (UID: \"3597d6aa-69d3-4e61-80b0-57c304ca013c\") " pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:47.310935 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.310904 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 18:17:47.321460 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.321416 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 18:17:47.332375 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.332327 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68g77\" (UniqueName: \"kubernetes.io/projected/3597d6aa-69d3-4e61-80b0-57c304ca013c-kube-api-access-68g77\") pod \"network-check-target-cssf9\" (UID: \"3597d6aa-69d3-4e61-80b0-57c304ca013c\") " pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:47.404419 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.404339 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4tl96"] Jul 08 18:17:47.408854 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:17:47.408813 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0b27c4_6651_41d5_bbb0_9d13194da0ce.slice/crio-54bdbaac81c65ee106dfb11035e6646bda3252d6fbc2f0a29319f76ee349b731 WatchSource:0}: Error finding container 54bdbaac81c65ee106dfb11035e6646bda3252d6fbc2f0a29319f76ee349b731: Status 404 returned error can't find the container with id 54bdbaac81c65ee106dfb11035e6646bda3252d6fbc2f0a29319f76ee349b731 Jul 08 18:17:47.582235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.579630 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c4rm5\"" Jul 08 18:17:47.582675 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.582638 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:47.717958 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:47.717918 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cssf9"] Jul 08 18:17:47.721024 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:17:47.720989 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3597d6aa_69d3_4e61_80b0_57c304ca013c.slice/crio-61c4d0ece1a22874d1b8aa9c209df28906b850ea135f7278e9575d5c43022d98 WatchSource:0}: Error finding container 61c4d0ece1a22874d1b8aa9c209df28906b850ea135f7278e9575d5c43022d98: Status 404 returned error can't find the container with id 61c4d0ece1a22874d1b8aa9c209df28906b850ea135f7278e9575d5c43022d98 Jul 08 18:17:48.023447 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:48.023396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cssf9" event={"ID":"3597d6aa-69d3-4e61-80b0-57c304ca013c","Type":"ContainerStarted","Data":"61c4d0ece1a22874d1b8aa9c209df28906b850ea135f7278e9575d5c43022d98"} Jul 08 18:17:48.024761 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:48.024723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4tl96" event={"ID":"ff0b27c4-6651-41d5-bbb0-9d13194da0ce","Type":"ContainerStarted","Data":"54bdbaac81c65ee106dfb11035e6646bda3252d6fbc2f0a29319f76ee349b731"} Jul 08 18:17:50.733010 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:50.732973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:17:50.733456 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:50.733111 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:50.733456 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:17:50.733181 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls podName:13a2bd72-57a5-4ee5-9ad4-b74f4702e655 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:22.733162443 +0000 UTC m=+101.747389514 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls") pod "dns-default-lqqxz" (UID: "13a2bd72-57a5-4ee5-9ad4-b74f4702e655") : secret "dns-default-metrics-tls" not found Jul 08 18:17:53.039615 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:53.039567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4tl96" event={"ID":"ff0b27c4-6651-41d5-bbb0-9d13194da0ce","Type":"ContainerStarted","Data":"9b4b6a649e88f0121003d4f863af485fb759cf0434fcc5857716032217b37e19"} Jul 08 18:17:53.041093 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:53.041059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cssf9" event={"ID":"3597d6aa-69d3-4e61-80b0-57c304ca013c","Type":"ContainerStarted","Data":"0cd05546c015b847ff7d100147d6fe1976e0e58d172264e413f1a44a3bf46350"} Jul 08 18:17:53.041227 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:53.041196 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:17:53.055200 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:53.055137 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4tl96" podStartSLOduration=65.983768957 podStartE2EDuration="1m11.05512121s" totalImagesPullingTime="5.071352253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:53.054475443 +0000 UTC m=+72.068702519" watchObservedRunningTime="2026-07-08 18:17:53.05512121 +0000 UTC m=+72.069348286" Jul 08 18:17:53.069158 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:17:53.069099 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cssf9" podStartSLOduration=66.310736275 podStartE2EDuration="1m11.069082643s" totalImagesPullingTime="4.758346368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:53.068239911 +0000 UTC m=+72.082466988" watchObservedRunningTime="2026-07-08 18:17:53.069082643 +0000 UTC m=+72.083309719" Jul 08 18:18:03.570839 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.570685 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-ft4kj"] Jul 08 18:18:03.573687 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.573660 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.576349 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.576320 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 18:18:03.576533 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.576512 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 18:18:03.577227 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.577209 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:18:03.577302 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.577223 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-grf52\"" Jul 08 18:18:03.577302 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.577252 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 18:18:03.582111 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.582085 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 18:18:03.589343 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.589306 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-ft4kj"] Jul 08 18:18:03.631435 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.631395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46c25403-0132-4dd9-8bdb-8698f003933f-config\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.631435 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.631440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbbkn\" (UniqueName: \"kubernetes.io/projected/46c25403-0132-4dd9-8bdb-8698f003933f-kube-api-access-vbbkn\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.631667 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.631546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46c25403-0132-4dd9-8bdb-8698f003933f-trusted-ca\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.631667 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.631587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46c25403-0132-4dd9-8bdb-8698f003933f-serving-cert\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.675541 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.675490 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl"] Jul 08 18:18:03.679050 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.679023 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:03.681197 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.681167 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4"] Jul 08 18:18:03.681853 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.681829 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 18:18:03.682006 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.681984 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 18:18:03.682065 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.682036 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mdccq\"" Jul 08 18:18:03.682491 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.682472 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 18:18:03.682606 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.682590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 18:18:03.683911 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.683892 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-26j6r"] Jul 08 18:18:03.684053 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.684035 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" Jul 08 18:18:03.686236 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.686213 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 18:18:03.686436 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.686398 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 18:18:03.686564 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.686521 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-767c9d8797-rz9qm"] Jul 08 18:18:03.686657 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.686641 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-26j6r" Jul 08 18:18:03.686657 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.686650 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 18:18:03.686764 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.686707 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-chj2c\"" Jul 08 18:18:03.686764 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.686730 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:18:03.688963 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.688945 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:18:03.689233 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.689215 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.689233 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.689231 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vmx92\"" Jul 08 18:18:03.689396 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.689265 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 18:18:03.691430 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.691406 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 18:18:03.691589 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.691566 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 18:18:03.691589 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.691570 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 18:18:03.691849 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.691832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xmj8w\"" Jul 08 18:18:03.695842 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.695771 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl"] Jul 08 18:18:03.697494 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.697469 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 18:18:03.699612 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.699210 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4"] Jul 08 18:18:03.700101 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.700077 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-26j6r"] Jul 08 18:18:03.701149 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.701125 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-767c9d8797-rz9qm"] Jul 08 18:18:03.732711 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f0939a2-0489-42b6-8ccc-79b7488d5abc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rdcf4\" (UID: \"2f0939a2-0489-42b6-8ccc-79b7488d5abc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" Jul 08 18:18:03.732711 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-image-registry-private-configuration\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.732948 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.732948 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-trusted-ca\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.732948 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-installation-pull-secrets\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.732948 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbbkn\" (UniqueName: \"kubernetes.io/projected/46c25403-0132-4dd9-8bdb-8698f003933f-kube-api-access-vbbkn\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.732948 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmzq9\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-kube-api-access-rmzq9\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.732948 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2f0939a2-0489-42b6-8ccc-79b7488d5abc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rdcf4\" (UID: \"2f0939a2-0489-42b6-8ccc-79b7488d5abc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" Jul 08 18:18:03.732948 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-certificates\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.732948 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cmdr\" (UniqueName: \"kubernetes.io/projected/faecf749-b7f7-443b-8a0c-befc4e0800c8-kube-api-access-5cmdr\") pod \"volume-data-source-validator-5d456fdbcd-26j6r\" (UID: \"faecf749-b7f7-443b-8a0c-befc4e0800c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-26j6r" Jul 08 18:18:03.732948 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-bound-sa-token\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.733326 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.732982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46c25403-0132-4dd9-8bdb-8698f003933f-trusted-ca\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.733326 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.733052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:03.733326 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.733117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46c25403-0132-4dd9-8bdb-8698f003933f-serving-cert\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.733326 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.733152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b3e981c9-3b91-482a-96d6-287793464594-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:03.733326 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.733180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbzw7\" (UniqueName: \"kubernetes.io/projected/b3e981c9-3b91-482a-96d6-287793464594-kube-api-access-sbzw7\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:03.733326 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.733207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wknwh\" (UniqueName: \"kubernetes.io/projected/2f0939a2-0489-42b6-8ccc-79b7488d5abc-kube-api-access-wknwh\") pod \"kube-storage-version-migrator-operator-846bf668f7-rdcf4\" (UID: \"2f0939a2-0489-42b6-8ccc-79b7488d5abc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" Jul 08 18:18:03.733326 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.733237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd22e76b-2100-479e-adb4-0d26252ce70c-ca-trust-extracted\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.733326 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.733279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46c25403-0132-4dd9-8bdb-8698f003933f-config\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.733832 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.733809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46c25403-0132-4dd9-8bdb-8698f003933f-config\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.733933 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.733877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46c25403-0132-4dd9-8bdb-8698f003933f-trusted-ca\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.735593 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.735572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46c25403-0132-4dd9-8bdb-8698f003933f-serving-cert\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.740324 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.740301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbbkn\" (UniqueName: \"kubernetes.io/projected/46c25403-0132-4dd9-8bdb-8698f003933f-kube-api-access-vbbkn\") pod \"console-operator-68b757fb67-ft4kj\" (UID: \"46c25403-0132-4dd9-8bdb-8698f003933f\") " pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:03.834249 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f0939a2-0489-42b6-8ccc-79b7488d5abc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rdcf4\" (UID: \"2f0939a2-0489-42b6-8ccc-79b7488d5abc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" Jul 08 18:18:03.834249 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-image-registry-private-configuration\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.834249 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.834566 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:03.834286 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:18:03.834566 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:03.834299 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767c9d8797-rz9qm: secret "image-registry-tls" not found Jul 08 18:18:03.834566 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:03.834347 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls podName:dd22e76b-2100-479e-adb4-0d26252ce70c nodeName:}" failed. No retries permitted until 2026-07-08 18:18:04.334330567 +0000 UTC m=+83.348557622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls") pod "image-registry-767c9d8797-rz9qm" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c") : secret "image-registry-tls" not found Jul 08 18:18:03.834566 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-trusted-ca\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.834566 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-installation-pull-secrets\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.834566 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmzq9\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-kube-api-access-rmzq9\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.834566 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2f0939a2-0489-42b6-8ccc-79b7488d5abc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rdcf4\" (UID: \"2f0939a2-0489-42b6-8ccc-79b7488d5abc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" Jul 08 18:18:03.834566 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-certificates\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.834566 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cmdr\" (UniqueName: \"kubernetes.io/projected/faecf749-b7f7-443b-8a0c-befc4e0800c8-kube-api-access-5cmdr\") pod \"volume-data-source-validator-5d456fdbcd-26j6r\" (UID: \"faecf749-b7f7-443b-8a0c-befc4e0800c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-26j6r" Jul 08 18:18:03.834566 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-bound-sa-token\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.835059 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:03.835059 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b3e981c9-3b91-482a-96d6-287793464594-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:03.835059 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbzw7\" (UniqueName: \"kubernetes.io/projected/b3e981c9-3b91-482a-96d6-287793464594-kube-api-access-sbzw7\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:03.835059 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wknwh\" (UniqueName: \"kubernetes.io/projected/2f0939a2-0489-42b6-8ccc-79b7488d5abc-kube-api-access-wknwh\") pod \"kube-storage-version-migrator-operator-846bf668f7-rdcf4\" (UID: \"2f0939a2-0489-42b6-8ccc-79b7488d5abc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" Jul 08 18:18:03.835059 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd22e76b-2100-479e-adb4-0d26252ce70c-ca-trust-extracted\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.835059 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:03.834763 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:03.835059 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:03.834824 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls podName:b3e981c9-3b91-482a-96d6-287793464594 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:04.33480907 +0000 UTC m=+83.349036124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7lzkl" (UID: "b3e981c9-3b91-482a-96d6-287793464594") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:03.835059 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.834913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f0939a2-0489-42b6-8ccc-79b7488d5abc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rdcf4\" (UID: \"2f0939a2-0489-42b6-8ccc-79b7488d5abc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" Jul 08 18:18:03.835059 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.835027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd22e76b-2100-479e-adb4-0d26252ce70c-ca-trust-extracted\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.835537 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.835294 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-trusted-ca\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.835537 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.835382 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-certificates\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.835940 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.835914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b3e981c9-3b91-482a-96d6-287793464594-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:03.836947 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.836924 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-image-registry-private-configuration\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.837061 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.837043 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-installation-pull-secrets\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.837216 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.837198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2f0939a2-0489-42b6-8ccc-79b7488d5abc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rdcf4\" (UID: \"2f0939a2-0489-42b6-8ccc-79b7488d5abc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" Jul 08 18:18:03.844831 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.844802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbzw7\" (UniqueName: \"kubernetes.io/projected/b3e981c9-3b91-482a-96d6-287793464594-kube-api-access-sbzw7\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:03.845026 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.845002 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-bound-sa-token\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.845138 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.845121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cmdr\" (UniqueName: \"kubernetes.io/projected/faecf749-b7f7-443b-8a0c-befc4e0800c8-kube-api-access-5cmdr\") pod \"volume-data-source-validator-5d456fdbcd-26j6r\" (UID: \"faecf749-b7f7-443b-8a0c-befc4e0800c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-26j6r" Jul 08 18:18:03.845192 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.845122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wknwh\" (UniqueName: \"kubernetes.io/projected/2f0939a2-0489-42b6-8ccc-79b7488d5abc-kube-api-access-wknwh\") pod \"kube-storage-version-migrator-operator-846bf668f7-rdcf4\" (UID: \"2f0939a2-0489-42b6-8ccc-79b7488d5abc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" Jul 08 18:18:03.845192 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.845178 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmzq9\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-kube-api-access-rmzq9\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:03.883884 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:03.883830 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:04.001580 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:04.001542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" Jul 08 18:18:04.007603 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:04.007582 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-26j6r" Jul 08 18:18:04.015742 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:04.015712 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-ft4kj"] Jul 08 18:18:04.018923 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:04.018889 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c25403_0132_4dd9_8bdb_8698f003933f.slice/crio-c4e7a675a53026cc8e0957479f2d2d499603cfc858d8d0d6d33a7183e8cc3006 WatchSource:0}: Error finding container c4e7a675a53026cc8e0957479f2d2d499603cfc858d8d0d6d33a7183e8cc3006: Status 404 returned error can't find the container with id c4e7a675a53026cc8e0957479f2d2d499603cfc858d8d0d6d33a7183e8cc3006 Jul 08 18:18:04.072854 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:04.072813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" event={"ID":"46c25403-0132-4dd9-8bdb-8698f003933f","Type":"ContainerStarted","Data":"c4e7a675a53026cc8e0957479f2d2d499603cfc858d8d0d6d33a7183e8cc3006"} Jul 08 18:18:04.138513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:04.138476 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4"] Jul 08 18:18:04.142869 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:04.142842 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0939a2_0489_42b6_8ccc_79b7488d5abc.slice/crio-3c3de91abd5edd02ab89411b6417614991923e46f03fef8a471ed9d33f5cf4fd WatchSource:0}: Error finding container 3c3de91abd5edd02ab89411b6417614991923e46f03fef8a471ed9d33f5cf4fd: Status 404 returned error can't find the container with id 3c3de91abd5edd02ab89411b6417614991923e46f03fef8a471ed9d33f5cf4fd Jul 08 18:18:04.154463 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:04.154428 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-26j6r"] Jul 08 18:18:04.158026 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:04.157995 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaecf749_b7f7_443b_8a0c_befc4e0800c8.slice/crio-58c81354ddff81dfeb30bc591435a24782a723cab4957f9417e3352cbc1bc36b WatchSource:0}: Error finding container 58c81354ddff81dfeb30bc591435a24782a723cab4957f9417e3352cbc1bc36b: Status 404 returned error can't find the container with id 58c81354ddff81dfeb30bc591435a24782a723cab4957f9417e3352cbc1bc36b Jul 08 18:18:04.338863 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:04.338824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:04.339023 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:04.338886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:04.339023 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:04.338981 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:04.339149 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:04.339041 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:18:04.339149 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:04.339052 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls podName:b3e981c9-3b91-482a-96d6-287793464594 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:05.339036987 +0000 UTC m=+84.353264044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7lzkl" (UID: "b3e981c9-3b91-482a-96d6-287793464594") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:04.339149 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:04.339059 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767c9d8797-rz9qm: secret "image-registry-tls" not found Jul 08 18:18:04.339149 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:04.339102 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls podName:dd22e76b-2100-479e-adb4-0d26252ce70c nodeName:}" failed. No retries permitted until 2026-07-08 18:18:05.339087715 +0000 UTC m=+84.353314785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls") pod "image-registry-767c9d8797-rz9qm" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c") : secret "image-registry-tls" not found Jul 08 18:18:05.078570 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:05.078521 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" event={"ID":"2f0939a2-0489-42b6-8ccc-79b7488d5abc","Type":"ContainerStarted","Data":"3c3de91abd5edd02ab89411b6417614991923e46f03fef8a471ed9d33f5cf4fd"} Jul 08 18:18:05.080583 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:05.080517 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-26j6r" event={"ID":"faecf749-b7f7-443b-8a0c-befc4e0800c8","Type":"ContainerStarted","Data":"58c81354ddff81dfeb30bc591435a24782a723cab4957f9417e3352cbc1bc36b"} Jul 08 18:18:05.348476 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:05.348341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:05.348652 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:05.348494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:05.348652 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:05.348497 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:18:05.348652 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:05.348566 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:05.348652 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:05.348640 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls podName:b3e981c9-3b91-482a-96d6-287793464594 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:07.348618833 +0000 UTC m=+86.362845887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7lzkl" (UID: "b3e981c9-3b91-482a-96d6-287793464594") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:05.348652 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:05.348570 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767c9d8797-rz9qm: secret "image-registry-tls" not found Jul 08 18:18:05.348907 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:05.348730 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls podName:dd22e76b-2100-479e-adb4-0d26252ce70c nodeName:}" failed. No retries permitted until 2026-07-08 18:18:07.348711648 +0000 UTC m=+86.362938705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls") pod "image-registry-767c9d8797-rz9qm" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c") : secret "image-registry-tls" not found Jul 08 18:18:06.085293 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:06.085250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-26j6r" event={"ID":"faecf749-b7f7-443b-8a0c-befc4e0800c8","Type":"ContainerStarted","Data":"7a8dd0a555e3de30d3fc899733e6d7e38d9e1f8a0bd696c72167f0ad8b78a58d"} Jul 08 18:18:06.101209 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:06.101147 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-26j6r" podStartSLOduration=1.822715631 podStartE2EDuration="3.10112645s" totalImagesPullingTime="1.278410819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:06.100513103 +0000 UTC m=+85.114740180" watchObservedRunningTime="2026-07-08 18:18:06.10112645 +0000 UTC m=+85.115353528" Jul 08 18:18:07.090740 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.090631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" event={"ID":"2f0939a2-0489-42b6-8ccc-79b7488d5abc","Type":"ContainerStarted","Data":"a9302be082dad436c513ea25d93485d8af57ea3466db003dac563eee2962b0af"} Jul 08 18:18:07.092613 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.092589 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/0.log" Jul 08 18:18:07.092750 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.092626 2576 generic.go:356] "Generic (PLEG): container finished" podID="46c25403-0132-4dd9-8bdb-8698f003933f" containerID="d59829bad1f7788c57123342673369e1cf9c49bb64dbe28b0c3615b74fab22fd" exitCode=255 Jul 08 18:18:07.092750 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.092724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" event={"ID":"46c25403-0132-4dd9-8bdb-8698f003933f","Type":"ContainerDied","Data":"d59829bad1f7788c57123342673369e1cf9c49bb64dbe28b0c3615b74fab22fd"} Jul 08 18:18:07.092945 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.092927 2576 scope.go:117] "RemoveContainer" containerID="d59829bad1f7788c57123342673369e1cf9c49bb64dbe28b0c3615b74fab22fd" Jul 08 18:18:07.108012 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.107956 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" podStartSLOduration=1.424287397 podStartE2EDuration="4.107939031s" totalImagesPullingTime="2.683651634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:07.106605207 +0000 UTC m=+86.120832285" watchObservedRunningTime="2026-07-08 18:18:07.107939031 +0000 UTC m=+86.122166107" Jul 08 18:18:07.315626 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.315591 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gdg6l"] Jul 08 18:18:07.318534 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.318512 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.321060 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.321036 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 18:18:07.321329 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.321312 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 18:18:07.321461 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.321438 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 18:18:07.321582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.321463 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 18:18:07.321582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.321491 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jvjnk\"" Jul 08 18:18:07.330211 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.330184 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gdg6l"] Jul 08 18:18:07.367211 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.367120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1fc28df-e4bd-4307-996b-310fb9ac9828-data-volume\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.367211 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.367160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:07.367211 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.367192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:07.367211 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.367213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.367533 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.367242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt6gq\" (UniqueName: \"kubernetes.io/projected/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-api-access-bt6gq\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.367533 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.367286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1fc28df-e4bd-4307-996b-310fb9ac9828-crio-socket\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.367533 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.367290 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:18:07.367533 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.367300 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:07.367533 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.367311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.367533 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.367314 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767c9d8797-rz9qm: secret "image-registry-tls" not found Jul 08 18:18:07.367533 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.367404 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls podName:b3e981c9-3b91-482a-96d6-287793464594 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:11.367383098 +0000 UTC m=+90.381610155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7lzkl" (UID: "b3e981c9-3b91-482a-96d6-287793464594") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:07.367533 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.367437 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls podName:dd22e76b-2100-479e-adb4-0d26252ce70c nodeName:}" failed. No retries permitted until 2026-07-08 18:18:11.36742203 +0000 UTC m=+90.381649085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls") pod "image-registry-767c9d8797-rz9qm" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c") : secret "image-registry-tls" not found Jul 08 18:18:07.468100 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.468058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1fc28df-e4bd-4307-996b-310fb9ac9828-crio-socket\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.468100 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.468101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.468320 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.468156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1fc28df-e4bd-4307-996b-310fb9ac9828-data-volume\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.468320 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.468187 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1fc28df-e4bd-4307-996b-310fb9ac9828-crio-socket\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.468320 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.468258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.468320 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.468266 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:18:07.468320 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.468304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt6gq\" (UniqueName: \"kubernetes.io/projected/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-api-access-bt6gq\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.468597 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.468348 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm podName:e1fc28df-e4bd-4307-996b-310fb9ac9828 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:07.968327882 +0000 UTC m=+86.982554959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gdg6l" (UID: "e1fc28df-e4bd-4307-996b-310fb9ac9828") : configmap "kube-rbac-proxy" not found Jul 08 18:18:07.468597 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.468430 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:07.468597 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.468487 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls podName:e1fc28df-e4bd-4307-996b-310fb9ac9828 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:07.968469946 +0000 UTC m=+86.982697016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gdg6l" (UID: "e1fc28df-e4bd-4307-996b-310fb9ac9828") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:07.468597 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.468553 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1fc28df-e4bd-4307-996b-310fb9ac9828-data-volume\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.479469 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.479431 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt6gq\" (UniqueName: \"kubernetes.io/projected/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-api-access-bt6gq\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.972370 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.972313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.972534 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.972445 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:18:07.972534 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:07.972445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:07.972534 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.972514 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm podName:e1fc28df-e4bd-4307-996b-310fb9ac9828 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:08.972495964 +0000 UTC m=+87.986723039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gdg6l" (UID: "e1fc28df-e4bd-4307-996b-310fb9ac9828") : configmap "kube-rbac-proxy" not found Jul 08 18:18:07.972641 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.972536 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:07.972641 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:07.972578 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls podName:e1fc28df-e4bd-4307-996b-310fb9ac9828 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:08.972567651 +0000 UTC m=+87.986794707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gdg6l" (UID: "e1fc28df-e4bd-4307-996b-310fb9ac9828") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:08.098051 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.098017 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/1.log" Jul 08 18:18:08.098508 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.098493 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/0.log" Jul 08 18:18:08.098559 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.098533 2576 generic.go:356] "Generic (PLEG): container finished" podID="46c25403-0132-4dd9-8bdb-8698f003933f" containerID="41b1b950eac42df4e6001d49c12a962897dca0e6eb2bb62cd1942de158ea7267" exitCode=255 Jul 08 18:18:08.098691 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.098654 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" event={"ID":"46c25403-0132-4dd9-8bdb-8698f003933f","Type":"ContainerDied","Data":"41b1b950eac42df4e6001d49c12a962897dca0e6eb2bb62cd1942de158ea7267"} Jul 08 18:18:08.098769 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.098742 2576 scope.go:117] "RemoveContainer" containerID="d59829bad1f7788c57123342673369e1cf9c49bb64dbe28b0c3615b74fab22fd" Jul 08 18:18:08.098923 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.098905 2576 scope.go:117] "RemoveContainer" containerID="41b1b950eac42df4e6001d49c12a962897dca0e6eb2bb62cd1942de158ea7267" Jul 08 18:18:08.099129 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:08.099100 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-ft4kj_openshift-console-operator(46c25403-0132-4dd9-8bdb-8698f003933f)\"" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" podUID="46c25403-0132-4dd9-8bdb-8698f003933f" Jul 08 18:18:08.152696 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.152660 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh"] Jul 08 18:18:08.156879 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.156857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh" Jul 08 18:18:08.160097 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.160075 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 18:18:08.160244 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.160123 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 18:18:08.160244 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.160194 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b5xpt\"" Jul 08 18:18:08.165854 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.165832 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh"] Jul 08 18:18:08.275405 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.275345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcp9c\" (UniqueName: \"kubernetes.io/projected/b4fa2ab1-79bd-4a82-8c1e-bf7b21401fdd-kube-api-access-wcp9c\") pod \"migrator-d57d58cc9-chmmh\" (UID: \"b4fa2ab1-79bd-4a82-8c1e-bf7b21401fdd\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh" Jul 08 18:18:08.375860 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.375818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcp9c\" (UniqueName: \"kubernetes.io/projected/b4fa2ab1-79bd-4a82-8c1e-bf7b21401fdd-kube-api-access-wcp9c\") pod \"migrator-d57d58cc9-chmmh\" (UID: \"b4fa2ab1-79bd-4a82-8c1e-bf7b21401fdd\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh" Jul 08 18:18:08.385641 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.385606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcp9c\" (UniqueName: \"kubernetes.io/projected/b4fa2ab1-79bd-4a82-8c1e-bf7b21401fdd-kube-api-access-wcp9c\") pod \"migrator-d57d58cc9-chmmh\" (UID: \"b4fa2ab1-79bd-4a82-8c1e-bf7b21401fdd\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh" Jul 08 18:18:08.466746 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.466703 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh" Jul 08 18:18:08.590482 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.590453 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh"] Jul 08 18:18:08.593697 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:08.593662 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fa2ab1_79bd_4a82_8c1e_bf7b21401fdd.slice/crio-208745684d71554eacdd180e201ed4300612d0c6c0f9d493b27b7f2d83b8fb9e WatchSource:0}: Error finding container 208745684d71554eacdd180e201ed4300612d0c6c0f9d493b27b7f2d83b8fb9e: Status 404 returned error can't find the container with id 208745684d71554eacdd180e201ed4300612d0c6c0f9d493b27b7f2d83b8fb9e Jul 08 18:18:08.980479 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.980383 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:08.980479 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:08.980447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:08.980752 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:08.980525 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:18:08.980752 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:08.980536 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:08.980752 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:08.980589 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm podName:e1fc28df-e4bd-4307-996b-310fb9ac9828 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:10.980573837 +0000 UTC m=+89.994800891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gdg6l" (UID: "e1fc28df-e4bd-4307-996b-310fb9ac9828") : configmap "kube-rbac-proxy" not found Jul 08 18:18:08.980752 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:08.980602 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls podName:e1fc28df-e4bd-4307-996b-310fb9ac9828 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:10.980596083 +0000 UTC m=+89.994823137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gdg6l" (UID: "e1fc28df-e4bd-4307-996b-310fb9ac9828") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:09.103575 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:09.103549 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/1.log" Jul 08 18:18:09.104021 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:09.103888 2576 scope.go:117] "RemoveContainer" containerID="41b1b950eac42df4e6001d49c12a962897dca0e6eb2bb62cd1942de158ea7267" Jul 08 18:18:09.104088 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:09.104055 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-ft4kj_openshift-console-operator(46c25403-0132-4dd9-8bdb-8698f003933f)\"" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" podUID="46c25403-0132-4dd9-8bdb-8698f003933f" Jul 08 18:18:09.104805 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:09.104783 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh" event={"ID":"b4fa2ab1-79bd-4a82-8c1e-bf7b21401fdd","Type":"ContainerStarted","Data":"208745684d71554eacdd180e201ed4300612d0c6c0f9d493b27b7f2d83b8fb9e"} Jul 08 18:18:09.282245 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:09.282218 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8dmgl_b7662b55-a0d9-457d-a19f-8b2b1db85a6f/dns-node-resolver/0.log" Jul 08 18:18:10.347392 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.347339 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vck2x"] Jul 08 18:18:10.351719 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.351690 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vck2x" Jul 08 18:18:10.354183 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.354165 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 08 18:18:10.354510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.354491 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 08 18:18:10.355300 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.355280 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-v7fpk\"" Jul 08 18:18:10.355399 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.355323 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 08 18:18:10.355399 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.355283 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 08 18:18:10.358688 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.358656 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vck2x"] Jul 08 18:18:10.482525 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.482498 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zbmxw_72892583-5a63-47ab-bb5c-957e69be5460/node-ca/0.log" Jul 08 18:18:10.493896 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.493870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3e55322e-f98a-464c-9b52-b5128bc69810-signing-key\") pod \"service-ca-758f599c5-vck2x\" (UID: \"3e55322e-f98a-464c-9b52-b5128bc69810\") " pod="openshift-service-ca/service-ca-758f599c5-vck2x" Jul 08 18:18:10.494002 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.493910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3e55322e-f98a-464c-9b52-b5128bc69810-signing-cabundle\") pod \"service-ca-758f599c5-vck2x\" (UID: \"3e55322e-f98a-464c-9b52-b5128bc69810\") " pod="openshift-service-ca/service-ca-758f599c5-vck2x" Jul 08 18:18:10.494002 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.493943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cvvd\" (UniqueName: \"kubernetes.io/projected/3e55322e-f98a-464c-9b52-b5128bc69810-kube-api-access-5cvvd\") pod \"service-ca-758f599c5-vck2x\" (UID: \"3e55322e-f98a-464c-9b52-b5128bc69810\") " pod="openshift-service-ca/service-ca-758f599c5-vck2x" Jul 08 18:18:10.594434 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.594394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cvvd\" (UniqueName: \"kubernetes.io/projected/3e55322e-f98a-464c-9b52-b5128bc69810-kube-api-access-5cvvd\") pod \"service-ca-758f599c5-vck2x\" (UID: \"3e55322e-f98a-464c-9b52-b5128bc69810\") " pod="openshift-service-ca/service-ca-758f599c5-vck2x" Jul 08 18:18:10.594601 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.594558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3e55322e-f98a-464c-9b52-b5128bc69810-signing-key\") pod \"service-ca-758f599c5-vck2x\" (UID: \"3e55322e-f98a-464c-9b52-b5128bc69810\") " pod="openshift-service-ca/service-ca-758f599c5-vck2x" Jul 08 18:18:10.594601 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.594590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3e55322e-f98a-464c-9b52-b5128bc69810-signing-cabundle\") pod \"service-ca-758f599c5-vck2x\" (UID: \"3e55322e-f98a-464c-9b52-b5128bc69810\") " pod="openshift-service-ca/service-ca-758f599c5-vck2x" Jul 08 18:18:10.595179 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.595156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3e55322e-f98a-464c-9b52-b5128bc69810-signing-cabundle\") pod \"service-ca-758f599c5-vck2x\" (UID: \"3e55322e-f98a-464c-9b52-b5128bc69810\") " pod="openshift-service-ca/service-ca-758f599c5-vck2x" Jul 08 18:18:10.596960 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.596938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3e55322e-f98a-464c-9b52-b5128bc69810-signing-key\") pod \"service-ca-758f599c5-vck2x\" (UID: \"3e55322e-f98a-464c-9b52-b5128bc69810\") " pod="openshift-service-ca/service-ca-758f599c5-vck2x" Jul 08 18:18:10.602387 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.602322 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cvvd\" (UniqueName: \"kubernetes.io/projected/3e55322e-f98a-464c-9b52-b5128bc69810-kube-api-access-5cvvd\") pod \"service-ca-758f599c5-vck2x\" (UID: \"3e55322e-f98a-464c-9b52-b5128bc69810\") " pod="openshift-service-ca/service-ca-758f599c5-vck2x" Jul 08 18:18:10.660773 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.660731 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vck2x" Jul 08 18:18:10.788700 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.788666 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vck2x"] Jul 08 18:18:10.985705 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:10.985624 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e55322e_f98a_464c_9b52_b5128bc69810.slice/crio-0cfdca4376eec1ea7ce5c3d07b451bdea714195c83878d32587fd73bdd811432 WatchSource:0}: Error finding container 0cfdca4376eec1ea7ce5c3d07b451bdea714195c83878d32587fd73bdd811432: Status 404 returned error can't find the container with id 0cfdca4376eec1ea7ce5c3d07b451bdea714195c83878d32587fd73bdd811432 Jul 08 18:18:10.997790 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.997765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:10.997967 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:10.997830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:10.997967 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:10.997901 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:18:10.997967 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:10.997930 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:10.997967 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:10.997950 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm podName:e1fc28df-e4bd-4307-996b-310fb9ac9828 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:14.997935349 +0000 UTC m=+94.012162403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gdg6l" (UID: "e1fc28df-e4bd-4307-996b-310fb9ac9828") : configmap "kube-rbac-proxy" not found Jul 08 18:18:10.998126 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:10.997990 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls podName:e1fc28df-e4bd-4307-996b-310fb9ac9828 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:14.997971406 +0000 UTC m=+94.012198474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gdg6l" (UID: "e1fc28df-e4bd-4307-996b-310fb9ac9828") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:11.082298 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:11.082274 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rg8rh_c6350e06-e68e-4d24-94d5-785a4e570bb6/serve-healthcheck-canary/0.log" Jul 08 18:18:11.113039 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:11.113005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh" event={"ID":"b4fa2ab1-79bd-4a82-8c1e-bf7b21401fdd","Type":"ContainerStarted","Data":"f752d358d0c5679138b6fa31d9f64a8cb9269fff3a46c6b85643e6cf47fe998b"} Jul 08 18:18:11.114501 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:11.114471 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vck2x" event={"ID":"3e55322e-f98a-464c-9b52-b5128bc69810","Type":"ContainerStarted","Data":"0cfdca4376eec1ea7ce5c3d07b451bdea714195c83878d32587fd73bdd811432"} Jul 08 18:18:11.400618 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:11.400577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:11.400618 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:11.400630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:11.401065 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:11.400733 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 18:18:11.401065 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:11.400734 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:11.401065 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:11.400806 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls podName:b3e981c9-3b91-482a-96d6-287793464594 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:19.400789361 +0000 UTC m=+98.415016437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7lzkl" (UID: "b3e981c9-3b91-482a-96d6-287793464594") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:11.401065 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:11.400746 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767c9d8797-rz9qm: secret "image-registry-tls" not found Jul 08 18:18:11.401065 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:11.400871 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls podName:dd22e76b-2100-479e-adb4-0d26252ce70c nodeName:}" failed. No retries permitted until 2026-07-08 18:18:19.400860241 +0000 UTC m=+98.415087318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls") pod "image-registry-767c9d8797-rz9qm" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c") : secret "image-registry-tls" not found Jul 08 18:18:12.119610 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:12.119572 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh" event={"ID":"b4fa2ab1-79bd-4a82-8c1e-bf7b21401fdd","Type":"ContainerStarted","Data":"a26d203a371858952fa52476e557d84cb5db681d1e0412d2908cd5d3e505f7a8"} Jul 08 18:18:12.136604 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:12.136552 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-chmmh" podStartSLOduration=1.702420595 podStartE2EDuration="4.136534654s" totalImagesPullingTime="2.434114059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:12.135758003 +0000 UTC m=+91.149985080" watchObservedRunningTime="2026-07-08 18:18:12.136534654 +0000 UTC m=+91.150761778" Jul 08 18:18:13.884543 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:13.884493 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:13.885025 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:13.884566 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:13.885025 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:13.884998 2576 scope.go:117] "RemoveContainer" containerID="41b1b950eac42df4e6001d49c12a962897dca0e6eb2bb62cd1942de158ea7267" Jul 08 18:18:13.885209 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:13.885185 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-ft4kj_openshift-console-operator(46c25403-0132-4dd9-8bdb-8698f003933f)\"" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" podUID="46c25403-0132-4dd9-8bdb-8698f003933f" Jul 08 18:18:14.126944 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:14.126908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vck2x" event={"ID":"3e55322e-f98a-464c-9b52-b5128bc69810","Type":"ContainerStarted","Data":"4d4178bc1c9cfd82ac7bfa00a9e86637c60e3ef6f4c213fef7129d25c1656c57"} Jul 08 18:18:14.144071 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:14.143977 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-vck2x" podStartSLOduration=1.873271857 podStartE2EDuration="4.143962304s" totalImagesPullingTime="2.270690447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:14.14320906 +0000 UTC m=+93.157436148" watchObservedRunningTime="2026-07-08 18:18:14.143962304 +0000 UTC m=+93.158189380" Jul 08 18:18:15.032902 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:15.032858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:15.033399 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:15.032942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:15.033399 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:15.033013 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:18:15.033399 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:15.033068 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:15.033399 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:15.033098 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm podName:e1fc28df-e4bd-4307-996b-310fb9ac9828 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:23.033075336 +0000 UTC m=+102.047302393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gdg6l" (UID: "e1fc28df-e4bd-4307-996b-310fb9ac9828") : configmap "kube-rbac-proxy" not found Jul 08 18:18:15.033399 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:15.033119 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls podName:e1fc28df-e4bd-4307-996b-310fb9ac9828 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:23.033108957 +0000 UTC m=+102.047336018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gdg6l" (UID: "e1fc28df-e4bd-4307-996b-310fb9ac9828") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:19.468582 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:19.468546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:19.468973 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:19.468593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:19.468973 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:19.468706 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:19.468973 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:19.468773 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls podName:b3e981c9-3b91-482a-96d6-287793464594 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:35.468750589 +0000 UTC m=+114.482977661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7lzkl" (UID: "b3e981c9-3b91-482a-96d6-287793464594") : secret "cluster-monitoring-operator-tls" not found Jul 08 18:18:19.471049 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:19.471030 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls\") pod \"image-registry-767c9d8797-rz9qm\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:19.613475 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:19.613437 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:19.754304 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:19.754277 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-767c9d8797-rz9qm"] Jul 08 18:18:19.757773 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:19.757745 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd22e76b_2100_479e_adb4_0d26252ce70c.slice/crio-308c57cdd21fcfbf019b61ffae1502d96615393b54e98205fe45b67087f81a5d WatchSource:0}: Error finding container 308c57cdd21fcfbf019b61ffae1502d96615393b54e98205fe45b67087f81a5d: Status 404 returned error can't find the container with id 308c57cdd21fcfbf019b61ffae1502d96615393b54e98205fe45b67087f81a5d Jul 08 18:18:20.152985 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:20.152903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" event={"ID":"dd22e76b-2100-479e-adb4-0d26252ce70c","Type":"ContainerStarted","Data":"3b0ce671610511ef723acf91188bbc2e4b5f05320b2bcc33a2ff23852baa570c"} Jul 08 18:18:20.153151 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:20.152985 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" event={"ID":"dd22e76b-2100-479e-adb4-0d26252ce70c","Type":"ContainerStarted","Data":"308c57cdd21fcfbf019b61ffae1502d96615393b54e98205fe45b67087f81a5d"} Jul 08 18:18:20.153151 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:20.153041 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:20.174147 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:20.174094 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" podStartSLOduration=17.174077303 podStartE2EDuration="17.174077303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:20.17313204 +0000 UTC m=+99.187359118" watchObservedRunningTime="2026-07-08 18:18:20.174077303 +0000 UTC m=+99.188304379" Jul 08 18:18:22.798364 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:22.798306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:18:22.800547 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:22.800516 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13a2bd72-57a5-4ee5-9ad4-b74f4702e655-metrics-tls\") pod \"dns-default-lqqxz\" (UID: \"13a2bd72-57a5-4ee5-9ad4-b74f4702e655\") " pod="openshift-dns/dns-default-lqqxz" Jul 08 18:18:23.044235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:23.044200 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d7khc\"" Jul 08 18:18:23.052674 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:23.052605 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lqqxz" Jul 08 18:18:23.100413 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:23.100381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:23.100575 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:23.100452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:23.100575 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:23.100566 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:23.100657 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:23.100618 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls podName:e1fc28df-e4bd-4307-996b-310fb9ac9828 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:39.100605252 +0000 UTC m=+118.114832307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gdg6l" (UID: "e1fc28df-e4bd-4307-996b-310fb9ac9828") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:23.101019 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:23.100995 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fc28df-e4bd-4307-996b-310fb9ac9828-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:23.192348 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:23.192320 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lqqxz"] Jul 08 18:18:23.205696 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:23.205669 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a2bd72_57a5_4ee5_9ad4_b74f4702e655.slice/crio-6f027df9d4b3ebee2f7236bc70b96fdf242a13c65a2e4fa866f1c7008d6c4060 WatchSource:0}: Error finding container 6f027df9d4b3ebee2f7236bc70b96fdf242a13c65a2e4fa866f1c7008d6c4060: Status 404 returned error can't find the container with id 6f027df9d4b3ebee2f7236bc70b96fdf242a13c65a2e4fa866f1c7008d6c4060 Jul 08 18:18:24.046999 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:24.046969 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cssf9" Jul 08 18:18:24.170887 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:24.170848 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqqxz" event={"ID":"13a2bd72-57a5-4ee5-9ad4-b74f4702e655","Type":"ContainerStarted","Data":"6f027df9d4b3ebee2f7236bc70b96fdf242a13c65a2e4fa866f1c7008d6c4060"} Jul 08 18:18:26.179725 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:26.179683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqqxz" event={"ID":"13a2bd72-57a5-4ee5-9ad4-b74f4702e655","Type":"ContainerStarted","Data":"6afd240b1be9802f708a2c568b211f0614f7b69ac9b6b55944acef254994e7e6"} Jul 08 18:18:26.180243 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:26.179747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqqxz" event={"ID":"13a2bd72-57a5-4ee5-9ad4-b74f4702e655","Type":"ContainerStarted","Data":"4b8e3484b0d257d8aff76c927a88f3c0002c67d9b80c4fd3584f93b675c9926b"} Jul 08 18:18:26.180243 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:26.179775 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lqqxz" Jul 08 18:18:26.198471 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:26.198408 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lqqxz" podStartSLOduration=66.156562899 podStartE2EDuration="1m8.19839191s" totalImagesPullingTime="2.041829011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:26.197220483 +0000 UTC m=+105.211447562" watchObservedRunningTime="2026-07-08 18:18:26.19839191 +0000 UTC m=+105.212618983" Jul 08 18:18:26.652092 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:26.652058 2576 scope.go:117] "RemoveContainer" containerID="41b1b950eac42df4e6001d49c12a962897dca0e6eb2bb62cd1942de158ea7267" Jul 08 18:18:27.184348 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:27.184320 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:18:27.184748 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:27.184723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/1.log" Jul 08 18:18:27.184803 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:27.184754 2576 generic.go:356] "Generic (PLEG): container finished" podID="46c25403-0132-4dd9-8bdb-8698f003933f" containerID="764e415c94e255db6acc81b340cf79ae58b7e9513bdfbe71081881686a28539d" exitCode=255 Jul 08 18:18:27.184842 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:27.184823 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" event={"ID":"46c25403-0132-4dd9-8bdb-8698f003933f","Type":"ContainerDied","Data":"764e415c94e255db6acc81b340cf79ae58b7e9513bdfbe71081881686a28539d"} Jul 08 18:18:27.184883 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:27.184870 2576 scope.go:117] "RemoveContainer" containerID="41b1b950eac42df4e6001d49c12a962897dca0e6eb2bb62cd1942de158ea7267" Jul 08 18:18:27.185259 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:27.185230 2576 scope.go:117] "RemoveContainer" containerID="764e415c94e255db6acc81b340cf79ae58b7e9513bdfbe71081881686a28539d" Jul 08 18:18:27.185436 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:27.185416 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-ft4kj_openshift-console-operator(46c25403-0132-4dd9-8bdb-8698f003933f)\"" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" podUID="46c25403-0132-4dd9-8bdb-8698f003933f" Jul 08 18:18:28.190701 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:28.190667 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:18:29.109983 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:29.109937 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-767c9d8797-rz9qm"] Jul 08 18:18:33.884503 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:33.884470 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:33.884956 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:33.884575 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:33.884956 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:33.884903 2576 scope.go:117] "RemoveContainer" containerID="764e415c94e255db6acc81b340cf79ae58b7e9513bdfbe71081881686a28539d" Jul 08 18:18:33.885064 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:33.885043 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-ft4kj_openshift-console-operator(46c25403-0132-4dd9-8bdb-8698f003933f)\"" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" podUID="46c25403-0132-4dd9-8bdb-8698f003933f" Jul 08 18:18:34.210371 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:34.210281 2576 scope.go:117] "RemoveContainer" containerID="764e415c94e255db6acc81b340cf79ae58b7e9513bdfbe71081881686a28539d" Jul 08 18:18:34.210535 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:34.210460 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-ft4kj_openshift-console-operator(46c25403-0132-4dd9-8bdb-8698f003933f)\"" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" podUID="46c25403-0132-4dd9-8bdb-8698f003933f" Jul 08 18:18:35.501963 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:35.501905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:35.504559 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:35.504536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3e981c9-3b91-482a-96d6-287793464594-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7lzkl\" (UID: \"b3e981c9-3b91-482a-96d6-287793464594\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:35.792327 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:35.792282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" Jul 08 18:18:35.921793 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:35.921762 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl"] Jul 08 18:18:35.924926 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:35.924894 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e981c9_3b91_482a_96d6_287793464594.slice/crio-e9e7357dd280d722b69afcc10251d0a6a98b219a29b43964f507f6942a853f82 WatchSource:0}: Error finding container e9e7357dd280d722b69afcc10251d0a6a98b219a29b43964f507f6942a853f82: Status 404 returned error can't find the container with id e9e7357dd280d722b69afcc10251d0a6a98b219a29b43964f507f6942a853f82 Jul 08 18:18:36.187794 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:36.187695 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lqqxz" Jul 08 18:18:36.219087 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:36.219047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" event={"ID":"b3e981c9-3b91-482a-96d6-287793464594","Type":"ContainerStarted","Data":"e9e7357dd280d722b69afcc10251d0a6a98b219a29b43964f507f6942a853f82"} Jul 08 18:18:38.226989 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:38.226953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" event={"ID":"b3e981c9-3b91-482a-96d6-287793464594","Type":"ContainerStarted","Data":"e0173f914cffe77ca189ce5affc3782b7aa504340185f216ab882eb840d5e13e"} Jul 08 18:18:38.243658 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:38.243604 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7lzkl" podStartSLOduration=33.081262328 podStartE2EDuration="35.243587252s" totalImagesPullingTime="2.162324924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:38.242068835 +0000 UTC m=+117.256295912" watchObservedRunningTime="2026-07-08 18:18:38.243587252 +0000 UTC m=+117.257814328" Jul 08 18:18:39.116574 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:39.116541 2576 patch_prober.go:28] interesting pod/image-registry-767c9d8797-rz9qm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 18:18:39.116767 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:39.116595 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" podUID="dd22e76b-2100-479e-adb4-0d26252ce70c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 18:18:39.132932 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:39.132895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:39.135342 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:39.135319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fc28df-e4bd-4307-996b-310fb9ac9828-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gdg6l\" (UID: \"e1fc28df-e4bd-4307-996b-310fb9ac9828\") " pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:39.427754 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:39.427644 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gdg6l" Jul 08 18:18:39.558216 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:39.558183 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gdg6l"] Jul 08 18:18:39.561954 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:39.561919 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1fc28df_e4bd_4307_996b_310fb9ac9828.slice/crio-6830751860faca8f0480f47ffbfade27bb19e2b626b772cd526d0cb07c481929 WatchSource:0}: Error finding container 6830751860faca8f0480f47ffbfade27bb19e2b626b772cd526d0cb07c481929: Status 404 returned error can't find the container with id 6830751860faca8f0480f47ffbfade27bb19e2b626b772cd526d0cb07c481929 Jul 08 18:18:40.245217 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:40.245124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gdg6l" event={"ID":"e1fc28df-e4bd-4307-996b-310fb9ac9828","Type":"ContainerStarted","Data":"6830751860faca8f0480f47ffbfade27bb19e2b626b772cd526d0cb07c481929"} Jul 08 18:18:41.671824 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.671781 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6"] Jul 08 18:18:41.682879 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.682845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:41.683877 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.683848 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6"] Jul 08 18:18:41.685840 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.685816 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 08 18:18:41.685986 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.685836 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 08 18:18:41.687250 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.686717 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 18:18:41.687250 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.686996 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dhmx7\"" Jul 08 18:18:41.755236 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.755198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:41.755456 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.755248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn7z6\" (UniqueName: \"kubernetes.io/projected/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-kube-api-access-zn7z6\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:41.755456 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.755345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:41.755456 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.755444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:41.856535 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.856490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:41.856535 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.856538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn7z6\" (UniqueName: \"kubernetes.io/projected/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-kube-api-access-zn7z6\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:41.856775 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.856732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:41.856915 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.856889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:41.857065 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:41.857032 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 08 18:18:41.857132 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:41.857121 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-prometheus-operator-tls podName:8aa1b9d6-ce68-4e84-887a-0d162a1d816a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:42.35710113 +0000 UTC m=+121.371328198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-m6vj6" (UID: "8aa1b9d6-ce68-4e84-887a-0d162a1d816a") : secret "prometheus-operator-tls" not found Jul 08 18:18:41.857398 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.857372 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:41.859852 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.859795 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:41.866149 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:41.866084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn7z6\" (UniqueName: \"kubernetes.io/projected/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-kube-api-access-zn7z6\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:42.362246 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:42.362208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:42.364702 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:42.364665 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8aa1b9d6-ce68-4e84-887a-0d162a1d816a-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-m6vj6\" (UID: \"8aa1b9d6-ce68-4e84-887a-0d162a1d816a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:42.596322 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:42.596275 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" Jul 08 18:18:43.428645 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:43.428613 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6"] Jul 08 18:18:43.431744 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:43.431716 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa1b9d6_ce68_4e84_887a_0d162a1d816a.slice/crio-8f187debe39bd66c96139ecbcd1a5205d637eb2176e2e726ab1c928c5b3cb114 WatchSource:0}: Error finding container 8f187debe39bd66c96139ecbcd1a5205d637eb2176e2e726ab1c928c5b3cb114: Status 404 returned error can't find the container with id 8f187debe39bd66c96139ecbcd1a5205d637eb2176e2e726ab1c928c5b3cb114 Jul 08 18:18:44.262004 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:44.261933 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" event={"ID":"8aa1b9d6-ce68-4e84-887a-0d162a1d816a","Type":"ContainerStarted","Data":"8f187debe39bd66c96139ecbcd1a5205d637eb2176e2e726ab1c928c5b3cb114"} Jul 08 18:18:44.264130 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:44.264098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gdg6l" event={"ID":"e1fc28df-e4bd-4307-996b-310fb9ac9828","Type":"ContainerStarted","Data":"e30463de0b77959f6c0dc5877f7882f87ee3b6ac673d5a0848c0814a4d61e225"} Jul 08 18:18:44.264300 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:44.264154 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gdg6l" event={"ID":"e1fc28df-e4bd-4307-996b-310fb9ac9828","Type":"ContainerStarted","Data":"372aece4d5663029681e36e313b0eae9095a4a47fa96ad59eaf0088bf5296782"} Jul 08 18:18:44.652133 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:44.652103 2576 scope.go:117] "RemoveContainer" containerID="764e415c94e255db6acc81b340cf79ae58b7e9513bdfbe71081881686a28539d" Jul 08 18:18:44.652559 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:44.652269 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-ft4kj_openshift-console-operator(46c25403-0132-4dd9-8bdb-8698f003933f)\"" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" podUID="46c25403-0132-4dd9-8bdb-8698f003933f" Jul 08 18:18:45.270965 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:45.270923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" event={"ID":"8aa1b9d6-ce68-4e84-887a-0d162a1d816a","Type":"ContainerStarted","Data":"b2fcbccc609c810b305731af2aa9251c34c625b980dc58f2675443025e79e37a"} Jul 08 18:18:46.276627 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:46.276587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" event={"ID":"8aa1b9d6-ce68-4e84-887a-0d162a1d816a","Type":"ContainerStarted","Data":"e6e56c78517258f5716b8404bb5741c7ac620dc7432c2f4a8fa5681836b3e1f9"} Jul 08 18:18:46.294331 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:46.294268 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-m6vj6" podStartSLOduration=3.545354448 podStartE2EDuration="5.294251227s" totalImagesPullingTime="1.748896779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:46.293410309 +0000 UTC m=+125.307637387" watchObservedRunningTime="2026-07-08 18:18:46.294251227 +0000 UTC m=+125.308478302" Jul 08 18:18:47.281961 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:47.281919 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gdg6l" event={"ID":"e1fc28df-e4bd-4307-996b-310fb9ac9828","Type":"ContainerStarted","Data":"dbbd9c59ace882ffa8664334e08b5e926be2d323d956f178b64a69bb74819c04"} Jul 08 18:18:47.303288 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:47.303221 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gdg6l" podStartSLOduration=33.202024419 podStartE2EDuration="40.303199712s" totalImagesPullingTime="7.101175293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:18:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:47.302110743 +0000 UTC m=+126.316337818" watchObservedRunningTime="2026-07-08 18:18:47.303199712 +0000 UTC m=+126.317426788" Jul 08 18:18:48.007884 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.007846 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v"] Jul 08 18:18:48.011048 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.011021 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.013507 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.013482 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 18:18:48.013645 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.013534 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 18:18:48.013645 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.013482 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-697d5\"" Jul 08 18:18:48.021320 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.021295 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tsssm"] Jul 08 18:18:48.024575 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.024537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.024990 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.024540 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v"] Jul 08 18:18:48.027611 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.027580 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 18:18:48.027611 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.027600 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 18:18:48.027894 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.027875 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gvc99\"" Jul 08 18:18:48.027979 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.027944 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 18:18:48.110781 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.110739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.110967 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.110790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.110967 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.110871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cc596df-6635-4c66-b662-907f98506766-sys\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.110967 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.110953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfsl4\" (UniqueName: \"kubernetes.io/projected/1cc596df-6635-4c66-b662-907f98506766-kube-api-access-qfsl4\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.111063 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.111001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.111063 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.111046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9vlc\" (UniqueName: \"kubernetes.io/projected/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-kube-api-access-v9vlc\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.111125 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.111090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1cc596df-6635-4c66-b662-907f98506766-node-exporter-wtmp\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.111165 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.111138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1cc596df-6635-4c66-b662-907f98506766-node-exporter-accelerators-collector-config\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.111205 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.111172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1cc596df-6635-4c66-b662-907f98506766-node-exporter-tls\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.111249 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.111205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1cc596df-6635-4c66-b662-907f98506766-root\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.111249 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.111232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cc596df-6635-4c66-b662-907f98506766-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.111343 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.111256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1cc596df-6635-4c66-b662-907f98506766-node-exporter-textfile\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.111343 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.111287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cc596df-6635-4c66-b662-907f98506766-metrics-client-ca\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212093 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cc596df-6635-4c66-b662-907f98506766-metrics-client-ca\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212309 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.212309 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.212309 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cc596df-6635-4c66-b662-907f98506766-sys\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212309 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfsl4\" (UniqueName: \"kubernetes.io/projected/1cc596df-6635-4c66-b662-907f98506766-kube-api-access-qfsl4\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212309 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.212309 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9vlc\" (UniqueName: \"kubernetes.io/projected/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-kube-api-access-v9vlc\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.212309 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1cc596df-6635-4c66-b662-907f98506766-node-exporter-wtmp\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212698 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1cc596df-6635-4c66-b662-907f98506766-node-exporter-accelerators-collector-config\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212698 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1cc596df-6635-4c66-b662-907f98506766-node-exporter-tls\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212698 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1cc596df-6635-4c66-b662-907f98506766-root\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212698 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cc596df-6635-4c66-b662-907f98506766-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212698 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1cc596df-6635-4c66-b662-907f98506766-node-exporter-textfile\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212698 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cc596df-6635-4c66-b662-907f98506766-sys\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212960 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1cc596df-6635-4c66-b662-907f98506766-node-exporter-textfile\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212960 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.212820 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cc596df-6635-4c66-b662-907f98506766-metrics-client-ca\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.212960 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:48.212890 2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 08 18:18:48.212960 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:18:48.212949 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-openshift-state-metrics-tls podName:7b4e721c-1f42-41dd-a1d2-28a40ad445ed nodeName:}" failed. No retries permitted until 2026-07-08 18:18:48.712931313 +0000 UTC m=+127.727158382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-j8z7v" (UID: "7b4e721c-1f42-41dd-a1d2-28a40ad445ed") : secret "openshift-state-metrics-tls" not found Jul 08 18:18:48.213292 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.213267 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1cc596df-6635-4c66-b662-907f98506766-node-exporter-accelerators-collector-config\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.213459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.213440 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1cc596df-6635-4c66-b662-907f98506766-root\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.213526 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.213461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1cc596df-6635-4c66-b662-907f98506766-node-exporter-wtmp\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.213588 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.213386 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.215509 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.215485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.215611 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.215574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cc596df-6635-4c66-b662-907f98506766-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.215980 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.215963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1cc596df-6635-4c66-b662-907f98506766-node-exporter-tls\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.224395 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.224309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfsl4\" (UniqueName: \"kubernetes.io/projected/1cc596df-6635-4c66-b662-907f98506766-kube-api-access-qfsl4\") pod \"node-exporter-tsssm\" (UID: \"1cc596df-6635-4c66-b662-907f98506766\") " pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.224540 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.224432 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9vlc\" (UniqueName: \"kubernetes.io/projected/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-kube-api-access-v9vlc\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.335568 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.335478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tsssm" Jul 08 18:18:48.348786 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:48.348748 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc596df_6635_4c66_b662_907f98506766.slice/crio-333abdcbea57e7cfbaee05b30f9414df8c408fd4d5c6f8b0b06af112807b9518 WatchSource:0}: Error finding container 333abdcbea57e7cfbaee05b30f9414df8c408fd4d5c6f8b0b06af112807b9518: Status 404 returned error can't find the container with id 333abdcbea57e7cfbaee05b30f9414df8c408fd4d5c6f8b0b06af112807b9518 Jul 08 18:18:48.716677 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.716575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.719221 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.719192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b4e721c-1f42-41dd-a1d2-28a40ad445ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-j8z7v\" (UID: \"7b4e721c-1f42-41dd-a1d2-28a40ad445ed\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:48.923170 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:48.923132 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" Jul 08 18:18:49.108273 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:49.108083 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v"] Jul 08 18:18:49.118923 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:49.118885 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4e721c_1f42_41dd_a1d2_28a40ad445ed.slice/crio-3a9bdb86fb9179bd22d2f32281ec0b50a14478cf797d1fc5664b2457675c2d95 WatchSource:0}: Error finding container 3a9bdb86fb9179bd22d2f32281ec0b50a14478cf797d1fc5664b2457675c2d95: Status 404 returned error can't find the container with id 3a9bdb86fb9179bd22d2f32281ec0b50a14478cf797d1fc5664b2457675c2d95 Jul 08 18:18:49.123422 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:49.123398 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:49.292062 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:49.292020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tsssm" event={"ID":"1cc596df-6635-4c66-b662-907f98506766","Type":"ContainerStarted","Data":"333abdcbea57e7cfbaee05b30f9414df8c408fd4d5c6f8b0b06af112807b9518"} Jul 08 18:18:49.294849 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:49.294813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" event={"ID":"7b4e721c-1f42-41dd-a1d2-28a40ad445ed","Type":"ContainerStarted","Data":"e2a18cfde75f82ebdedc68ea65ec58a7ecff0f67a9a6d59e3d802725a00c4e23"} Jul 08 18:18:49.294976 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:49.294891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" event={"ID":"7b4e721c-1f42-41dd-a1d2-28a40ad445ed","Type":"ContainerStarted","Data":"3a9bdb86fb9179bd22d2f32281ec0b50a14478cf797d1fc5664b2457675c2d95"} Jul 08 18:18:50.116094 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.116061 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68d68b49d4-42cwz"] Jul 08 18:18:50.120448 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.120419 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.123325 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.123122 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 08 18:18:50.123325 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.123183 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 08 18:18:50.123325 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.123314 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lttkk\"" Jul 08 18:18:50.123621 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.123434 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 08 18:18:50.123679 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.123627 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 08 18:18:50.123726 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.123710 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3fekrd5f99bcf\"" Jul 08 18:18:50.123726 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.123718 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 08 18:18:50.130599 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.130566 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68d68b49d4-42cwz"] Jul 08 18:18:50.233092 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.233051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fd593e5-048d-469c-855f-b8cacdeab66c-metrics-client-ca\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.233277 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.233145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.233277 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.233184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgjmw\" (UniqueName: \"kubernetes.io/projected/7fd593e5-048d-469c-855f-b8cacdeab66c-kube-api-access-xgjmw\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.233277 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.233257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.233432 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.233283 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-tls\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.233432 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.233339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.233432 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.233404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-grpc-tls\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.233573 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.233441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.300786 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.300748 2576 generic.go:356] "Generic (PLEG): container finished" podID="1cc596df-6635-4c66-b662-907f98506766" containerID="8c965f2a10abf80a55e616baba9fa5e5ffbf95231dd38a17f66940b57be86684" exitCode=0 Jul 08 18:18:50.300960 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.300844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tsssm" event={"ID":"1cc596df-6635-4c66-b662-907f98506766","Type":"ContainerDied","Data":"8c965f2a10abf80a55e616baba9fa5e5ffbf95231dd38a17f66940b57be86684"} Jul 08 18:18:50.302738 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.302711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" event={"ID":"7b4e721c-1f42-41dd-a1d2-28a40ad445ed","Type":"ContainerStarted","Data":"633106c6c5f29b3dad4a8ed8e81a165486d74309637ea867f9e3ddbf4d1d55b0"} Jul 08 18:18:50.334459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.334406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fd593e5-048d-469c-855f-b8cacdeab66c-metrics-client-ca\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.334459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.334458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.334671 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.334563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgjmw\" (UniqueName: \"kubernetes.io/projected/7fd593e5-048d-469c-855f-b8cacdeab66c-kube-api-access-xgjmw\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.334671 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.334618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.334671 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.334645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-tls\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.334816 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.334678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.334816 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.334763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-grpc-tls\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.334913 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.334838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.335278 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.335209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fd593e5-048d-469c-855f-b8cacdeab66c-metrics-client-ca\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.338259 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.338138 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.338259 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.338152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-tls\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.338259 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.338187 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.338539 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.338457 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.338677 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.338634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.338789 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.338702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7fd593e5-048d-469c-855f-b8cacdeab66c-secret-grpc-tls\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.341642 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.341608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgjmw\" (UniqueName: \"kubernetes.io/projected/7fd593e5-048d-469c-855f-b8cacdeab66c-kube-api-access-xgjmw\") pod \"thanos-querier-68d68b49d4-42cwz\" (UID: \"7fd593e5-048d-469c-855f-b8cacdeab66c\") " pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.432932 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.432898 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:50.593593 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:50.593554 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68d68b49d4-42cwz"] Jul 08 18:18:50.597285 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:50.597248 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd593e5_048d_469c_855f_b8cacdeab66c.slice/crio-a1cfecd8eaa0b1fec90562cfde3ce983ed26989ecf5d21d13a123f22b34984ef WatchSource:0}: Error finding container a1cfecd8eaa0b1fec90562cfde3ce983ed26989ecf5d21d13a123f22b34984ef: Status 404 returned error can't find the container with id a1cfecd8eaa0b1fec90562cfde3ce983ed26989ecf5d21d13a123f22b34984ef Jul 08 18:18:51.245517 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:51.245483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:18:51.248349 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:51.248319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4fa372f-98c3-4c68-8bea-da69a6550422-metrics-certs\") pod \"network-metrics-daemon-tngjv\" (UID: \"f4fa372f-98c3-4c68-8bea-da69a6550422\") " pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:18:51.309822 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:51.309786 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" event={"ID":"7b4e721c-1f42-41dd-a1d2-28a40ad445ed","Type":"ContainerStarted","Data":"22cc0a34da214104002da5ddaeccbd2a4f48a13fc00fc6b910fe79a52cbf0b74"} Jul 08 18:18:51.311081 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:51.311050 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" event={"ID":"7fd593e5-048d-469c-855f-b8cacdeab66c","Type":"ContainerStarted","Data":"a1cfecd8eaa0b1fec90562cfde3ce983ed26989ecf5d21d13a123f22b34984ef"} Jul 08 18:18:51.313318 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:51.313293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tsssm" event={"ID":"1cc596df-6635-4c66-b662-907f98506766","Type":"ContainerStarted","Data":"656220b6202ddc649281caa2a93dc95ae04e05e16b521dc6e762f2a4b247e2db"} Jul 08 18:18:51.313463 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:51.313340 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tsssm" event={"ID":"1cc596df-6635-4c66-b662-907f98506766","Type":"ContainerStarted","Data":"6bbbd7efdc3d6d42d4c1c96c82d10c48281982f8825e28ba0564d65df06b4b4c"} Jul 08 18:18:51.329875 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:51.329813 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j8z7v" podStartSLOduration=3.319876829 podStartE2EDuration="4.329795065s" totalImagesPullingTime="1.009918236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:51.328793782 +0000 UTC m=+130.343020860" watchObservedRunningTime="2026-07-08 18:18:51.329795065 +0000 UTC m=+130.344022140" Jul 08 18:18:51.348199 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:51.347985 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tsssm" podStartSLOduration=1.994816534 podStartE2EDuration="3.347962049s" totalImagesPullingTime="1.285374132s" totalInitContainerRuntime="67.771383ms" isStatefulPod=true podCreationTimestamp="2026-07-08 18:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:51.347729032 +0000 UTC m=+130.361956107" watchObservedRunningTime="2026-07-08 18:18:51.347962049 +0000 UTC m=+130.362189125" Jul 08 18:18:51.480984 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:51.480951 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hn7hw\"" Jul 08 18:18:51.488483 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:51.488432 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tngjv" Jul 08 18:18:51.645835 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:51.645796 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tngjv"] Jul 08 18:18:51.650677 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:51.650625 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4fa372f_98c3_4c68_8bea_da69a6550422.slice/crio-c383fdfeb6a8a5e5ae6031d04049139484927b4a47afd8bbaee4bdfb34e2d987 WatchSource:0}: Error finding container c383fdfeb6a8a5e5ae6031d04049139484927b4a47afd8bbaee4bdfb34e2d987: Status 404 returned error can't find the container with id c383fdfeb6a8a5e5ae6031d04049139484927b4a47afd8bbaee4bdfb34e2d987 Jul 08 18:18:52.321843 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:52.321787 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tngjv" event={"ID":"f4fa372f-98c3-4c68-8bea-da69a6550422","Type":"ContainerStarted","Data":"c383fdfeb6a8a5e5ae6031d04049139484927b4a47afd8bbaee4bdfb34e2d987"} Jul 08 18:18:53.328864 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:53.328830 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" event={"ID":"7fd593e5-048d-469c-855f-b8cacdeab66c","Type":"ContainerStarted","Data":"40c5f5e8d0ece7b76bcf41ca77a4a60b0ec4a37f2c4469f2c37a2f5e690e1b8d"} Jul 08 18:18:53.331206 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:53.331109 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tngjv" event={"ID":"f4fa372f-98c3-4c68-8bea-da69a6550422","Type":"ContainerStarted","Data":"4c3f6276bfd4e2e7f368f74a1acd0d50cc423307095355b3ef383b84566cf7be"} Jul 08 18:18:54.132106 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.132053 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" podUID="dd22e76b-2100-479e-adb4-0d26252ce70c" containerName="registry" containerID="cri-o://3b0ce671610511ef723acf91188bbc2e4b5f05320b2bcc33a2ff23852baa570c" gracePeriod=30 Jul 08 18:18:54.276557 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.274174 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:18:54.279188 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.279161 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.282055 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.281834 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 18:18:54.282213 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.282088 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 18:18:54.282309 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.282283 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 18:18:54.282777 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.282483 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6lprr\"" Jul 08 18:18:54.286011 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.285265 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 18:18:54.286011 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.285322 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 18:18:54.286011 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.285273 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 18:18:54.286011 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.285559 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 18:18:54.286011 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.285642 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bg1ck4008fqj3\"" Jul 08 18:18:54.286011 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.285761 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 18:18:54.286011 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.285789 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 18:18:54.286011 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.285832 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 18:18:54.286011 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.285846 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 18:18:54.286011 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.285986 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 18:18:54.286603 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.286058 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 18:18:54.286603 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.286200 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 18:18:54.287457 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.287431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 18:18:54.304943 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.304067 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:18:54.342478 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.342389 2576 generic.go:356] "Generic (PLEG): container finished" podID="dd22e76b-2100-479e-adb4-0d26252ce70c" containerID="3b0ce671610511ef723acf91188bbc2e4b5f05320b2bcc33a2ff23852baa570c" exitCode=0 Jul 08 18:18:54.343621 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.343051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" event={"ID":"dd22e76b-2100-479e-adb4-0d26252ce70c","Type":"ContainerDied","Data":"3b0ce671610511ef723acf91188bbc2e4b5f05320b2bcc33a2ff23852baa570c"} Jul 08 18:18:54.348519 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.348463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" event={"ID":"7fd593e5-048d-469c-855f-b8cacdeab66c","Type":"ContainerStarted","Data":"cc03382506912a19c3ccb230910ff0de62fa9f490e3244a4e9e762e2557fd1ee"} Jul 08 18:18:54.348681 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.348574 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" event={"ID":"7fd593e5-048d-469c-855f-b8cacdeab66c","Type":"ContainerStarted","Data":"8cbda27c6b7e3e532d85147e7dc641070fa17cb605d3755516ff3ba22d06f773"} Jul 08 18:18:54.348681 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.348622 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" event={"ID":"7fd593e5-048d-469c-855f-b8cacdeab66c","Type":"ContainerStarted","Data":"e5e331f5faf19aad3c285569f163471ba228569e57cc0046515e3eac7f4a9b8a"} Jul 08 18:18:54.352496 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.352464 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tngjv" event={"ID":"f4fa372f-98c3-4c68-8bea-da69a6550422","Type":"ContainerStarted","Data":"7db97762ddd32046732e8cc0f922f60c096fd54ee411f86a6491a5f29763cffe"} Jul 08 18:18:54.372396 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.372280 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tngjv" podStartSLOduration=130.850909141 podStartE2EDuration="2m12.372260489s" totalImagesPullingTime="1.521351348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:54.371123718 +0000 UTC m=+133.385350796" watchObservedRunningTime="2026-07-08 18:18:54.372260489 +0000 UTC m=+133.386487565" Jul 08 18:18:54.378410 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.378347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.378701 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.378681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-config\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.378828 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.378814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.378982 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.378968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.379152 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.379138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.379334 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.379284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.379507 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.379491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.379621 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.379605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.379749 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.379736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.379844 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.379832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.379938 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.379925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.380039 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.380023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.380154 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.380140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.380252 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.380240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.380370 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.380342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-config-out\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.380483 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.380470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.380594 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.380581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.380802 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.380783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfgbp\" (UniqueName: \"kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-kube-api-access-xfgbp\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.380960 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.380930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-web-config\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.381078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.381064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.441594 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.441562 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:54.482276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.482276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.482276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.482276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.482276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.482276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.482276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-config-out\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.482276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483113 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483113 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfgbp\" (UniqueName: \"kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-kube-api-access-xfgbp\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483113 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-web-config\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483113 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483113 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483113 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.482989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483113 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.483047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-config\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483113 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.483078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483113 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.483107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483592 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.483135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483592 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.483166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483592 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.483196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.483592 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.483229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.486708 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.484693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.486708 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.485542 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.486708 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.485823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.486708 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.485897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.486708 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.486124 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.486708 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.486607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-web-config\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.487624 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.487269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.487624 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.487509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.488155 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.487979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.488155 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.488047 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.488155 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.488074 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.488523 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.488501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.488644 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.488622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.489796 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.489754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.490127 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.490096 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.490127 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.490115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.490264 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.490170 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-config\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.491282 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.491260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-config-out\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.492726 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.492702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfgbp\" (UniqueName: \"kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-kube-api-access-xfgbp\") pod \"prometheus-k8s-0\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.583779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.583740 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-trusted-ca\") pod \"dd22e76b-2100-479e-adb4-0d26252ce70c\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " Jul 08 18:18:54.583956 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.583796 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-certificates\") pod \"dd22e76b-2100-479e-adb4-0d26252ce70c\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " Jul 08 18:18:54.583956 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.583829 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls\") pod \"dd22e76b-2100-479e-adb4-0d26252ce70c\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " Jul 08 18:18:54.584079 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.583956 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd22e76b-2100-479e-adb4-0d26252ce70c-ca-trust-extracted\") pod \"dd22e76b-2100-479e-adb4-0d26252ce70c\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " Jul 08 18:18:54.584079 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.584022 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmzq9\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-kube-api-access-rmzq9\") pod \"dd22e76b-2100-479e-adb4-0d26252ce70c\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " Jul 08 18:18:54.584079 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.584053 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-installation-pull-secrets\") pod \"dd22e76b-2100-479e-adb4-0d26252ce70c\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " Jul 08 18:18:54.584228 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.584083 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-bound-sa-token\") pod \"dd22e76b-2100-479e-adb4-0d26252ce70c\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " Jul 08 18:18:54.584228 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.584131 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-image-registry-private-configuration\") pod \"dd22e76b-2100-479e-adb4-0d26252ce70c\" (UID: \"dd22e76b-2100-479e-adb4-0d26252ce70c\") " Jul 08 18:18:54.584329 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.584241 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dd22e76b-2100-479e-adb4-0d26252ce70c" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:18:54.584329 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.584269 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dd22e76b-2100-479e-adb4-0d26252ce70c" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:18:54.584738 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.584462 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-trusted-ca\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:18:54.584738 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.584485 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-certificates\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:18:54.587137 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.587065 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dd22e76b-2100-479e-adb4-0d26252ce70c" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:18:54.587298 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.587188 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dd22e76b-2100-479e-adb4-0d26252ce70c" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:18:54.587298 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.587228 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dd22e76b-2100-479e-adb4-0d26252ce70c" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:18:54.587429 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.587310 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dd22e76b-2100-479e-adb4-0d26252ce70c" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:18:54.587429 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.587406 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-kube-api-access-rmzq9" (OuterVolumeSpecName: "kube-api-access-rmzq9") pod "dd22e76b-2100-479e-adb4-0d26252ce70c" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c"). InnerVolumeSpecName "kube-api-access-rmzq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:18:54.593992 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.593950 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd22e76b-2100-479e-adb4-0d26252ce70c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dd22e76b-2100-479e-adb4-0d26252ce70c" (UID: "dd22e76b-2100-479e-adb4-0d26252ce70c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:18:54.619754 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.619696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:18:54.685677 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.685639 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-registry-tls\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:18:54.685677 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.685673 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd22e76b-2100-479e-adb4-0d26252ce70c-ca-trust-extracted\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:18:54.685892 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.685692 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmzq9\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-kube-api-access-rmzq9\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:18:54.685892 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.685704 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-installation-pull-secrets\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:18:54.685892 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.685717 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd22e76b-2100-479e-adb4-0d26252ce70c-bound-sa-token\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:18:54.685892 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.685730 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd22e76b-2100-479e-adb4-0d26252ce70c-image-registry-private-configuration\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:18:54.790583 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:54.790552 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:18:54.793110 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:18:54.793080 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401ead61_b954_4ff7_9b75_f13f41a84a84.slice/crio-0b279c1654319c3da025307327f208734dc1723d1a591c032b5ca7ffc1009805 WatchSource:0}: Error finding container 0b279c1654319c3da025307327f208734dc1723d1a591c032b5ca7ffc1009805: Status 404 returned error can't find the container with id 0b279c1654319c3da025307327f208734dc1723d1a591c032b5ca7ffc1009805 Jul 08 18:18:55.359432 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.359396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerStarted","Data":"0b279c1654319c3da025307327f208734dc1723d1a591c032b5ca7ffc1009805"} Jul 08 18:18:55.361512 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.361484 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" Jul 08 18:18:55.361644 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.361488 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767c9d8797-rz9qm" event={"ID":"dd22e76b-2100-479e-adb4-0d26252ce70c","Type":"ContainerDied","Data":"308c57cdd21fcfbf019b61ffae1502d96615393b54e98205fe45b67087f81a5d"} Jul 08 18:18:55.361731 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.361685 2576 scope.go:117] "RemoveContainer" containerID="3b0ce671610511ef723acf91188bbc2e4b5f05320b2bcc33a2ff23852baa570c" Jul 08 18:18:55.367465 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.367418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" event={"ID":"7fd593e5-048d-469c-855f-b8cacdeab66c","Type":"ContainerStarted","Data":"c264e952d54ef8e29a2eeb6917e1311e72a39aaf7c63315800c2cfc774e93774"} Jul 08 18:18:55.367621 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.367503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" event={"ID":"7fd593e5-048d-469c-855f-b8cacdeab66c","Type":"ContainerStarted","Data":"8e7fea0fd5fc209f73bd591115a21ef9885adae336b632bf33c08e1fe2a2aba8"} Jul 08 18:18:55.367929 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.367907 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:18:55.394092 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.393975 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" podStartSLOduration=2.00137212 podStartE2EDuration="5.3939535s" totalImagesPullingTime="3.39258138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:55.393072793 +0000 UTC m=+134.407299868" watchObservedRunningTime="2026-07-08 18:18:55.3939535 +0000 UTC m=+134.408180578" Jul 08 18:18:55.407335 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.407294 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-767c9d8797-rz9qm"] Jul 08 18:18:55.412470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.412436 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-767c9d8797-rz9qm"] Jul 08 18:18:55.652683 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.652647 2576 scope.go:117] "RemoveContainer" containerID="764e415c94e255db6acc81b340cf79ae58b7e9513bdfbe71081881686a28539d" Jul 08 18:18:55.659190 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:55.659154 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd22e76b-2100-479e-adb4-0d26252ce70c" path="/var/lib/kubelet/pods/dd22e76b-2100-479e-adb4-0d26252ce70c/volumes" Jul 08 18:18:56.372678 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:56.372594 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:18:56.373196 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:56.372706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" event={"ID":"46c25403-0132-4dd9-8bdb-8698f003933f","Type":"ContainerStarted","Data":"80299264c425e5a17c4631996ac75225de81c8b78c53a0bd7bedfb6806e68bb8"} Jul 08 18:18:56.373196 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:56.373072 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:56.374589 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:56.374557 2576 generic.go:356] "Generic (PLEG): container finished" podID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerID="feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298" exitCode=0 Jul 08 18:18:56.374726 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:56.374672 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerDied","Data":"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298"} Jul 08 18:18:56.378784 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:56.378755 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" Jul 08 18:18:56.390651 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:18:56.390593 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-ft4kj" podStartSLOduration=50.586405687 podStartE2EDuration="53.3905757s" totalImagesPullingTime="2.804170013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:56.389553574 +0000 UTC m=+135.403780674" watchObservedRunningTime="2026-07-08 18:18:56.3905757 +0000 UTC m=+135.404802775" Jul 08 18:19:00.402510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:00.402392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerStarted","Data":"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd"} Jul 08 18:19:00.402510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:00.402486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerStarted","Data":"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb"} Jul 08 18:19:00.403075 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:00.402522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerStarted","Data":"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263"} Jul 08 18:19:00.403075 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:00.402547 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerStarted","Data":"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1"} Jul 08 18:19:00.403075 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:00.402574 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerStarted","Data":"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1"} Jul 08 18:19:00.403075 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:00.402602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerStarted","Data":"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4"} Jul 08 18:19:00.430090 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:00.430002 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.640616681 podStartE2EDuration="6.429976406s" totalImagesPullingTime="4.769940131s" totalInitContainerRuntime="19.419594ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:19:00.428550786 +0000 UTC m=+139.442777864" watchObservedRunningTime="2026-07-08 18:19:00.429976406 +0000 UTC m=+139.444203483" Jul 08 18:19:01.383681 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:01.383651 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68d68b49d4-42cwz" Jul 08 18:19:04.620769 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:04.620730 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:19:23.481622 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:23.481590 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rg8rh_c6350e06-e68e-4d24-94d5-785a4e570bb6/serve-healthcheck-canary/0.log" Jul 08 18:19:23.502576 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:23.502541 2576 generic.go:356] "Generic (PLEG): container finished" podID="2f0939a2-0489-42b6-8ccc-79b7488d5abc" containerID="a9302be082dad436c513ea25d93485d8af57ea3466db003dac563eee2962b0af" exitCode=0 Jul 08 18:19:23.502753 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:23.502617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" event={"ID":"2f0939a2-0489-42b6-8ccc-79b7488d5abc","Type":"ContainerDied","Data":"a9302be082dad436c513ea25d93485d8af57ea3466db003dac563eee2962b0af"} Jul 08 18:19:23.503008 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:23.502992 2576 scope.go:117] "RemoveContainer" containerID="a9302be082dad436c513ea25d93485d8af57ea3466db003dac563eee2962b0af" Jul 08 18:19:24.507866 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:24.507834 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rdcf4" event={"ID":"2f0939a2-0489-42b6-8ccc-79b7488d5abc","Type":"ContainerStarted","Data":"9b652f9710b0aa5ba31d9d3b6d1577556f1508f6b3b84ada825ef7ea70dc32c8"} Jul 08 18:19:54.620238 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:54.620182 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:19:54.643370 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:54.643327 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:19:55.646756 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:19:55.646716 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:12.638721 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.638673 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:20:12.640130 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.640093 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="prometheus" containerID="cri-o://11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4" gracePeriod=600 Jul 08 18:20:12.640458 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.640406 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd" gracePeriod=600 Jul 08 18:20:12.640576 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.640432 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy-web" containerID="cri-o://c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263" gracePeriod=600 Jul 08 18:20:12.640649 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.640574 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy" containerID="cri-o://082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb" gracePeriod=600 Jul 08 18:20:12.640705 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.640624 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="thanos-sidecar" containerID="cri-o://b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1" gracePeriod=600 Jul 08 18:20:12.640760 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.640721 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="config-reloader" containerID="cri-o://007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1" gracePeriod=600 Jul 08 18:20:12.903874 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.903534 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:12.965894 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.965857 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-tls-assets\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966079 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.965928 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-1\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966079 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.965958 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-config-out\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966079 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.965983 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfgbp\" (UniqueName: \"kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-kube-api-access-xfgbp\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966079 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966030 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-config\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966079 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966055 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-thanos-prometheus-http-client-file\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966094 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-0\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966131 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966180 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-kube-rbac-proxy\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966204 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-trusted-ca-bundle\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966230 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-2\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966259 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-serving-certs-ca-bundle\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966285 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966312 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-db\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966335 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-grpc-tls\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966345 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966396 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-web-config\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966706 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966758 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-tls\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.966846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966806 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-metrics-client-certs\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.967531 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966840 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-metrics-client-ca\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.967531 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.966864 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-kubelet-serving-ca-bundle\") pod \"401ead61-b954-4ff7-9b75-f13f41a84a84\" (UID: \"401ead61-b954-4ff7-9b75-f13f41a84a84\") " Jul 08 18:20:12.967531 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.967123 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:12.967531 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.967141 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:12.967531 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.967470 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:12.967531 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.967504 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:12.968916 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.968577 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:12.970434 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.970325 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:20:12.970642 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.970512 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:20:12.970743 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.970639 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:12.970743 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.970672 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:12.972861 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.972828 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:12.973100 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.973064 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:12.973550 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.973510 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:12.974035 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.973837 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-kube-api-access-xfgbp" (OuterVolumeSpecName: "kube-api-access-xfgbp") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "kube-api-access-xfgbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:20:12.974035 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.973941 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:12.974035 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.973993 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:12.974453 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.974424 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-config-out" (OuterVolumeSpecName: "config-out") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:20:12.974944 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.974915 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:12.975504 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.975479 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:12.975619 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.975517 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-config" (OuterVolumeSpecName: "config") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:12.986149 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:12.986108 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-web-config" (OuterVolumeSpecName: "web-config") pod "401ead61-b954-4ff7-9b75-f13f41a84a84" (UID: "401ead61-b954-4ff7-9b75-f13f41a84a84"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:13.068529 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068483 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068529 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068519 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-db\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068529 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068532 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-grpc-tls\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068564 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-web-config\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068575 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068585 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-metrics-client-certs\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068595 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-metrics-client-ca\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068603 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068612 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-tls-assets\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068619 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/401ead61-b954-4ff7-9b75-f13f41a84a84-config-out\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068628 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfgbp\" (UniqueName: \"kubernetes.io/projected/401ead61-b954-4ff7-9b75-f13f41a84a84-kube-api-access-xfgbp\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068636 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-config\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068644 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068653 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068662 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068671 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/401ead61-b954-4ff7-9b75-f13f41a84a84-secret-kube-rbac-proxy\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068680 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.068779 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.068688 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401ead61-b954-4ff7-9b75-f13f41a84a84-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:20:13.709658 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709620 2576 generic.go:356] "Generic (PLEG): container finished" podID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerID="2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd" exitCode=0 Jul 08 18:20:13.709658 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709653 2576 generic.go:356] "Generic (PLEG): container finished" podID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerID="082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb" exitCode=0 Jul 08 18:20:13.709658 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709660 2576 generic.go:356] "Generic (PLEG): container finished" podID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerID="c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263" exitCode=0 Jul 08 18:20:13.709658 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709666 2576 generic.go:356] "Generic (PLEG): container finished" podID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerID="b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1" exitCode=0 Jul 08 18:20:13.709658 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709672 2576 generic.go:356] "Generic (PLEG): container finished" podID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerID="007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1" exitCode=0 Jul 08 18:20:13.709658 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709680 2576 generic.go:356] "Generic (PLEG): container finished" podID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerID="11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4" exitCode=0 Jul 08 18:20:13.710252 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709704 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.710252 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerDied","Data":"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd"} Jul 08 18:20:13.710252 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerDied","Data":"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb"} Jul 08 18:20:13.710252 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709818 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerDied","Data":"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263"} Jul 08 18:20:13.710252 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709850 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerDied","Data":"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1"} Jul 08 18:20:13.710252 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709854 2576 scope.go:117] "RemoveContainer" containerID="2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd" Jul 08 18:20:13.710252 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerDied","Data":"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1"} Jul 08 18:20:13.710252 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709927 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerDied","Data":"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4"} Jul 08 18:20:13.710252 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.709966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"401ead61-b954-4ff7-9b75-f13f41a84a84","Type":"ContainerDied","Data":"0b279c1654319c3da025307327f208734dc1723d1a591c032b5ca7ffc1009805"} Jul 08 18:20:13.718957 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.718933 2576 scope.go:117] "RemoveContainer" containerID="082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb" Jul 08 18:20:13.727577 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.727549 2576 scope.go:117] "RemoveContainer" containerID="c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263" Jul 08 18:20:13.734302 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.734267 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:20:13.736541 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.736516 2576 scope.go:117] "RemoveContainer" containerID="b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1" Jul 08 18:20:13.739400 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.739342 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:20:13.745004 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.744984 2576 scope.go:117] "RemoveContainer" containerID="007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1" Jul 08 18:20:13.753023 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.753002 2576 scope.go:117] "RemoveContainer" containerID="11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4" Jul 08 18:20:13.761818 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.761792 2576 scope.go:117] "RemoveContainer" containerID="feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298" Jul 08 18:20:13.766014 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.765986 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:20:13.766334 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766319 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd22e76b-2100-479e-adb4-0d26252ce70c" containerName="registry" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766339 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd22e76b-2100-479e-adb4-0d26252ce70c" containerName="registry" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766384 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="thanos-sidecar" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766394 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="thanos-sidecar" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766412 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="prometheus" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766420 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="prometheus" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766429 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766437 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766450 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy-web" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766458 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy-web" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766474 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="config-reloader" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766484 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="config-reloader" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766497 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="init-config-reloader" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766505 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="init-config-reloader" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766515 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy-thanos" Jul 08 18:20:13.766513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766529 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy-thanos" Jul 08 18:20:13.767082 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766598 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="thanos-sidecar" Jul 08 18:20:13.767082 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766608 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd22e76b-2100-479e-adb4-0d26252ce70c" containerName="registry" Jul 08 18:20:13.767082 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766618 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="prometheus" Jul 08 18:20:13.767082 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766629 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="config-reloader" Jul 08 18:20:13.767082 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766635 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy" Jul 08 18:20:13.767082 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766641 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy-thanos" Jul 08 18:20:13.767082 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.766647 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" containerName="kube-rbac-proxy-web" Jul 08 18:20:13.770694 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.770610 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.770757 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.770741 2576 scope.go:117] "RemoveContainer" containerID="2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd" Jul 08 18:20:13.771408 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:20:13.771345 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": container with ID starting with 2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd not found: ID does not exist" containerID="2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd" Jul 08 18:20:13.771540 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.771404 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd"} err="failed to get container status \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": rpc error: code = NotFound desc = could not find container \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": container with ID starting with 2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd not found: ID does not exist" Jul 08 18:20:13.771540 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.771450 2576 scope.go:117] "RemoveContainer" containerID="082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb" Jul 08 18:20:13.771759 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:20:13.771739 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": container with ID starting with 082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb not found: ID does not exist" containerID="082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb" Jul 08 18:20:13.771798 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.771770 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb"} err="failed to get container status \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": rpc error: code = NotFound desc = could not find container \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": container with ID starting with 082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb not found: ID does not exist" Jul 08 18:20:13.771838 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.771797 2576 scope.go:117] "RemoveContainer" containerID="c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263" Jul 08 18:20:13.772095 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:20:13.772073 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": container with ID starting with c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263 not found: ID does not exist" containerID="c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263" Jul 08 18:20:13.772158 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.772103 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263"} err="failed to get container status \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": rpc error: code = NotFound desc = could not find container \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": container with ID starting with c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263 not found: ID does not exist" Jul 08 18:20:13.772158 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.772120 2576 scope.go:117] "RemoveContainer" containerID="b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1" Jul 08 18:20:13.772392 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:20:13.772373 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": container with ID starting with b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1 not found: ID does not exist" containerID="b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1" Jul 08 18:20:13.772459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.772401 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1"} err="failed to get container status \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": rpc error: code = NotFound desc = could not find container \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": container with ID starting with b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1 not found: ID does not exist" Jul 08 18:20:13.772459 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.772423 2576 scope.go:117] "RemoveContainer" containerID="007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1" Jul 08 18:20:13.772726 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:20:13.772709 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": container with ID starting with 007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1 not found: ID does not exist" containerID="007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1" Jul 08 18:20:13.772820 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.772731 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1"} err="failed to get container status \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": rpc error: code = NotFound desc = could not find container \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": container with ID starting with 007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1 not found: ID does not exist" Jul 08 18:20:13.772820 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.772747 2576 scope.go:117] "RemoveContainer" containerID="11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4" Jul 08 18:20:13.773015 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:20:13.772996 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": container with ID starting with 11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4 not found: ID does not exist" containerID="11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4" Jul 08 18:20:13.773088 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773024 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4"} err="failed to get container status \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": rpc error: code = NotFound desc = could not find container \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": container with ID starting with 11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4 not found: ID does not exist" Jul 08 18:20:13.773088 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773057 2576 scope.go:117] "RemoveContainer" containerID="feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298" Jul 08 18:20:13.773341 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:20:13.773295 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": container with ID starting with feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298 not found: ID does not exist" containerID="feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298" Jul 08 18:20:13.773341 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773327 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298"} err="failed to get container status \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": rpc error: code = NotFound desc = could not find container \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": container with ID starting with feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298 not found: ID does not exist" Jul 08 18:20:13.773500 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773346 2576 scope.go:117] "RemoveContainer" containerID="2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd" Jul 08 18:20:13.773500 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773416 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 18:20:13.773500 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773434 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 18:20:13.773905 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773568 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6lprr\"" Jul 08 18:20:13.773905 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773672 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 18:20:13.773905 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773690 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 18:20:13.773905 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773709 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd"} err="failed to get container status \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": rpc error: code = NotFound desc = could not find container \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": container with ID starting with 2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd not found: ID does not exist" Jul 08 18:20:13.773905 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773737 2576 scope.go:117] "RemoveContainer" containerID="082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb" Jul 08 18:20:13.774177 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773911 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 18:20:13.774177 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773924 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bg1ck4008fqj3\"" Jul 08 18:20:13.774177 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773980 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 18:20:13.774177 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.773976 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 18:20:13.774177 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774122 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb"} err="failed to get container status \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": rpc error: code = NotFound desc = could not find container \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": container with ID starting with 082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb not found: ID does not exist" Jul 08 18:20:13.774177 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774145 2576 scope.go:117] "RemoveContainer" containerID="c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774266 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774290 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prfcb\" (UniqueName: \"kubernetes.io/projected/0143fcea-64ec-4d0c-8e93-9c43c5d48393-kube-api-access-prfcb\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0143fcea-64ec-4d0c-8e93-9c43c5d48393-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-config\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774653 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774702 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774621 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774791 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.775345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-web-config\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.777218 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0143fcea-64ec-4d0c-8e93-9c43c5d48393-config-out\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.777218 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.774961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.777218 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.775009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.777218 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.775042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.777218 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.775073 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.777218 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.775102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.777218 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.775169 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263"} err="failed to get container status \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": rpc error: code = NotFound desc = could not find container \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": container with ID starting with c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263 not found: ID does not exist" Jul 08 18:20:13.777218 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.775184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.777218 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.775217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.777218 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.775263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.777218 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.775193 2576 scope.go:117] "RemoveContainer" containerID="b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1" Jul 08 18:20:13.777734 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.777245 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1"} err="failed to get container status \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": rpc error: code = NotFound desc = could not find container \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": container with ID starting with b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1 not found: ID does not exist" Jul 08 18:20:13.777734 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.777292 2576 scope.go:117] "RemoveContainer" containerID="007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1" Jul 08 18:20:13.777861 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.777832 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1"} err="failed to get container status \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": rpc error: code = NotFound desc = could not find container \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": container with ID starting with 007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1 not found: ID does not exist" Jul 08 18:20:13.777989 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.777862 2576 scope.go:117] "RemoveContainer" containerID="11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4" Jul 08 18:20:13.778197 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.778169 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4"} err="failed to get container status \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": rpc error: code = NotFound desc = could not find container \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": container with ID starting with 11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4 not found: ID does not exist" Jul 08 18:20:13.778197 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.778197 2576 scope.go:117] "RemoveContainer" containerID="feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298" Jul 08 18:20:13.778397 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.778213 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 18:20:13.778513 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.778492 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298"} err="failed to get container status \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": rpc error: code = NotFound desc = could not find container \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": container with ID starting with feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298 not found: ID does not exist" Jul 08 18:20:13.778587 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.778513 2576 scope.go:117] "RemoveContainer" containerID="2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd" Jul 08 18:20:13.778808 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.778785 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd"} err="failed to get container status \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": rpc error: code = NotFound desc = could not find container \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": container with ID starting with 2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd not found: ID does not exist" Jul 08 18:20:13.778808 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.778807 2576 scope.go:117] "RemoveContainer" containerID="082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb" Jul 08 18:20:13.779040 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.779024 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb"} err="failed to get container status \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": rpc error: code = NotFound desc = could not find container \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": container with ID starting with 082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb not found: ID does not exist" Jul 08 18:20:13.779085 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.779040 2576 scope.go:117] "RemoveContainer" containerID="c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263" Jul 08 18:20:13.779250 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.779231 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263"} err="failed to get container status \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": rpc error: code = NotFound desc = could not find container \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": container with ID starting with c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263 not found: ID does not exist" Jul 08 18:20:13.779295 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.779252 2576 scope.go:117] "RemoveContainer" containerID="b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1" Jul 08 18:20:13.779521 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.779502 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1"} err="failed to get container status \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": rpc error: code = NotFound desc = could not find container \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": container with ID starting with b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1 not found: ID does not exist" Jul 08 18:20:13.779594 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.779521 2576 scope.go:117] "RemoveContainer" containerID="007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1" Jul 08 18:20:13.779745 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.779726 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1"} err="failed to get container status \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": rpc error: code = NotFound desc = could not find container \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": container with ID starting with 007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1 not found: ID does not exist" Jul 08 18:20:13.779745 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.779743 2576 scope.go:117] "RemoveContainer" containerID="11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4" Jul 08 18:20:13.780028 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.779965 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4"} err="failed to get container status \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": rpc error: code = NotFound desc = could not find container \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": container with ID starting with 11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4 not found: ID does not exist" Jul 08 18:20:13.780028 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.780000 2576 scope.go:117] "RemoveContainer" containerID="feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298" Jul 08 18:20:13.780318 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.780289 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298"} err="failed to get container status \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": rpc error: code = NotFound desc = could not find container \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": container with ID starting with feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298 not found: ID does not exist" Jul 08 18:20:13.780318 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.780310 2576 scope.go:117] "RemoveContainer" containerID="2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd" Jul 08 18:20:13.780648 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.780571 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd"} err="failed to get container status \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": rpc error: code = NotFound desc = could not find container \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": container with ID starting with 2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd not found: ID does not exist" Jul 08 18:20:13.780648 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.780590 2576 scope.go:117] "RemoveContainer" containerID="082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb" Jul 08 18:20:13.780839 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.780811 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb"} err="failed to get container status \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": rpc error: code = NotFound desc = could not find container \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": container with ID starting with 082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb not found: ID does not exist" Jul 08 18:20:13.780935 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.780841 2576 scope.go:117] "RemoveContainer" containerID="c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263" Jul 08 18:20:13.781089 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.781070 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 18:20:13.781139 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.781076 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263"} err="failed to get container status \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": rpc error: code = NotFound desc = could not find container \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": container with ID starting with c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263 not found: ID does not exist" Jul 08 18:20:13.781139 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.781106 2576 scope.go:117] "RemoveContainer" containerID="b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1" Jul 08 18:20:13.781343 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.781319 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1"} err="failed to get container status \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": rpc error: code = NotFound desc = could not find container \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": container with ID starting with b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1 not found: ID does not exist" Jul 08 18:20:13.781448 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.781346 2576 scope.go:117] "RemoveContainer" containerID="007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1" Jul 08 18:20:13.781702 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.781656 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1"} err="failed to get container status \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": rpc error: code = NotFound desc = could not find container \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": container with ID starting with 007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1 not found: ID does not exist" Jul 08 18:20:13.781702 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.781695 2576 scope.go:117] "RemoveContainer" containerID="11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4" Jul 08 18:20:13.782321 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.782297 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4"} err="failed to get container status \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": rpc error: code = NotFound desc = could not find container \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": container with ID starting with 11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4 not found: ID does not exist" Jul 08 18:20:13.782321 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.782322 2576 scope.go:117] "RemoveContainer" containerID="feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298" Jul 08 18:20:13.782621 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.782601 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298"} err="failed to get container status \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": rpc error: code = NotFound desc = could not find container \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": container with ID starting with feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298 not found: ID does not exist" Jul 08 18:20:13.782621 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.782621 2576 scope.go:117] "RemoveContainer" containerID="2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd" Jul 08 18:20:13.782853 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.782833 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd"} err="failed to get container status \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": rpc error: code = NotFound desc = could not find container \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": container with ID starting with 2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd not found: ID does not exist" Jul 08 18:20:13.782933 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.782862 2576 scope.go:117] "RemoveContainer" containerID="082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb" Jul 08 18:20:13.783093 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.783078 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb"} err="failed to get container status \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": rpc error: code = NotFound desc = could not find container \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": container with ID starting with 082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb not found: ID does not exist" Jul 08 18:20:13.783133 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.783093 2576 scope.go:117] "RemoveContainer" containerID="c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263" Jul 08 18:20:13.783326 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.783307 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263"} err="failed to get container status \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": rpc error: code = NotFound desc = could not find container \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": container with ID starting with c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263 not found: ID does not exist" Jul 08 18:20:13.783419 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.783326 2576 scope.go:117] "RemoveContainer" containerID="b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1" Jul 08 18:20:13.783606 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.783578 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1"} err="failed to get container status \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": rpc error: code = NotFound desc = could not find container \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": container with ID starting with b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1 not found: ID does not exist" Jul 08 18:20:13.783606 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.783603 2576 scope.go:117] "RemoveContainer" containerID="007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1" Jul 08 18:20:13.784187 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.784127 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1"} err="failed to get container status \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": rpc error: code = NotFound desc = could not find container \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": container with ID starting with 007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1 not found: ID does not exist" Jul 08 18:20:13.784187 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.784153 2576 scope.go:117] "RemoveContainer" containerID="11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4" Jul 08 18:20:13.784517 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.784490 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4"} err="failed to get container status \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": rpc error: code = NotFound desc = could not find container \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": container with ID starting with 11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4 not found: ID does not exist" Jul 08 18:20:13.784585 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.784519 2576 scope.go:117] "RemoveContainer" containerID="feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298" Jul 08 18:20:13.784812 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.784785 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298"} err="failed to get container status \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": rpc error: code = NotFound desc = could not find container \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": container with ID starting with feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298 not found: ID does not exist" Jul 08 18:20:13.784812 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.784810 2576 scope.go:117] "RemoveContainer" containerID="2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd" Jul 08 18:20:13.785101 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.785083 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd"} err="failed to get container status \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": rpc error: code = NotFound desc = could not find container \"2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd\": container with ID starting with 2eb6f4b9b46c592dfaf6925870ab2449562034f1c98faf6498169f9b6fcddacd not found: ID does not exist" Jul 08 18:20:13.785153 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.785102 2576 scope.go:117] "RemoveContainer" containerID="082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb" Jul 08 18:20:13.785339 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.785320 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb"} err="failed to get container status \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": rpc error: code = NotFound desc = could not find container \"082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb\": container with ID starting with 082126cc74838905b02de8a8cf8dd0acc1f03251e11f17455844e23bdfd81adb not found: ID does not exist" Jul 08 18:20:13.785437 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.785341 2576 scope.go:117] "RemoveContainer" containerID="c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263" Jul 08 18:20:13.785616 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.785591 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263"} err="failed to get container status \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": rpc error: code = NotFound desc = could not find container \"c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263\": container with ID starting with c5a32028984eb93fc0e6eacf1abe685693af0b7fb12495b7e1889a858e01f263 not found: ID does not exist" Jul 08 18:20:13.785704 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.785618 2576 scope.go:117] "RemoveContainer" containerID="b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1" Jul 08 18:20:13.785910 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.785890 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1"} err="failed to get container status \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": rpc error: code = NotFound desc = could not find container \"b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1\": container with ID starting with b4fb6a3f60ac288060647668145f155711aa3556094955e34ca156aef119d4f1 not found: ID does not exist" Jul 08 18:20:13.785983 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.785910 2576 scope.go:117] "RemoveContainer" containerID="007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1" Jul 08 18:20:13.786168 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.786149 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1"} err="failed to get container status \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": rpc error: code = NotFound desc = could not find container \"007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1\": container with ID starting with 007a43e05d80e1df87307d8f247c4a36967d73e7c5f31bc6fc373227aac01dc1 not found: ID does not exist" Jul 08 18:20:13.786232 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.786168 2576 scope.go:117] "RemoveContainer" containerID="11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4" Jul 08 18:20:13.786232 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.786179 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:20:13.786406 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.786388 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4"} err="failed to get container status \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": rpc error: code = NotFound desc = could not find container \"11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4\": container with ID starting with 11cf91197d707c96bcfb098c1ef0f8bcd8db9406732e874b5e95e6b4322689d4 not found: ID does not exist" Jul 08 18:20:13.786476 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.786405 2576 scope.go:117] "RemoveContainer" containerID="feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298" Jul 08 18:20:13.786657 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.786638 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298"} err="failed to get container status \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": rpc error: code = NotFound desc = could not find container \"feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298\": container with ID starting with feb1909ed405a94116cd54a24c7843d63b1eb2a64c1127e9a2e695fa2d737298 not found: ID does not exist" Jul 08 18:20:13.876163 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876163 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-web-config\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0143fcea-64ec-4d0c-8e93-9c43c5d48393-config-out\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876383 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876949 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876949 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876949 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876949 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prfcb\" (UniqueName: \"kubernetes.io/projected/0143fcea-64ec-4d0c-8e93-9c43c5d48393-kube-api-access-prfcb\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876949 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0143fcea-64ec-4d0c-8e93-9c43c5d48393-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876949 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876949 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876949 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-config\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.876949 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.876919 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.877422 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.877021 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.877589 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.877561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.877794 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.877769 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.879538 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.879499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-web-config\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.879669 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.879541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.879669 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.879591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.879811 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.879783 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-config\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.879873 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.879809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.880311 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.880278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.880463 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.880440 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.880533 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.880503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.880672 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.880653 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.881046 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.881017 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0143fcea-64ec-4d0c-8e93-9c43c5d48393-config-out\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.881475 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.881453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.881855 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.881834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0143fcea-64ec-4d0c-8e93-9c43c5d48393-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.882237 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.882215 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.882854 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.882834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0143fcea-64ec-4d0c-8e93-9c43c5d48393-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.883384 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.883334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0143fcea-64ec-4d0c-8e93-9c43c5d48393-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:13.889102 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:13.889068 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prfcb\" (UniqueName: \"kubernetes.io/projected/0143fcea-64ec-4d0c-8e93-9c43c5d48393-kube-api-access-prfcb\") pod \"prometheus-k8s-0\" (UID: \"0143fcea-64ec-4d0c-8e93-9c43c5d48393\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:14.084973 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:14.084928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:20:14.233210 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:14.233171 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:20:14.239005 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:20:14.238978 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0143fcea_64ec_4d0c_8e93_9c43c5d48393.slice/crio-e717f3a5eddaea1a65f25e524ebeeadf95b32e2688d408ff7bcc1289ae71701d WatchSource:0}: Error finding container e717f3a5eddaea1a65f25e524ebeeadf95b32e2688d408ff7bcc1289ae71701d: Status 404 returned error can't find the container with id e717f3a5eddaea1a65f25e524ebeeadf95b32e2688d408ff7bcc1289ae71701d Jul 08 18:20:14.717103 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:14.717065 2576 generic.go:356] "Generic (PLEG): container finished" podID="0143fcea-64ec-4d0c-8e93-9c43c5d48393" containerID="d9b94f99dad04c41a687cf88dc69571a208bc7f97058ff47d315fd476c6337c6" exitCode=0 Jul 08 18:20:14.717497 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:14.717129 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0143fcea-64ec-4d0c-8e93-9c43c5d48393","Type":"ContainerDied","Data":"d9b94f99dad04c41a687cf88dc69571a208bc7f97058ff47d315fd476c6337c6"} Jul 08 18:20:14.717497 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:14.717211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0143fcea-64ec-4d0c-8e93-9c43c5d48393","Type":"ContainerStarted","Data":"e717f3a5eddaea1a65f25e524ebeeadf95b32e2688d408ff7bcc1289ae71701d"} Jul 08 18:20:15.657888 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:15.657838 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="401ead61-b954-4ff7-9b75-f13f41a84a84" path="/var/lib/kubelet/pods/401ead61-b954-4ff7-9b75-f13f41a84a84/volumes" Jul 08 18:20:15.726041 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:15.726006 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0143fcea-64ec-4d0c-8e93-9c43c5d48393","Type":"ContainerStarted","Data":"e698301c5ebf1c5d7fad12be5f4f61344a6bf632d3189a8cb5cbc42f9a503b34"} Jul 08 18:20:15.726434 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:15.726073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0143fcea-64ec-4d0c-8e93-9c43c5d48393","Type":"ContainerStarted","Data":"bbd5a36d45c10b6515c8a2c069fe08edaea69e9a970c56a36c0e33df3de07e4f"} Jul 08 18:20:15.726434 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:15.726101 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0143fcea-64ec-4d0c-8e93-9c43c5d48393","Type":"ContainerStarted","Data":"b5c26d327b30d5bbe639b3ef3cf6e7e43d7df4c4a1dbb7bb0932ca65091a3af8"} Jul 08 18:20:15.726434 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:15.726134 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0143fcea-64ec-4d0c-8e93-9c43c5d48393","Type":"ContainerStarted","Data":"5df053cca5804cbf4cee67dd336e670b9409fe401cbf5fe5ddd079be5d5122d1"} Jul 08 18:20:15.726434 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:15.726159 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0143fcea-64ec-4d0c-8e93-9c43c5d48393","Type":"ContainerStarted","Data":"16e711dfbe517faed397613ac392e05e919bbd89743cf2d059e13f2f9cc4d716"} Jul 08 18:20:15.726434 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:15.726193 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0143fcea-64ec-4d0c-8e93-9c43c5d48393","Type":"ContainerStarted","Data":"7de731924c3e8eec65bd4376644866b8bc72753c206f4e92e2a812f3633d1532"} Jul 08 18:20:15.756318 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:15.756230 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.734679022 podStartE2EDuration="2.756207938s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.528916ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:20:15.754570127 +0000 UTC m=+214.768797202" watchObservedRunningTime="2026-07-08 18:20:15.756207938 +0000 UTC m=+214.770435013" Jul 08 18:20:19.085757 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:20:19.085701 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:21:14.086210 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:21:14.086104 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:21:14.101887 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:21:14.101864 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:21:14.988058 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:21:14.988027 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:21:41.406210 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:21:41.406179 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:21:41.411605 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:21:41.411572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:21:41.411789 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:21:41.411617 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:21:41.416560 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:21:41.416528 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:21:41.416864 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:21:41.416849 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 18:23:24.438164 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.438126 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz"] Jul 08 18:23:24.441239 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.441220 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz" Jul 08 18:23:24.443686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.443659 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 18:23:24.443686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.443663 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 18:23:24.444678 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.444658 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-znlz9\"" Jul 08 18:23:24.450854 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.450825 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz"] Jul 08 18:23:24.479594 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.479557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwrcv\" (UniqueName: \"kubernetes.io/projected/2dc48fef-115e-4f1b-9acc-9f2725121ed2-kube-api-access-dwrcv\") pod \"cert-manager-cainjector-559cdd8c87-jqfnz\" (UID: \"2dc48fef-115e-4f1b-9acc-9f2725121ed2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz" Jul 08 18:23:24.479771 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.479605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dc48fef-115e-4f1b-9acc-9f2725121ed2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jqfnz\" (UID: \"2dc48fef-115e-4f1b-9acc-9f2725121ed2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz" Jul 08 18:23:24.580075 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.580035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwrcv\" (UniqueName: \"kubernetes.io/projected/2dc48fef-115e-4f1b-9acc-9f2725121ed2-kube-api-access-dwrcv\") pod \"cert-manager-cainjector-559cdd8c87-jqfnz\" (UID: \"2dc48fef-115e-4f1b-9acc-9f2725121ed2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz" Jul 08 18:23:24.580301 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.580101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dc48fef-115e-4f1b-9acc-9f2725121ed2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jqfnz\" (UID: \"2dc48fef-115e-4f1b-9acc-9f2725121ed2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz" Jul 08 18:23:24.590708 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.590671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2dc48fef-115e-4f1b-9acc-9f2725121ed2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jqfnz\" (UID: \"2dc48fef-115e-4f1b-9acc-9f2725121ed2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz" Jul 08 18:23:24.590848 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.590743 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwrcv\" (UniqueName: \"kubernetes.io/projected/2dc48fef-115e-4f1b-9acc-9f2725121ed2-kube-api-access-dwrcv\") pod \"cert-manager-cainjector-559cdd8c87-jqfnz\" (UID: \"2dc48fef-115e-4f1b-9acc-9f2725121ed2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz" Jul 08 18:23:24.760488 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.760449 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz" Jul 08 18:23:24.906893 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.906862 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz"] Jul 08 18:23:24.909741 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:23:24.909711 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dc48fef_115e_4f1b_9acc_9f2725121ed2.slice/crio-115b75b6aba43f2274f6011f0d48cdbc5b2679a5923a8df2217e2c3525b95c41 WatchSource:0}: Error finding container 115b75b6aba43f2274f6011f0d48cdbc5b2679a5923a8df2217e2c3525b95c41: Status 404 returned error can't find the container with id 115b75b6aba43f2274f6011f0d48cdbc5b2679a5923a8df2217e2c3525b95c41 Jul 08 18:23:24.911924 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:24.911902 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:23:25.501886 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:25.501802 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz" event={"ID":"2dc48fef-115e-4f1b-9acc-9f2725121ed2","Type":"ContainerStarted","Data":"115b75b6aba43f2274f6011f0d48cdbc5b2679a5923a8df2217e2c3525b95c41"} Jul 08 18:23:28.516943 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:28.516900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz" event={"ID":"2dc48fef-115e-4f1b-9acc-9f2725121ed2","Type":"ContainerStarted","Data":"5f4f4776a1ace50cc600bca9de0c910e4760911f12ae6d749f0bc37762c3b167"} Jul 08 18:23:28.532968 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:28.532911 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jqfnz" podStartSLOduration=1.572220251 podStartE2EDuration="4.532894084s" totalImagesPullingTime="2.960673833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:23:28.531924407 +0000 UTC m=+407.546151486" watchObservedRunningTime="2026-07-08 18:23:28.532894084 +0000 UTC m=+407.547121160" Jul 08 18:23:55.036041 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.035993 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2"] Jul 08 18:23:55.040812 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.040780 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.044508 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.044479 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 18:23:55.044508 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.044493 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 18:23:55.044723 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.044540 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 18:23:55.044723 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.044479 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 18:23:55.044723 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.044499 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:23:55.044723 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.044479 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sz25f\"" Jul 08 18:23:55.049992 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.049960 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2"] Jul 08 18:23:55.156706 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.156665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjmwl\" (UniqueName: \"kubernetes.io/projected/c52026eb-3255-4f2f-941b-45f49227fbd3-kube-api-access-bjmwl\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.156917 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.156728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c52026eb-3255-4f2f-941b-45f49227fbd3-metrics-cert\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.156917 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.156802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c52026eb-3255-4f2f-941b-45f49227fbd3-cert\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.156917 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.156876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c52026eb-3255-4f2f-941b-45f49227fbd3-manager-config\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.258063 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.258023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c52026eb-3255-4f2f-941b-45f49227fbd3-manager-config\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.258284 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.258081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjmwl\" (UniqueName: \"kubernetes.io/projected/c52026eb-3255-4f2f-941b-45f49227fbd3-kube-api-access-bjmwl\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.258284 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.258112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c52026eb-3255-4f2f-941b-45f49227fbd3-metrics-cert\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.258284 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.258134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c52026eb-3255-4f2f-941b-45f49227fbd3-cert\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.258838 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.258813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c52026eb-3255-4f2f-941b-45f49227fbd3-manager-config\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.260710 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.260688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c52026eb-3255-4f2f-941b-45f49227fbd3-metrics-cert\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.260857 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.260787 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c52026eb-3255-4f2f-941b-45f49227fbd3-cert\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.268639 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.268614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjmwl\" (UniqueName: \"kubernetes.io/projected/c52026eb-3255-4f2f-941b-45f49227fbd3-kube-api-access-bjmwl\") pod \"lws-controller-manager-85f5474f9b-5cvm2\" (UID: \"c52026eb-3255-4f2f-941b-45f49227fbd3\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.351594 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.351495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:23:55.511078 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.511034 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2"] Jul 08 18:23:55.514239 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:23:55.514203 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52026eb_3255_4f2f_941b_45f49227fbd3.slice/crio-cedbe5e13f84c03c4cf36d1073758bdb020cfb5757d355a80b73dc1858fbf07a WatchSource:0}: Error finding container cedbe5e13f84c03c4cf36d1073758bdb020cfb5757d355a80b73dc1858fbf07a: Status 404 returned error can't find the container with id cedbe5e13f84c03c4cf36d1073758bdb020cfb5757d355a80b73dc1858fbf07a Jul 08 18:23:55.629413 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.629293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" event={"ID":"c52026eb-3255-4f2f-941b-45f49227fbd3","Type":"ContainerStarted","Data":"cedbe5e13f84c03c4cf36d1073758bdb020cfb5757d355a80b73dc1858fbf07a"} Jul 08 18:23:55.692801 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.692764 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9"] Jul 08 18:23:55.697901 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.697870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.700500 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.700470 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 18:23:55.700811 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.700792 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 18:23:55.701074 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.701058 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 18:23:55.701166 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.701062 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 18:23:55.701519 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.701504 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vlpxl\"" Jul 08 18:23:55.715670 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.715637 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9"] Jul 08 18:23:55.863870 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.863827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f48164-c3aa-4af0-a914-97e08ff1b1e3-tmp\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.864089 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.863889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncwnr\" (UniqueName: \"kubernetes.io/projected/12f48164-c3aa-4af0-a914-97e08ff1b1e3-kube-api-access-ncwnr\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.864089 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.863962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12f48164-c3aa-4af0-a914-97e08ff1b1e3-manifests\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.864089 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.864015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12f48164-c3aa-4af0-a914-97e08ff1b1e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.864089 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.864048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12f48164-c3aa-4af0-a914-97e08ff1b1e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.965571 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.965470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12f48164-c3aa-4af0-a914-97e08ff1b1e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.965571 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.965516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12f48164-c3aa-4af0-a914-97e08ff1b1e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.965571 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.965570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f48164-c3aa-4af0-a914-97e08ff1b1e3-tmp\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.965872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.965615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncwnr\" (UniqueName: \"kubernetes.io/projected/12f48164-c3aa-4af0-a914-97e08ff1b1e3-kube-api-access-ncwnr\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.965872 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.965650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12f48164-c3aa-4af0-a914-97e08ff1b1e3-manifests\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.966132 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.966104 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12f48164-c3aa-4af0-a914-97e08ff1b1e3-manifests\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.967936 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.967907 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f48164-c3aa-4af0-a914-97e08ff1b1e3-tmp\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.968134 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.968116 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12f48164-c3aa-4af0-a914-97e08ff1b1e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.968221 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.968199 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12f48164-c3aa-4af0-a914-97e08ff1b1e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:55.974120 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:55.974096 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncwnr\" (UniqueName: \"kubernetes.io/projected/12f48164-c3aa-4af0-a914-97e08ff1b1e3-kube-api-access-ncwnr\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-ds7m9\" (UID: \"12f48164-c3aa-4af0-a914-97e08ff1b1e3\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:56.010178 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:56.010145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:23:56.173365 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:56.173308 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9"] Jul 08 18:23:56.179318 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:23:56.179268 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f48164_c3aa_4af0_a914_97e08ff1b1e3.slice/crio-a383d51ea771e0c8a7d7ca89ee1b79d4944d812ee157f2893a5b4f6200ce2bff WatchSource:0}: Error finding container a383d51ea771e0c8a7d7ca89ee1b79d4944d812ee157f2893a5b4f6200ce2bff: Status 404 returned error can't find the container with id a383d51ea771e0c8a7d7ca89ee1b79d4944d812ee157f2893a5b4f6200ce2bff Jul 08 18:23:56.636672 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:23:56.636632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" event={"ID":"12f48164-c3aa-4af0-a914-97e08ff1b1e3","Type":"ContainerStarted","Data":"a383d51ea771e0c8a7d7ca89ee1b79d4944d812ee157f2893a5b4f6200ce2bff"} Jul 08 18:24:00.659727 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:00.659683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" event={"ID":"c52026eb-3255-4f2f-941b-45f49227fbd3","Type":"ContainerStarted","Data":"c76dd17091a7f75db814fc891717ea23c454860bd3c5c853351c5c906b29eca4"} Jul 08 18:24:00.660222 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:00.659811 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:24:00.661380 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:00.661339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" event={"ID":"12f48164-c3aa-4af0-a914-97e08ff1b1e3","Type":"ContainerStarted","Data":"9805e2c81070952fdc4d960a1106c2dd78a25ced4a2840f20d4edb3797d989c0"} Jul 08 18:24:00.680864 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:00.680798 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" podStartSLOduration=1.448183043 podStartE2EDuration="5.680778745s" totalImagesPullingTime="4.232595702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:00.680090008 +0000 UTC m=+439.694317083" watchObservedRunningTime="2026-07-08 18:24:00.680778745 +0000 UTC m=+439.695005836" Jul 08 18:24:01.673861 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:01.673826 2576 generic.go:356] "Generic (PLEG): container finished" podID="12f48164-c3aa-4af0-a914-97e08ff1b1e3" containerID="9805e2c81070952fdc4d960a1106c2dd78a25ced4a2840f20d4edb3797d989c0" exitCode=0 Jul 08 18:24:01.674267 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:01.673901 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" event={"ID":"12f48164-c3aa-4af0-a914-97e08ff1b1e3","Type":"ContainerDied","Data":"9805e2c81070952fdc4d960a1106c2dd78a25ced4a2840f20d4edb3797d989c0"} Jul 08 18:24:02.680964 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:02.680930 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" event={"ID":"12f48164-c3aa-4af0-a914-97e08ff1b1e3","Type":"ContainerStarted","Data":"1564cb0de31b7282c62fcdf73c8cd743e0e7188bbfa34cb8ba125f45a08b5fda"} Jul 08 18:24:02.681470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:02.681011 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:24:02.702750 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:02.702690 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" podStartSLOduration=2.63569175 podStartE2EDuration="7.70267144s" totalImagesPullingTime="3.98077407s" totalInitContainerRuntime="1.08620562s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:23:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:02.700113177 +0000 UTC m=+441.714340264" watchObservedRunningTime="2026-07-08 18:24:02.70267144 +0000 UTC m=+441.716898516" Jul 08 18:24:11.676540 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:11.676506 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-5cvm2" Jul 08 18:24:13.687986 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:13.687950 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-ds7m9" Jul 08 18:24:26.336337 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.336295 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57657c797d-r8gpd"] Jul 08 18:24:26.348474 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.348437 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" Jul 08 18:24:26.351214 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.351191 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 18:24:26.352305 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.352278 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 18:24:26.352451 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.352281 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vcvj4\"" Jul 08 18:24:26.352992 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.352967 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 18:24:26.353103 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.352975 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 18:24:26.359951 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.359922 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57657c797d-r8gpd"] Jul 08 18:24:26.424937 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.424893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf4l7\" (UniqueName: \"kubernetes.io/projected/1c7849d1-7d46-4875-a635-2ccad8950350-kube-api-access-zf4l7\") pod \"kube-auth-proxy-57657c797d-r8gpd\" (UID: \"1c7849d1-7d46-4875-a635-2ccad8950350\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" Jul 08 18:24:26.424937 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.424946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c7849d1-7d46-4875-a635-2ccad8950350-tmp\") pod \"kube-auth-proxy-57657c797d-r8gpd\" (UID: \"1c7849d1-7d46-4875-a635-2ccad8950350\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" Jul 08 18:24:26.425166 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.425024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c7849d1-7d46-4875-a635-2ccad8950350-tls-certs\") pod \"kube-auth-proxy-57657c797d-r8gpd\" (UID: \"1c7849d1-7d46-4875-a635-2ccad8950350\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" Jul 08 18:24:26.525673 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.525581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf4l7\" (UniqueName: \"kubernetes.io/projected/1c7849d1-7d46-4875-a635-2ccad8950350-kube-api-access-zf4l7\") pod \"kube-auth-proxy-57657c797d-r8gpd\" (UID: \"1c7849d1-7d46-4875-a635-2ccad8950350\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" Jul 08 18:24:26.525890 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.525688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c7849d1-7d46-4875-a635-2ccad8950350-tmp\") pod \"kube-auth-proxy-57657c797d-r8gpd\" (UID: \"1c7849d1-7d46-4875-a635-2ccad8950350\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" Jul 08 18:24:26.525890 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.525840 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c7849d1-7d46-4875-a635-2ccad8950350-tls-certs\") pod \"kube-auth-proxy-57657c797d-r8gpd\" (UID: \"1c7849d1-7d46-4875-a635-2ccad8950350\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" Jul 08 18:24:26.528192 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.528159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c7849d1-7d46-4875-a635-2ccad8950350-tmp\") pod \"kube-auth-proxy-57657c797d-r8gpd\" (UID: \"1c7849d1-7d46-4875-a635-2ccad8950350\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" Jul 08 18:24:26.528400 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.528377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c7849d1-7d46-4875-a635-2ccad8950350-tls-certs\") pod \"kube-auth-proxy-57657c797d-r8gpd\" (UID: \"1c7849d1-7d46-4875-a635-2ccad8950350\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" Jul 08 18:24:26.552793 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.552753 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf4l7\" (UniqueName: \"kubernetes.io/projected/1c7849d1-7d46-4875-a635-2ccad8950350-kube-api-access-zf4l7\") pod \"kube-auth-proxy-57657c797d-r8gpd\" (UID: \"1c7849d1-7d46-4875-a635-2ccad8950350\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" Jul 08 18:24:26.661634 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.661531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" Jul 08 18:24:26.810538 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:26.810498 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57657c797d-r8gpd"] Jul 08 18:24:26.812717 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:24:26.812683 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7849d1_7d46_4875_a635_2ccad8950350.slice/crio-d3a252ce1c32a728aaa41ab42d641417b0de92fef2ca876d4777f4a2389af270 WatchSource:0}: Error finding container d3a252ce1c32a728aaa41ab42d641417b0de92fef2ca876d4777f4a2389af270: Status 404 returned error can't find the container with id d3a252ce1c32a728aaa41ab42d641417b0de92fef2ca876d4777f4a2389af270 Jul 08 18:24:27.798675 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:27.798630 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" event={"ID":"1c7849d1-7d46-4875-a635-2ccad8950350","Type":"ContainerStarted","Data":"d3a252ce1c32a728aaa41ab42d641417b0de92fef2ca876d4777f4a2389af270"} Jul 08 18:24:30.815088 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:30.815051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" event={"ID":"1c7849d1-7d46-4875-a635-2ccad8950350","Type":"ContainerStarted","Data":"0976b4a8bc9e0ab16ce0eb197454a9cade8026317019c881c25318431154a160"} Jul 08 18:24:30.850732 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:24:30.850664 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57657c797d-r8gpd" podStartSLOduration=1.452225345 podStartE2EDuration="4.850644612s" totalImagesPullingTime="3.398419267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:30.849209402 +0000 UTC m=+469.863436503" watchObservedRunningTime="2026-07-08 18:24:30.850644612 +0000 UTC m=+469.864871702" Jul 08 18:25:59.995808 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:25:59.995764 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59"] Jul 08 18:25:59.999151 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:25:59.999133 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:00.001734 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.001710 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 18:26:00.001867 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.001736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gh9kx\"" Jul 08 18:26:00.001867 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.001710 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 18:26:00.011530 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.011505 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59"] Jul 08 18:26:00.042984 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.042942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phkf9\" (UniqueName: \"kubernetes.io/projected/828890b6-7ca7-4468-86ec-3c8c89bbb398-kube-api-access-phkf9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" (UID: \"828890b6-7ca7-4468-86ec-3c8c89bbb398\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:00.043197 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.043023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/828890b6-7ca7-4468-86ec-3c8c89bbb398-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" (UID: \"828890b6-7ca7-4468-86ec-3c8c89bbb398\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:00.143526 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.143490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/828890b6-7ca7-4468-86ec-3c8c89bbb398-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" (UID: \"828890b6-7ca7-4468-86ec-3c8c89bbb398\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:00.143696 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.143564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phkf9\" (UniqueName: \"kubernetes.io/projected/828890b6-7ca7-4468-86ec-3c8c89bbb398-kube-api-access-phkf9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" (UID: \"828890b6-7ca7-4468-86ec-3c8c89bbb398\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:00.143922 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.143899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/828890b6-7ca7-4468-86ec-3c8c89bbb398-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" (UID: \"828890b6-7ca7-4468-86ec-3c8c89bbb398\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:00.157502 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.157466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkf9\" (UniqueName: \"kubernetes.io/projected/828890b6-7ca7-4468-86ec-3c8c89bbb398-kube-api-access-phkf9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" (UID: \"828890b6-7ca7-4468-86ec-3c8c89bbb398\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:00.309724 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.309687 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:00.455036 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:00.455013 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59"] Jul 08 18:26:00.457188 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:26:00.457162 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828890b6_7ca7_4468_86ec_3c8c89bbb398.slice/crio-691dff8bf783b16091015b812c2ec9df91ed142c469d4e23bbc0427288bbff03 WatchSource:0}: Error finding container 691dff8bf783b16091015b812c2ec9df91ed142c469d4e23bbc0427288bbff03: Status 404 returned error can't find the container with id 691dff8bf783b16091015b812c2ec9df91ed142c469d4e23bbc0427288bbff03 Jul 08 18:26:01.219818 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:01.219772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" event={"ID":"828890b6-7ca7-4468-86ec-3c8c89bbb398","Type":"ContainerStarted","Data":"691dff8bf783b16091015b812c2ec9df91ed142c469d4e23bbc0427288bbff03"} Jul 08 18:26:08.252822 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:08.252789 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" event={"ID":"828890b6-7ca7-4468-86ec-3c8c89bbb398","Type":"ContainerStarted","Data":"fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796"} Jul 08 18:26:08.253258 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:08.252911 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:08.273247 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:08.273182 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" podStartSLOduration=2.01285659 podStartE2EDuration="9.273163199s" totalImagesPullingTime="7.260306609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:26:08.270958487 +0000 UTC m=+567.285185595" watchObservedRunningTime="2026-07-08 18:26:08.273163199 +0000 UTC m=+567.287390271" Jul 08 18:26:19.259752 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:19.259723 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:20.972085 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:20.972045 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59"] Jul 08 18:26:20.972476 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:20.972400 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" podUID="828890b6-7ca7-4468-86ec-3c8c89bbb398" containerName="manager" containerID="cri-o://fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796" gracePeriod=2 Jul 08 18:26:20.987087 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:20.987053 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59"] Jul 08 18:26:20.997180 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:26:20.997133 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"828890b6-7ca7-4468-86ec-3c8c89bbb398\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-fbw59\": pods \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:21.003052 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.003022 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9"] Jul 08 18:26:21.003535 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.003384 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="828890b6-7ca7-4468-86ec-3c8c89bbb398" containerName="manager" Jul 08 18:26:21.003535 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.003404 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="828890b6-7ca7-4468-86ec-3c8c89bbb398" containerName="manager" Jul 08 18:26:21.003535 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.003527 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="828890b6-7ca7-4468-86ec-3c8c89bbb398" containerName="manager" Jul 08 18:26:21.006883 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.006857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:21.009232 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:26:21.009191 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" is forbidden: User \"system:node:ip-10-0-130-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-26.ec2.internal' and this object" podUID="828890b6-7ca7-4468-86ec-3c8c89bbb398" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:21.023923 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.023891 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9"] Jul 08 18:26:21.129639 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.129597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gckbs\" (UniqueName: \"kubernetes.io/projected/14511206-0f2b-41e5-b55e-29e3987d4256-kube-api-access-gckbs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4r7k9\" (UID: \"14511206-0f2b-41e5-b55e-29e3987d4256\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:21.129847 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.129683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14511206-0f2b-41e5-b55e-29e3987d4256-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4r7k9\" (UID: \"14511206-0f2b-41e5-b55e-29e3987d4256\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:21.205392 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.205343 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:21.207852 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:26:21.207821 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" is forbidden: User \"system:node:ip-10-0-130-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-26.ec2.internal' and this object" podUID="828890b6-7ca7-4468-86ec-3c8c89bbb398" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:21.230345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.230242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14511206-0f2b-41e5-b55e-29e3987d4256-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4r7k9\" (UID: \"14511206-0f2b-41e5-b55e-29e3987d4256\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:21.230345 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.230338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gckbs\" (UniqueName: \"kubernetes.io/projected/14511206-0f2b-41e5-b55e-29e3987d4256-kube-api-access-gckbs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4r7k9\" (UID: \"14511206-0f2b-41e5-b55e-29e3987d4256\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:21.230683 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.230662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14511206-0f2b-41e5-b55e-29e3987d4256-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4r7k9\" (UID: \"14511206-0f2b-41e5-b55e-29e3987d4256\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:21.246747 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.246716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gckbs\" (UniqueName: \"kubernetes.io/projected/14511206-0f2b-41e5-b55e-29e3987d4256-kube-api-access-gckbs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4r7k9\" (UID: \"14511206-0f2b-41e5-b55e-29e3987d4256\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:21.312806 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.312775 2576 generic.go:356] "Generic (PLEG): container finished" podID="828890b6-7ca7-4468-86ec-3c8c89bbb398" containerID="fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796" exitCode=0 Jul 08 18:26:21.312967 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.312825 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:21.312967 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.312864 2576 scope.go:117] "RemoveContainer" containerID="fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796" Jul 08 18:26:21.315444 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:26:21.315416 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" is forbidden: User \"system:node:ip-10-0-130-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-26.ec2.internal' and this object" podUID="828890b6-7ca7-4468-86ec-3c8c89bbb398" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:21.321027 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.320998 2576 scope.go:117] "RemoveContainer" containerID="fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796" Jul 08 18:26:21.321277 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:26:21.321257 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796\": container with ID starting with fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796 not found: ID does not exist" containerID="fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796" Jul 08 18:26:21.321368 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.321284 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796"} err="failed to get container status \"fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796\": rpc error: code = NotFound desc = could not find container \"fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796\": container with ID starting with fe0b40f2109757cdf422dae3a1fc133e46eaae5b6c8d6c05e18e7ca8dd093796 not found: ID does not exist" Jul 08 18:26:21.331639 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.331613 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phkf9\" (UniqueName: \"kubernetes.io/projected/828890b6-7ca7-4468-86ec-3c8c89bbb398-kube-api-access-phkf9\") pod \"828890b6-7ca7-4468-86ec-3c8c89bbb398\" (UID: \"828890b6-7ca7-4468-86ec-3c8c89bbb398\") " Jul 08 18:26:21.331769 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.331662 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/828890b6-7ca7-4468-86ec-3c8c89bbb398-extensions-socket-volume\") pod \"828890b6-7ca7-4468-86ec-3c8c89bbb398\" (UID: \"828890b6-7ca7-4468-86ec-3c8c89bbb398\") " Jul 08 18:26:21.332291 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.332258 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/828890b6-7ca7-4468-86ec-3c8c89bbb398-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "828890b6-7ca7-4468-86ec-3c8c89bbb398" (UID: "828890b6-7ca7-4468-86ec-3c8c89bbb398"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:26:21.334244 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.334216 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/828890b6-7ca7-4468-86ec-3c8c89bbb398-kube-api-access-phkf9" (OuterVolumeSpecName: "kube-api-access-phkf9") pod "828890b6-7ca7-4468-86ec-3c8c89bbb398" (UID: "828890b6-7ca7-4468-86ec-3c8c89bbb398"). InnerVolumeSpecName "kube-api-access-phkf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:26:21.349262 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.349215 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:21.432671 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.432631 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phkf9\" (UniqueName: \"kubernetes.io/projected/828890b6-7ca7-4468-86ec-3c8c89bbb398-kube-api-access-phkf9\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:26:21.432842 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.432677 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/828890b6-7ca7-4468-86ec-3c8c89bbb398-extensions-socket-volume\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:26:21.524899 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.524872 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9"] Jul 08 18:26:21.526636 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:26:21.526610 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14511206_0f2b_41e5_b55e_29e3987d4256.slice/crio-225ec4ec827f281b59e6a959244645e565d50a7a4e4293aa6b983ccc22f8e5e0 WatchSource:0}: Error finding container 225ec4ec827f281b59e6a959244645e565d50a7a4e4293aa6b983ccc22f8e5e0: Status 404 returned error can't find the container with id 225ec4ec827f281b59e6a959244645e565d50a7a4e4293aa6b983ccc22f8e5e0 Jul 08 18:26:21.623512 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:26:21.623474 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" is forbidden: User \"system:node:ip-10-0-130-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-26.ec2.internal' and this object" podUID="828890b6-7ca7-4468-86ec-3c8c89bbb398" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:21.656124 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:26:21.656085 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fbw59\" is forbidden: User \"system:node:ip-10-0-130-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-26.ec2.internal' and this object" podUID="828890b6-7ca7-4468-86ec-3c8c89bbb398" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fbw59" Jul 08 18:26:21.657189 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:21.657168 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="828890b6-7ca7-4468-86ec-3c8c89bbb398" path="/var/lib/kubelet/pods/828890b6-7ca7-4468-86ec-3c8c89bbb398/volumes" Jul 08 18:26:22.321092 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:22.321060 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" event={"ID":"14511206-0f2b-41e5-b55e-29e3987d4256","Type":"ContainerStarted","Data":"59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333"} Jul 08 18:26:22.321576 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:22.321123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" event={"ID":"14511206-0f2b-41e5-b55e-29e3987d4256","Type":"ContainerStarted","Data":"225ec4ec827f281b59e6a959244645e565d50a7a4e4293aa6b983ccc22f8e5e0"} Jul 08 18:26:22.321576 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:22.321155 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:22.350129 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:22.350072 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" podStartSLOduration=2.35005388 podStartE2EDuration="2.35005388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:26:22.347943454 +0000 UTC m=+581.362170530" watchObservedRunningTime="2026-07-08 18:26:22.35005388 +0000 UTC m=+581.364280954" Jul 08 18:26:33.329445 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:33.329416 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:37.729740 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:37.729703 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9"] Jul 08 18:26:37.730367 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:37.729922 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" podUID="14511206-0f2b-41e5-b55e-29e3987d4256" containerName="manager" containerID="cri-o://59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333" gracePeriod=10 Jul 08 18:26:38.053485 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.053449 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb"] Jul 08 18:26:38.059846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.059816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:26:38.072234 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.072203 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb"] Jul 08 18:26:38.085863 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.085835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2fdt\" (UniqueName: \"kubernetes.io/projected/da8b1223-4181-4f12-87f9-3f6745846120-kube-api-access-z2fdt\") pod \"kuadrant-operator-controller-manager-86878c769f-qt9qb\" (UID: \"da8b1223-4181-4f12-87f9-3f6745846120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:26:38.086006 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.085880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8b1223-4181-4f12-87f9-3f6745846120-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qt9qb\" (UID: \"da8b1223-4181-4f12-87f9-3f6745846120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:26:38.186544 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.186490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2fdt\" (UniqueName: \"kubernetes.io/projected/da8b1223-4181-4f12-87f9-3f6745846120-kube-api-access-z2fdt\") pod \"kuadrant-operator-controller-manager-86878c769f-qt9qb\" (UID: \"da8b1223-4181-4f12-87f9-3f6745846120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:26:38.186719 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.186556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8b1223-4181-4f12-87f9-3f6745846120-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qt9qb\" (UID: \"da8b1223-4181-4f12-87f9-3f6745846120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:26:38.186921 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.186902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8b1223-4181-4f12-87f9-3f6745846120-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qt9qb\" (UID: \"da8b1223-4181-4f12-87f9-3f6745846120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:26:38.200924 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.200895 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2fdt\" (UniqueName: \"kubernetes.io/projected/da8b1223-4181-4f12-87f9-3f6745846120-kube-api-access-z2fdt\") pod \"kuadrant-operator-controller-manager-86878c769f-qt9qb\" (UID: \"da8b1223-4181-4f12-87f9-3f6745846120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:26:38.370735 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.370642 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:26:38.523391 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.523341 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb"] Jul 08 18:26:38.527341 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:26:38.527312 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8b1223_4181_4f12_87f9_3f6745846120.slice/crio-b911c37ba015932525d800117baabc561ec689f7f978db3c6535dcd335c09de6 WatchSource:0}: Error finding container b911c37ba015932525d800117baabc561ec689f7f978db3c6535dcd335c09de6: Status 404 returned error can't find the container with id b911c37ba015932525d800117baabc561ec689f7f978db3c6535dcd335c09de6 Jul 08 18:26:38.573615 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.573589 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:38.590339 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.590306 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14511206-0f2b-41e5-b55e-29e3987d4256-extensions-socket-volume\") pod \"14511206-0f2b-41e5-b55e-29e3987d4256\" (UID: \"14511206-0f2b-41e5-b55e-29e3987d4256\") " Jul 08 18:26:38.590568 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.590389 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gckbs\" (UniqueName: \"kubernetes.io/projected/14511206-0f2b-41e5-b55e-29e3987d4256-kube-api-access-gckbs\") pod \"14511206-0f2b-41e5-b55e-29e3987d4256\" (UID: \"14511206-0f2b-41e5-b55e-29e3987d4256\") " Jul 08 18:26:38.590755 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.590732 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14511206-0f2b-41e5-b55e-29e3987d4256-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "14511206-0f2b-41e5-b55e-29e3987d4256" (UID: "14511206-0f2b-41e5-b55e-29e3987d4256"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:26:38.592482 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.592457 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14511206-0f2b-41e5-b55e-29e3987d4256-kube-api-access-gckbs" (OuterVolumeSpecName: "kube-api-access-gckbs") pod "14511206-0f2b-41e5-b55e-29e3987d4256" (UID: "14511206-0f2b-41e5-b55e-29e3987d4256"). InnerVolumeSpecName "kube-api-access-gckbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:26:38.691721 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.691631 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gckbs\" (UniqueName: \"kubernetes.io/projected/14511206-0f2b-41e5-b55e-29e3987d4256-kube-api-access-gckbs\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:26:38.691721 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:38.691664 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14511206-0f2b-41e5-b55e-29e3987d4256-extensions-socket-volume\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:26:39.402669 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.402633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" event={"ID":"da8b1223-4181-4f12-87f9-3f6745846120","Type":"ContainerStarted","Data":"78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398"} Jul 08 18:26:39.403146 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.402699 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:26:39.403146 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.402721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" event={"ID":"da8b1223-4181-4f12-87f9-3f6745846120","Type":"ContainerStarted","Data":"b911c37ba015932525d800117baabc561ec689f7f978db3c6535dcd335c09de6"} Jul 08 18:26:39.404057 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.404034 2576 generic.go:356] "Generic (PLEG): container finished" podID="14511206-0f2b-41e5-b55e-29e3987d4256" containerID="59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333" exitCode=0 Jul 08 18:26:39.404136 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.404075 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" Jul 08 18:26:39.404136 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.404104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" event={"ID":"14511206-0f2b-41e5-b55e-29e3987d4256","Type":"ContainerDied","Data":"59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333"} Jul 08 18:26:39.404201 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.404139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9" event={"ID":"14511206-0f2b-41e5-b55e-29e3987d4256","Type":"ContainerDied","Data":"225ec4ec827f281b59e6a959244645e565d50a7a4e4293aa6b983ccc22f8e5e0"} Jul 08 18:26:39.404201 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.404160 2576 scope.go:117] "RemoveContainer" containerID="59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333" Jul 08 18:26:39.413294 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.413271 2576 scope.go:117] "RemoveContainer" containerID="59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333" Jul 08 18:26:39.413681 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:26:39.413657 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333\": container with ID starting with 59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333 not found: ID does not exist" containerID="59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333" Jul 08 18:26:39.413770 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.413690 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333"} err="failed to get container status \"59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333\": rpc error: code = NotFound desc = could not find container \"59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333\": container with ID starting with 59f1f0e6cd62cf26b84884ff769758416fe42ec3d7c238c37610357611015333 not found: ID does not exist" Jul 08 18:26:39.425802 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.425741 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" podStartSLOduration=1.425723111 podStartE2EDuration="1.425723111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:26:39.424598374 +0000 UTC m=+598.438825451" watchObservedRunningTime="2026-07-08 18:26:39.425723111 +0000 UTC m=+598.439950193" Jul 08 18:26:39.440575 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.440546 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9"] Jul 08 18:26:39.445990 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.445960 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4r7k9"] Jul 08 18:26:39.657499 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:39.657461 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14511206-0f2b-41e5-b55e-29e3987d4256" path="/var/lib/kubelet/pods/14511206-0f2b-41e5-b55e-29e3987d4256/volumes" Jul 08 18:26:41.438647 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:41.438621 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:26:41.440447 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:41.440423 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:26:41.443936 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:41.443907 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:26:41.445726 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:41.445697 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:26:50.412371 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:50.412324 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:26:59.371853 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.371818 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:26:59.372276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.372160 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14511206-0f2b-41e5-b55e-29e3987d4256" containerName="manager" Jul 08 18:26:59.372276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.372172 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14511206-0f2b-41e5-b55e-29e3987d4256" containerName="manager" Jul 08 18:26:59.372276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.372239 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="14511206-0f2b-41e5-b55e-29e3987d4256" containerName="manager" Jul 08 18:26:59.375080 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.375059 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" Jul 08 18:26:59.377835 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.377808 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 18:26:59.377835 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.377834 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9z6ft\"" Jul 08 18:26:59.382308 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.382277 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:26:59.409950 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.409908 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:26:59.481526 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.481482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/32baaa54-9d9f-4951-8bf6-073b278e1d83-config-file\") pod \"limitador-limitador-54d6d988d5-ch8jf\" (UID: \"32baaa54-9d9f-4951-8bf6-073b278e1d83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" Jul 08 18:26:59.481723 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.481621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jh9q\" (UniqueName: \"kubernetes.io/projected/32baaa54-9d9f-4951-8bf6-073b278e1d83-kube-api-access-6jh9q\") pod \"limitador-limitador-54d6d988d5-ch8jf\" (UID: \"32baaa54-9d9f-4951-8bf6-073b278e1d83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" Jul 08 18:26:59.582959 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.582919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jh9q\" (UniqueName: \"kubernetes.io/projected/32baaa54-9d9f-4951-8bf6-073b278e1d83-kube-api-access-6jh9q\") pod \"limitador-limitador-54d6d988d5-ch8jf\" (UID: \"32baaa54-9d9f-4951-8bf6-073b278e1d83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" Jul 08 18:26:59.583136 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.582972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/32baaa54-9d9f-4951-8bf6-073b278e1d83-config-file\") pod \"limitador-limitador-54d6d988d5-ch8jf\" (UID: \"32baaa54-9d9f-4951-8bf6-073b278e1d83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" Jul 08 18:26:59.583695 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.583676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/32baaa54-9d9f-4951-8bf6-073b278e1d83-config-file\") pod \"limitador-limitador-54d6d988d5-ch8jf\" (UID: \"32baaa54-9d9f-4951-8bf6-073b278e1d83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" Jul 08 18:26:59.592828 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.592796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jh9q\" (UniqueName: \"kubernetes.io/projected/32baaa54-9d9f-4951-8bf6-073b278e1d83-kube-api-access-6jh9q\") pod \"limitador-limitador-54d6d988d5-ch8jf\" (UID: \"32baaa54-9d9f-4951-8bf6-073b278e1d83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" Jul 08 18:26:59.687401 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.687282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" Jul 08 18:26:59.823713 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.823677 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-pl6jx"] Jul 08 18:26:59.826680 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.826655 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pl6jx" Jul 08 18:26:59.829127 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.829095 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zdspl\"" Jul 08 18:26:59.833862 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.833720 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:26:59.836737 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.836710 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pl6jx"] Jul 08 18:26:59.838422 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:26:59.838396 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32baaa54_9d9f_4951_8bf6_073b278e1d83.slice/crio-5da7ce2e0f01cd6973395d4f6e81bfc3041fccdb55138fd31029ddc28ea94c52 WatchSource:0}: Error finding container 5da7ce2e0f01cd6973395d4f6e81bfc3041fccdb55138fd31029ddc28ea94c52: Status 404 returned error can't find the container with id 5da7ce2e0f01cd6973395d4f6e81bfc3041fccdb55138fd31029ddc28ea94c52 Jul 08 18:26:59.986578 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:26:59.986477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nnzd\" (UniqueName: \"kubernetes.io/projected/f97f4c33-811d-4af8-8e2e-11ead223e45e-kube-api-access-9nnzd\") pod \"authorino-75d556bd77-pl6jx\" (UID: \"f97f4c33-811d-4af8-8e2e-11ead223e45e\") " pod="kuadrant-system/authorino-75d556bd77-pl6jx" Jul 08 18:27:00.087549 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:00.087512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nnzd\" (UniqueName: \"kubernetes.io/projected/f97f4c33-811d-4af8-8e2e-11ead223e45e-kube-api-access-9nnzd\") pod \"authorino-75d556bd77-pl6jx\" (UID: \"f97f4c33-811d-4af8-8e2e-11ead223e45e\") " pod="kuadrant-system/authorino-75d556bd77-pl6jx" Jul 08 18:27:00.096102 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:00.096065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nnzd\" (UniqueName: \"kubernetes.io/projected/f97f4c33-811d-4af8-8e2e-11ead223e45e-kube-api-access-9nnzd\") pod \"authorino-75d556bd77-pl6jx\" (UID: \"f97f4c33-811d-4af8-8e2e-11ead223e45e\") " pod="kuadrant-system/authorino-75d556bd77-pl6jx" Jul 08 18:27:00.138624 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:00.138589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pl6jx" Jul 08 18:27:00.274015 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:00.273987 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pl6jx"] Jul 08 18:27:00.276446 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:27:00.276416 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf97f4c33_811d_4af8_8e2e_11ead223e45e.slice/crio-dd49b657e17be4a4bfd07e27fa2710d3cf573f9bc88d5e153f98b17eb17099cc WatchSource:0}: Error finding container dd49b657e17be4a4bfd07e27fa2710d3cf573f9bc88d5e153f98b17eb17099cc: Status 404 returned error can't find the container with id dd49b657e17be4a4bfd07e27fa2710d3cf573f9bc88d5e153f98b17eb17099cc Jul 08 18:27:00.514305 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:00.514112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" event={"ID":"32baaa54-9d9f-4951-8bf6-073b278e1d83","Type":"ContainerStarted","Data":"5da7ce2e0f01cd6973395d4f6e81bfc3041fccdb55138fd31029ddc28ea94c52"} Jul 08 18:27:00.516283 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:00.516225 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pl6jx" event={"ID":"f97f4c33-811d-4af8-8e2e-11ead223e45e","Type":"ContainerStarted","Data":"dd49b657e17be4a4bfd07e27fa2710d3cf573f9bc88d5e153f98b17eb17099cc"} Jul 08 18:27:04.540527 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:04.540489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pl6jx" event={"ID":"f97f4c33-811d-4af8-8e2e-11ead223e45e","Type":"ContainerStarted","Data":"0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e"} Jul 08 18:27:04.542018 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:04.541994 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" event={"ID":"32baaa54-9d9f-4951-8bf6-073b278e1d83","Type":"ContainerStarted","Data":"1d065ed1cda31648f21953aca9db4b29c9c2c6c52d3ec182bbc9c56ae86b150a"} Jul 08 18:27:04.542115 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:04.542074 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" Jul 08 18:27:04.554707 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:04.554659 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-pl6jx" podStartSLOduration=1.470102827 podStartE2EDuration="5.554642672s" totalImagesPullingTime="4.084539845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:27:04.553929506 +0000 UTC m=+623.568156583" watchObservedRunningTime="2026-07-08 18:27:04.554642672 +0000 UTC m=+623.568869747" Jul 08 18:27:04.571470 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:04.571411 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" podStartSLOduration=1.062293992 podStartE2EDuration="5.571391122s" totalImagesPullingTime="4.50909713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:27:04.569537257 +0000 UTC m=+623.583764334" watchObservedRunningTime="2026-07-08 18:27:04.571391122 +0000 UTC m=+623.585618198" Jul 08 18:27:15.549017 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:15.548987 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ch8jf" Jul 08 18:27:32.496008 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.495973 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mh2vv"] Jul 08 18:27:32.499333 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.499308 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mh2vv" Jul 08 18:27:32.506391 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.506221 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mh2vv"] Jul 08 18:27:32.577017 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.576978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqd78\" (UniqueName: \"kubernetes.io/projected/b5db3d51-98ac-4173-bdd5-dfbd306108c0-kube-api-access-tqd78\") pod \"authorino-5d4b67c446-mh2vv\" (UID: \"b5db3d51-98ac-4173-bdd5-dfbd306108c0\") " pod="kuadrant-system/authorino-5d4b67c446-mh2vv" Jul 08 18:27:32.677528 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.677488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqd78\" (UniqueName: \"kubernetes.io/projected/b5db3d51-98ac-4173-bdd5-dfbd306108c0-kube-api-access-tqd78\") pod \"authorino-5d4b67c446-mh2vv\" (UID: \"b5db3d51-98ac-4173-bdd5-dfbd306108c0\") " pod="kuadrant-system/authorino-5d4b67c446-mh2vv" Jul 08 18:27:32.686904 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.686875 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqd78\" (UniqueName: \"kubernetes.io/projected/b5db3d51-98ac-4173-bdd5-dfbd306108c0-kube-api-access-tqd78\") pod \"authorino-5d4b67c446-mh2vv\" (UID: \"b5db3d51-98ac-4173-bdd5-dfbd306108c0\") " pod="kuadrant-system/authorino-5d4b67c446-mh2vv" Jul 08 18:27:32.690403 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.690378 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mh2vv"] Jul 08 18:27:32.690640 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.690627 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mh2vv" Jul 08 18:27:32.714770 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.714732 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-sjkrq"] Jul 08 18:27:32.718233 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.718208 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-sjkrq" Jul 08 18:27:32.720749 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.720720 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 18:27:32.725827 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.725802 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-sjkrq"] Jul 08 18:27:32.746268 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.745808 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-sjkrq"] Jul 08 18:27:32.746268 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:27:32.746173 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vxggq tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-vxggq tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-sjkrq" podUID="9515bdc3-4393-45fb-b91d-06e742955fdb" Jul 08 18:27:32.768923 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.768856 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-759bcc7d4f-dcxgn"] Jul 08 18:27:32.772202 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.772184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" Jul 08 18:27:32.778392 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.778349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9515bdc3-4393-45fb-b91d-06e742955fdb-tls-cert\") pod \"authorino-76877994-sjkrq\" (UID: \"9515bdc3-4393-45fb-b91d-06e742955fdb\") " pod="kuadrant-system/authorino-76877994-sjkrq" Jul 08 18:27:32.778546 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.778489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxggq\" (UniqueName: \"kubernetes.io/projected/9515bdc3-4393-45fb-b91d-06e742955fdb-kube-api-access-vxggq\") pod \"authorino-76877994-sjkrq\" (UID: \"9515bdc3-4393-45fb-b91d-06e742955fdb\") " pod="kuadrant-system/authorino-76877994-sjkrq" Jul 08 18:27:32.780156 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.780133 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-759bcc7d4f-dcxgn"] Jul 08 18:27:32.829531 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.829504 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mh2vv"] Jul 08 18:27:32.832128 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:27:32.832096 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5db3d51_98ac_4173_bdd5_dfbd306108c0.slice/crio-969209946dd3ecc3fdec233fbb703f558e9426f5fab25fb42f4474e6f577df9f WatchSource:0}: Error finding container 969209946dd3ecc3fdec233fbb703f558e9426f5fab25fb42f4474e6f577df9f: Status 404 returned error can't find the container with id 969209946dd3ecc3fdec233fbb703f558e9426f5fab25fb42f4474e6f577df9f Jul 08 18:27:32.879741 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.879699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9515bdc3-4393-45fb-b91d-06e742955fdb-tls-cert\") pod \"authorino-76877994-sjkrq\" (UID: \"9515bdc3-4393-45fb-b91d-06e742955fdb\") " pod="kuadrant-system/authorino-76877994-sjkrq" Jul 08 18:27:32.879894 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.879758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6548a144-ee4f-47cc-a92a-16f71388169b-tls-cert\") pod \"authorino-759bcc7d4f-dcxgn\" (UID: \"6548a144-ee4f-47cc-a92a-16f71388169b\") " pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" Jul 08 18:27:32.879894 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.879778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zdmh\" (UniqueName: \"kubernetes.io/projected/6548a144-ee4f-47cc-a92a-16f71388169b-kube-api-access-9zdmh\") pod \"authorino-759bcc7d4f-dcxgn\" (UID: \"6548a144-ee4f-47cc-a92a-16f71388169b\") " pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" Jul 08 18:27:32.879894 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.879814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxggq\" (UniqueName: \"kubernetes.io/projected/9515bdc3-4393-45fb-b91d-06e742955fdb-kube-api-access-vxggq\") pod \"authorino-76877994-sjkrq\" (UID: \"9515bdc3-4393-45fb-b91d-06e742955fdb\") " pod="kuadrant-system/authorino-76877994-sjkrq" Jul 08 18:27:32.882116 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.882089 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9515bdc3-4393-45fb-b91d-06e742955fdb-tls-cert\") pod \"authorino-76877994-sjkrq\" (UID: \"9515bdc3-4393-45fb-b91d-06e742955fdb\") " pod="kuadrant-system/authorino-76877994-sjkrq" Jul 08 18:27:32.888216 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.888180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxggq\" (UniqueName: \"kubernetes.io/projected/9515bdc3-4393-45fb-b91d-06e742955fdb-kube-api-access-vxggq\") pod \"authorino-76877994-sjkrq\" (UID: \"9515bdc3-4393-45fb-b91d-06e742955fdb\") " pod="kuadrant-system/authorino-76877994-sjkrq" Jul 08 18:27:32.980859 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.980820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6548a144-ee4f-47cc-a92a-16f71388169b-tls-cert\") pod \"authorino-759bcc7d4f-dcxgn\" (UID: \"6548a144-ee4f-47cc-a92a-16f71388169b\") " pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" Jul 08 18:27:32.980859 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.980861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zdmh\" (UniqueName: \"kubernetes.io/projected/6548a144-ee4f-47cc-a92a-16f71388169b-kube-api-access-9zdmh\") pod \"authorino-759bcc7d4f-dcxgn\" (UID: \"6548a144-ee4f-47cc-a92a-16f71388169b\") " pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" Jul 08 18:27:32.983366 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.983333 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6548a144-ee4f-47cc-a92a-16f71388169b-tls-cert\") pod \"authorino-759bcc7d4f-dcxgn\" (UID: \"6548a144-ee4f-47cc-a92a-16f71388169b\") " pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" Jul 08 18:27:32.988680 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:32.988661 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zdmh\" (UniqueName: \"kubernetes.io/projected/6548a144-ee4f-47cc-a92a-16f71388169b-kube-api-access-9zdmh\") pod \"authorino-759bcc7d4f-dcxgn\" (UID: \"6548a144-ee4f-47cc-a92a-16f71388169b\") " pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" Jul 08 18:27:33.082270 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.082233 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" Jul 08 18:27:33.216666 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.216630 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-759bcc7d4f-dcxgn"] Jul 08 18:27:33.220678 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:27:33.220647 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6548a144_ee4f_47cc_a92a_16f71388169b.slice/crio-fa79154d779aee56a8de69bdea838a8a26a59c7c1bf8b0e031a68cecad53cec0 WatchSource:0}: Error finding container fa79154d779aee56a8de69bdea838a8a26a59c7c1bf8b0e031a68cecad53cec0: Status 404 returned error can't find the container with id fa79154d779aee56a8de69bdea838a8a26a59c7c1bf8b0e031a68cecad53cec0 Jul 08 18:27:33.677824 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.677788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mh2vv" event={"ID":"b5db3d51-98ac-4173-bdd5-dfbd306108c0","Type":"ContainerStarted","Data":"b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe"} Jul 08 18:27:33.677824 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.677813 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-mh2vv" podUID="b5db3d51-98ac-4173-bdd5-dfbd306108c0" containerName="authorino" containerID="cri-o://b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe" gracePeriod=30 Jul 08 18:27:33.678298 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.677835 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mh2vv" event={"ID":"b5db3d51-98ac-4173-bdd5-dfbd306108c0","Type":"ContainerStarted","Data":"969209946dd3ecc3fdec233fbb703f558e9426f5fab25fb42f4474e6f577df9f"} Jul 08 18:27:33.679461 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.679425 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" event={"ID":"6548a144-ee4f-47cc-a92a-16f71388169b","Type":"ContainerStarted","Data":"05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1"} Jul 08 18:27:33.679461 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.679465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" event={"ID":"6548a144-ee4f-47cc-a92a-16f71388169b","Type":"ContainerStarted","Data":"fa79154d779aee56a8de69bdea838a8a26a59c7c1bf8b0e031a68cecad53cec0"} Jul 08 18:27:33.679636 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.679490 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-sjkrq" Jul 08 18:27:33.687547 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.687523 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-sjkrq" Jul 08 18:27:33.694057 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.694006 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-mh2vv" podStartSLOduration=1.291310258 podStartE2EDuration="1.693985723s" totalImagesPullingTime="402.675465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:27:33.69181405 +0000 UTC m=+652.706041129" watchObservedRunningTime="2026-07-08 18:27:33.693985723 +0000 UTC m=+652.708212801" Jul 08 18:27:33.721095 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.721043 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" podStartSLOduration=1.363633346 podStartE2EDuration="1.721025291s" totalImagesPullingTime="357.391945ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:27:33.720287438 +0000 UTC m=+652.734514520" watchObservedRunningTime="2026-07-08 18:27:33.721025291 +0000 UTC m=+652.735252414" Jul 08 18:27:33.746990 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.746954 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pl6jx"] Jul 08 18:27:33.747153 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.747137 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-pl6jx" podUID="f97f4c33-811d-4af8-8e2e-11ead223e45e" containerName="authorino" containerID="cri-o://0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e" gracePeriod=30 Jul 08 18:27:33.787657 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.787629 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9515bdc3-4393-45fb-b91d-06e742955fdb-tls-cert\") pod \"9515bdc3-4393-45fb-b91d-06e742955fdb\" (UID: \"9515bdc3-4393-45fb-b91d-06e742955fdb\") " Jul 08 18:27:33.787801 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.787709 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxggq\" (UniqueName: \"kubernetes.io/projected/9515bdc3-4393-45fb-b91d-06e742955fdb-kube-api-access-vxggq\") pod \"9515bdc3-4393-45fb-b91d-06e742955fdb\" (UID: \"9515bdc3-4393-45fb-b91d-06e742955fdb\") " Jul 08 18:27:33.789541 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.789512 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9515bdc3-4393-45fb-b91d-06e742955fdb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9515bdc3-4393-45fb-b91d-06e742955fdb" (UID: "9515bdc3-4393-45fb-b91d-06e742955fdb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:27:33.789665 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.789622 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9515bdc3-4393-45fb-b91d-06e742955fdb-kube-api-access-vxggq" (OuterVolumeSpecName: "kube-api-access-vxggq") pod "9515bdc3-4393-45fb-b91d-06e742955fdb" (UID: "9515bdc3-4393-45fb-b91d-06e742955fdb"). InnerVolumeSpecName "kube-api-access-vxggq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:27:33.888526 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.888479 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxggq\" (UniqueName: \"kubernetes.io/projected/9515bdc3-4393-45fb-b91d-06e742955fdb-kube-api-access-vxggq\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:27:33.888526 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:33.888504 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9515bdc3-4393-45fb-b91d-06e742955fdb-tls-cert\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:27:34.003922 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.003902 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mh2vv" Jul 08 18:27:34.006804 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.006781 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pl6jx" Jul 08 18:27:34.089630 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.089603 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqd78\" (UniqueName: \"kubernetes.io/projected/b5db3d51-98ac-4173-bdd5-dfbd306108c0-kube-api-access-tqd78\") pod \"b5db3d51-98ac-4173-bdd5-dfbd306108c0\" (UID: \"b5db3d51-98ac-4173-bdd5-dfbd306108c0\") " Jul 08 18:27:34.089792 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.089640 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nnzd\" (UniqueName: \"kubernetes.io/projected/f97f4c33-811d-4af8-8e2e-11ead223e45e-kube-api-access-9nnzd\") pod \"f97f4c33-811d-4af8-8e2e-11ead223e45e\" (UID: \"f97f4c33-811d-4af8-8e2e-11ead223e45e\") " Jul 08 18:27:34.091750 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.091718 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5db3d51-98ac-4173-bdd5-dfbd306108c0-kube-api-access-tqd78" (OuterVolumeSpecName: "kube-api-access-tqd78") pod "b5db3d51-98ac-4173-bdd5-dfbd306108c0" (UID: "b5db3d51-98ac-4173-bdd5-dfbd306108c0"). InnerVolumeSpecName "kube-api-access-tqd78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:27:34.091869 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.091783 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f97f4c33-811d-4af8-8e2e-11ead223e45e-kube-api-access-9nnzd" (OuterVolumeSpecName: "kube-api-access-9nnzd") pod "f97f4c33-811d-4af8-8e2e-11ead223e45e" (UID: "f97f4c33-811d-4af8-8e2e-11ead223e45e"). InnerVolumeSpecName "kube-api-access-9nnzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:27:34.190593 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.190514 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqd78\" (UniqueName: \"kubernetes.io/projected/b5db3d51-98ac-4173-bdd5-dfbd306108c0-kube-api-access-tqd78\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:27:34.190593 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.190546 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nnzd\" (UniqueName: \"kubernetes.io/projected/f97f4c33-811d-4af8-8e2e-11ead223e45e-kube-api-access-9nnzd\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:27:34.685199 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.685160 2576 generic.go:356] "Generic (PLEG): container finished" podID="b5db3d51-98ac-4173-bdd5-dfbd306108c0" containerID="b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe" exitCode=0 Jul 08 18:27:34.685199 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.685197 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mh2vv" Jul 08 18:27:34.685727 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.685244 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mh2vv" event={"ID":"b5db3d51-98ac-4173-bdd5-dfbd306108c0","Type":"ContainerDied","Data":"b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe"} Jul 08 18:27:34.685727 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.685290 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mh2vv" event={"ID":"b5db3d51-98ac-4173-bdd5-dfbd306108c0","Type":"ContainerDied","Data":"969209946dd3ecc3fdec233fbb703f558e9426f5fab25fb42f4474e6f577df9f"} Jul 08 18:27:34.685727 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.685320 2576 scope.go:117] "RemoveContainer" containerID="b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe" Jul 08 18:27:34.687026 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.686998 2576 generic.go:356] "Generic (PLEG): container finished" podID="f97f4c33-811d-4af8-8e2e-11ead223e45e" containerID="0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e" exitCode=0 Jul 08 18:27:34.687149 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.687041 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pl6jx" Jul 08 18:27:34.687149 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.687055 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pl6jx" event={"ID":"f97f4c33-811d-4af8-8e2e-11ead223e45e","Type":"ContainerDied","Data":"0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e"} Jul 08 18:27:34.687149 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.687091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pl6jx" event={"ID":"f97f4c33-811d-4af8-8e2e-11ead223e45e","Type":"ContainerDied","Data":"dd49b657e17be4a4bfd07e27fa2710d3cf573f9bc88d5e153f98b17eb17099cc"} Jul 08 18:27:34.687471 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.687449 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-sjkrq" Jul 08 18:27:34.705983 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.705958 2576 scope.go:117] "RemoveContainer" containerID="b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe" Jul 08 18:27:34.706298 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:27:34.706275 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe\": container with ID starting with b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe not found: ID does not exist" containerID="b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe" Jul 08 18:27:34.706400 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.706305 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe"} err="failed to get container status \"b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe\": rpc error: code = NotFound desc = could not find container \"b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe\": container with ID starting with b95c3000ccf0c2faf5128122101506ad14bad6a4979b304364994d30a6eafdbe not found: ID does not exist" Jul 08 18:27:34.706400 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.706322 2576 scope.go:117] "RemoveContainer" containerID="0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e" Jul 08 18:27:34.714119 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.714103 2576 scope.go:117] "RemoveContainer" containerID="0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e" Jul 08 18:27:34.714850 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:27:34.714824 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e\": container with ID starting with 0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e not found: ID does not exist" containerID="0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e" Jul 08 18:27:34.714913 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.714860 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e"} err="failed to get container status \"0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e\": rpc error: code = NotFound desc = could not find container \"0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e\": container with ID starting with 0b60d9ce0769960448ff8717faffe9e90a458b7e7eb8bc497db73f0a823b771e not found: ID does not exist" Jul 08 18:27:34.718234 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.718212 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mh2vv"] Jul 08 18:27:34.721478 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.721457 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mh2vv"] Jul 08 18:27:34.731584 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.731525 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pl6jx"] Jul 08 18:27:34.733794 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.733773 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pl6jx"] Jul 08 18:27:34.755777 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.755741 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-sjkrq"] Jul 08 18:27:34.761802 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:34.761774 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-sjkrq"] Jul 08 18:27:35.656985 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:35.656953 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9515bdc3-4393-45fb-b91d-06e742955fdb" path="/var/lib/kubelet/pods/9515bdc3-4393-45fb-b91d-06e742955fdb/volumes" Jul 08 18:27:35.657184 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:35.657172 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5db3d51-98ac-4173-bdd5-dfbd306108c0" path="/var/lib/kubelet/pods/b5db3d51-98ac-4173-bdd5-dfbd306108c0/volumes" Jul 08 18:27:35.657485 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:27:35.657472 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f97f4c33-811d-4af8-8e2e-11ead223e45e" path="/var/lib/kubelet/pods/f97f4c33-811d-4af8-8e2e-11ead223e45e/volumes" Jul 08 18:28:18.297436 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:28:18.297400 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:28:35.370841 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:28:35.370758 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:28:48.181009 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:28:48.180972 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:28:56.071248 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:28:56.071204 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:29:04.766257 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:29:04.766226 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:29:16.569403 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:29:16.569348 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:29:29.942391 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:29:29.942326 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:30:00.144031 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.143994 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr"] Jul 08 18:30:00.144455 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.144343 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5db3d51-98ac-4173-bdd5-dfbd306108c0" containerName="authorino" Jul 08 18:30:00.144455 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.144367 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5db3d51-98ac-4173-bdd5-dfbd306108c0" containerName="authorino" Jul 08 18:30:00.144455 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.144387 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f97f4c33-811d-4af8-8e2e-11ead223e45e" containerName="authorino" Jul 08 18:30:00.144455 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.144392 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f97f4c33-811d-4af8-8e2e-11ead223e45e" containerName="authorino" Jul 08 18:30:00.144455 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.144452 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5db3d51-98ac-4173-bdd5-dfbd306108c0" containerName="authorino" Jul 08 18:30:00.144637 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.144463 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f97f4c33-811d-4af8-8e2e-11ead223e45e" containerName="authorino" Jul 08 18:30:00.146440 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.146423 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" Jul 08 18:30:00.148804 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.148782 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 18:30:00.149554 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.149534 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 18:30:00.149554 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.149550 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dvcs5\"" Jul 08 18:30:00.155393 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.155347 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr"] Jul 08 18:30:00.265229 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.265188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j62b5\" (UniqueName: \"kubernetes.io/projected/1a660a28-34a1-438f-aaa0-b0b29da4e0c5-kube-api-access-j62b5\") pod \"maas-api-key-cleanup-29725590-qwjhr\" (UID: \"1a660a28-34a1-438f-aaa0-b0b29da4e0c5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" Jul 08 18:30:00.365862 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.365831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j62b5\" (UniqueName: \"kubernetes.io/projected/1a660a28-34a1-438f-aaa0-b0b29da4e0c5-kube-api-access-j62b5\") pod \"maas-api-key-cleanup-29725590-qwjhr\" (UID: \"1a660a28-34a1-438f-aaa0-b0b29da4e0c5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" Jul 08 18:30:00.373750 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.373724 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j62b5\" (UniqueName: \"kubernetes.io/projected/1a660a28-34a1-438f-aaa0-b0b29da4e0c5-kube-api-access-j62b5\") pod \"maas-api-key-cleanup-29725590-qwjhr\" (UID: \"1a660a28-34a1-438f-aaa0-b0b29da4e0c5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" Jul 08 18:30:00.457976 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.457908 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" Jul 08 18:30:00.579287 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.579267 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr"] Jul 08 18:30:00.581681 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:30:00.581655 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a660a28_34a1_438f_aaa0_b0b29da4e0c5.slice/crio-1f99b86874d1f4b0226941eb0336fcd168214f09607af89a38ad461d3a85b7d8 WatchSource:0}: Error finding container 1f99b86874d1f4b0226941eb0336fcd168214f09607af89a38ad461d3a85b7d8: Status 404 returned error can't find the container with id 1f99b86874d1f4b0226941eb0336fcd168214f09607af89a38ad461d3a85b7d8 Jul 08 18:30:00.583567 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:00.583551 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:30:01.337092 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:01.337057 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" event={"ID":"1a660a28-34a1-438f-aaa0-b0b29da4e0c5","Type":"ContainerStarted","Data":"1f99b86874d1f4b0226941eb0336fcd168214f09607af89a38ad461d3a85b7d8"} Jul 08 18:30:03.346900 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:03.346856 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" event={"ID":"1a660a28-34a1-438f-aaa0-b0b29da4e0c5","Type":"ContainerStarted","Data":"1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f"} Jul 08 18:30:03.362429 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:03.362377 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" podStartSLOduration=1.209787869 podStartE2EDuration="3.362345925s" totalImagesPullingTime="2.152558056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:30:03.361776168 +0000 UTC m=+802.376003257" watchObservedRunningTime="2026-07-08 18:30:03.362345925 +0000 UTC m=+802.376572998" Jul 08 18:30:23.952506 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:23.952475 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f8df5968d-nzfbc"] Jul 08 18:30:23.957757 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:23.957735 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8df5968d-nzfbc" Jul 08 18:30:23.961758 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:23.961714 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f8df5968d-nzfbc"] Jul 08 18:30:24.071663 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:24.071632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b39f6155-3853-408a-a153-8926cd63243a-tls-cert\") pod \"authorino-5f8df5968d-nzfbc\" (UID: \"b39f6155-3853-408a-a153-8926cd63243a\") " pod="kuadrant-system/authorino-5f8df5968d-nzfbc" Jul 08 18:30:24.071821 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:24.071689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvlm\" (UniqueName: \"kubernetes.io/projected/b39f6155-3853-408a-a153-8926cd63243a-kube-api-access-zmvlm\") pod \"authorino-5f8df5968d-nzfbc\" (UID: \"b39f6155-3853-408a-a153-8926cd63243a\") " pod="kuadrant-system/authorino-5f8df5968d-nzfbc" Jul 08 18:30:24.172846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:24.172808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvlm\" (UniqueName: \"kubernetes.io/projected/b39f6155-3853-408a-a153-8926cd63243a-kube-api-access-zmvlm\") pod \"authorino-5f8df5968d-nzfbc\" (UID: \"b39f6155-3853-408a-a153-8926cd63243a\") " pod="kuadrant-system/authorino-5f8df5968d-nzfbc" Jul 08 18:30:24.173019 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:24.172874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b39f6155-3853-408a-a153-8926cd63243a-tls-cert\") pod \"authorino-5f8df5968d-nzfbc\" (UID: \"b39f6155-3853-408a-a153-8926cd63243a\") " pod="kuadrant-system/authorino-5f8df5968d-nzfbc" Jul 08 18:30:24.175176 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:24.175150 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b39f6155-3853-408a-a153-8926cd63243a-tls-cert\") pod \"authorino-5f8df5968d-nzfbc\" (UID: \"b39f6155-3853-408a-a153-8926cd63243a\") " pod="kuadrant-system/authorino-5f8df5968d-nzfbc" Jul 08 18:30:24.180893 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:24.180875 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvlm\" (UniqueName: \"kubernetes.io/projected/b39f6155-3853-408a-a153-8926cd63243a-kube-api-access-zmvlm\") pod \"authorino-5f8df5968d-nzfbc\" (UID: \"b39f6155-3853-408a-a153-8926cd63243a\") " pod="kuadrant-system/authorino-5f8df5968d-nzfbc" Jul 08 18:30:24.267222 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:24.267194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8df5968d-nzfbc" Jul 08 18:30:24.391062 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:24.391031 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f8df5968d-nzfbc"] Jul 08 18:30:24.393340 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:30:24.393314 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb39f6155_3853_408a_a153_8926cd63243a.slice/crio-5da47d507705d6a38f30f505c020c9b641330d3091168baab51104394815fd9a WatchSource:0}: Error finding container 5da47d507705d6a38f30f505c020c9b641330d3091168baab51104394815fd9a: Status 404 returned error can't find the container with id 5da47d507705d6a38f30f505c020c9b641330d3091168baab51104394815fd9a Jul 08 18:30:24.439700 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:24.439671 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8df5968d-nzfbc" event={"ID":"b39f6155-3853-408a-a153-8926cd63243a","Type":"ContainerStarted","Data":"5da47d507705d6a38f30f505c020c9b641330d3091168baab51104394815fd9a"} Jul 08 18:30:25.447517 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:25.447416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8df5968d-nzfbc" event={"ID":"b39f6155-3853-408a-a153-8926cd63243a","Type":"ContainerStarted","Data":"116e15419053051c1f690ae6fa75c699c7166e2bab7656d44e1f839c5be59e5c"} Jul 08 18:30:25.474250 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:25.474193 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f8df5968d-nzfbc" podStartSLOduration=2.070547268 podStartE2EDuration="2.474176775s" totalImagesPullingTime="403.629507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:30:25.473246524 +0000 UTC m=+824.487473599" watchObservedRunningTime="2026-07-08 18:30:25.474176775 +0000 UTC m=+824.488403849" Jul 08 18:30:25.537124 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:25.537092 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-759bcc7d4f-dcxgn"] Jul 08 18:30:25.537325 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:25.537300 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" podUID="6548a144-ee4f-47cc-a92a-16f71388169b" containerName="authorino" containerID="cri-o://05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1" gracePeriod=30 Jul 08 18:30:25.792136 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:25.792110 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" Jul 08 18:30:25.888122 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:25.887708 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6548a144-ee4f-47cc-a92a-16f71388169b-tls-cert\") pod \"6548a144-ee4f-47cc-a92a-16f71388169b\" (UID: \"6548a144-ee4f-47cc-a92a-16f71388169b\") " Jul 08 18:30:25.888122 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:25.887845 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zdmh\" (UniqueName: \"kubernetes.io/projected/6548a144-ee4f-47cc-a92a-16f71388169b-kube-api-access-9zdmh\") pod \"6548a144-ee4f-47cc-a92a-16f71388169b\" (UID: \"6548a144-ee4f-47cc-a92a-16f71388169b\") " Jul 08 18:30:25.895196 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:25.895160 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6548a144-ee4f-47cc-a92a-16f71388169b-kube-api-access-9zdmh" (OuterVolumeSpecName: "kube-api-access-9zdmh") pod "6548a144-ee4f-47cc-a92a-16f71388169b" (UID: "6548a144-ee4f-47cc-a92a-16f71388169b"). InnerVolumeSpecName "kube-api-access-9zdmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:30:25.902468 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:25.902342 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6548a144-ee4f-47cc-a92a-16f71388169b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6548a144-ee4f-47cc-a92a-16f71388169b" (UID: "6548a144-ee4f-47cc-a92a-16f71388169b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:30:25.989537 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:25.989456 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zdmh\" (UniqueName: \"kubernetes.io/projected/6548a144-ee4f-47cc-a92a-16f71388169b-kube-api-access-9zdmh\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:30:25.989537 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:25.989501 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6548a144-ee4f-47cc-a92a-16f71388169b-tls-cert\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:30:26.454668 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:26.454633 2576 generic.go:356] "Generic (PLEG): container finished" podID="6548a144-ee4f-47cc-a92a-16f71388169b" containerID="05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1" exitCode=0 Jul 08 18:30:26.455151 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:26.454679 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" Jul 08 18:30:26.455151 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:26.454720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" event={"ID":"6548a144-ee4f-47cc-a92a-16f71388169b","Type":"ContainerDied","Data":"05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1"} Jul 08 18:30:26.455151 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:26.454757 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-759bcc7d4f-dcxgn" event={"ID":"6548a144-ee4f-47cc-a92a-16f71388169b","Type":"ContainerDied","Data":"fa79154d779aee56a8de69bdea838a8a26a59c7c1bf8b0e031a68cecad53cec0"} Jul 08 18:30:26.455151 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:26.454776 2576 scope.go:117] "RemoveContainer" containerID="05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1" Jul 08 18:30:26.463742 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:26.463720 2576 scope.go:117] "RemoveContainer" containerID="05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1" Jul 08 18:30:26.464073 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:30:26.464053 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1\": container with ID starting with 05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1 not found: ID does not exist" containerID="05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1" Jul 08 18:30:26.464121 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:26.464083 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1"} err="failed to get container status \"05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1\": rpc error: code = NotFound desc = could not find container \"05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1\": container with ID starting with 05a16368c1a290b235fbb0a08aefbeca001b9d4f1bb6419d2330e07a3662e8a1 not found: ID does not exist" Jul 08 18:30:26.475911 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:26.475888 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-759bcc7d4f-dcxgn"] Jul 08 18:30:26.481780 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:26.481756 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-759bcc7d4f-dcxgn"] Jul 08 18:30:27.657879 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:27.657837 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6548a144-ee4f-47cc-a92a-16f71388169b" path="/var/lib/kubelet/pods/6548a144-ee4f-47cc-a92a-16f71388169b/volumes" Jul 08 18:30:54.171263 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:30:54.171222 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:31:00.010527 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:00.010494 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr"] Jul 08 18:31:00.010899 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:00.010690 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" podUID="1a660a28-34a1-438f-aaa0-b0b29da4e0c5" containerName="cleanup" containerID="cri-o://1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f" gracePeriod=30 Jul 08 18:31:03.212528 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:03.212484 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:31:13.874592 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:13.874558 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:31:24.178104 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:24.178070 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:31:30.190663 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.190630 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" Jul 08 18:31:30.356098 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.356002 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j62b5\" (UniqueName: \"kubernetes.io/projected/1a660a28-34a1-438f-aaa0-b0b29da4e0c5-kube-api-access-j62b5\") pod \"1a660a28-34a1-438f-aaa0-b0b29da4e0c5\" (UID: \"1a660a28-34a1-438f-aaa0-b0b29da4e0c5\") " Jul 08 18:31:30.358146 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.358112 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a660a28-34a1-438f-aaa0-b0b29da4e0c5-kube-api-access-j62b5" (OuterVolumeSpecName: "kube-api-access-j62b5") pod "1a660a28-34a1-438f-aaa0-b0b29da4e0c5" (UID: "1a660a28-34a1-438f-aaa0-b0b29da4e0c5"). InnerVolumeSpecName "kube-api-access-j62b5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:31:30.456829 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.456789 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j62b5\" (UniqueName: \"kubernetes.io/projected/1a660a28-34a1-438f-aaa0-b0b29da4e0c5-kube-api-access-j62b5\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:31:30.753132 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.753044 2576 generic.go:356] "Generic (PLEG): container finished" podID="1a660a28-34a1-438f-aaa0-b0b29da4e0c5" containerID="1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f" exitCode=137 Jul 08 18:31:30.753132 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.753088 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" Jul 08 18:31:30.753377 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.753129 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" event={"ID":"1a660a28-34a1-438f-aaa0-b0b29da4e0c5","Type":"ContainerDied","Data":"1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f"} Jul 08 18:31:30.753377 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.753181 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr" event={"ID":"1a660a28-34a1-438f-aaa0-b0b29da4e0c5","Type":"ContainerDied","Data":"1f99b86874d1f4b0226941eb0336fcd168214f09607af89a38ad461d3a85b7d8"} Jul 08 18:31:30.753377 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.753209 2576 scope.go:117] "RemoveContainer" containerID="1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f" Jul 08 18:31:30.762236 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.762213 2576 scope.go:117] "RemoveContainer" containerID="1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f" Jul 08 18:31:30.762517 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:31:30.762498 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f\": container with ID starting with 1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f not found: ID does not exist" containerID="1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f" Jul 08 18:31:30.762566 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.762529 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f"} err="failed to get container status \"1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f\": rpc error: code = NotFound desc = could not find container \"1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f\": container with ID starting with 1f59ee48601f46d754335aa341c3fc98265caa429b0d05bc76b2a6a7d215988f not found: ID does not exist" Jul 08 18:31:30.773211 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.773188 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr"] Jul 08 18:31:30.775923 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:30.775899 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725590-qwjhr"] Jul 08 18:31:31.657112 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:31.657077 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a660a28-34a1-438f-aaa0-b0b29da4e0c5" path="/var/lib/kubelet/pods/1a660a28-34a1-438f-aaa0-b0b29da4e0c5/volumes" Jul 08 18:31:33.872587 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:33.872508 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:31:41.471659 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:41.471630 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:31:41.472105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:41.471711 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:31:41.476588 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:41.476568 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:31:41.476744 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:31:41.476596 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:32:01.076105 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:32:01.076059 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:32:11.974295 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:32:11.974257 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:32:46.970775 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:32:46.970735 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:32:56.369895 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:32:56.369859 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:33:06.772664 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:33:06.772579 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:33:15.062961 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:33:15.062920 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:33:26.872016 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:33:26.871974 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:33:36.770900 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:33:36.770867 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:33:47.969216 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:33:47.969179 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:33:57.772836 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:33:57.772798 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:34:19.265018 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:34:19.264977 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:34:31.069251 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:34:31.069206 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:34:54.164810 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:34:54.164726 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:35:05.067219 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:35:05.067180 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:35:20.007380 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:35:20.004062 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:35:29.071526 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:35:29.071490 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:35:40.671254 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:35:40.671217 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:35:50.465867 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:35:50.465828 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:35:59.667863 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:35:59.667826 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:36:25.340423 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:25.340324 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb"] Jul 08 18:36:25.340956 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:25.340569 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" podUID="da8b1223-4181-4f12-87f9-3f6745846120" containerName="manager" containerID="cri-o://78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398" gracePeriod=10 Jul 08 18:36:28.684515 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:28.684489 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:36:28.695707 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:28.695685 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2fdt\" (UniqueName: \"kubernetes.io/projected/da8b1223-4181-4f12-87f9-3f6745846120-kube-api-access-z2fdt\") pod \"da8b1223-4181-4f12-87f9-3f6745846120\" (UID: \"da8b1223-4181-4f12-87f9-3f6745846120\") " Jul 08 18:36:28.695811 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:28.695735 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8b1223-4181-4f12-87f9-3f6745846120-extensions-socket-volume\") pod \"da8b1223-4181-4f12-87f9-3f6745846120\" (UID: \"da8b1223-4181-4f12-87f9-3f6745846120\") " Jul 08 18:36:28.696121 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:28.696094 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8b1223-4181-4f12-87f9-3f6745846120-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "da8b1223-4181-4f12-87f9-3f6745846120" (UID: "da8b1223-4181-4f12-87f9-3f6745846120"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:36:28.697662 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:28.697641 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da8b1223-4181-4f12-87f9-3f6745846120-kube-api-access-z2fdt" (OuterVolumeSpecName: "kube-api-access-z2fdt") pod "da8b1223-4181-4f12-87f9-3f6745846120" (UID: "da8b1223-4181-4f12-87f9-3f6745846120"). InnerVolumeSpecName "kube-api-access-z2fdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:36:28.796607 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:28.796506 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8b1223-4181-4f12-87f9-3f6745846120-extensions-socket-volume\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:36:28.796607 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:28.796547 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2fdt\" (UniqueName: \"kubernetes.io/projected/da8b1223-4181-4f12-87f9-3f6745846120-kube-api-access-z2fdt\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:36:29.113975 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:29.113882 2576 generic.go:356] "Generic (PLEG): container finished" podID="da8b1223-4181-4f12-87f9-3f6745846120" containerID="78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398" exitCode=0 Jul 08 18:36:29.113975 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:29.113929 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" Jul 08 18:36:29.113975 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:29.113935 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" event={"ID":"da8b1223-4181-4f12-87f9-3f6745846120","Type":"ContainerDied","Data":"78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398"} Jul 08 18:36:29.114245 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:29.113994 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb" event={"ID":"da8b1223-4181-4f12-87f9-3f6745846120","Type":"ContainerDied","Data":"b911c37ba015932525d800117baabc561ec689f7f978db3c6535dcd335c09de6"} Jul 08 18:36:29.114245 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:29.114018 2576 scope.go:117] "RemoveContainer" containerID="78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398" Jul 08 18:36:29.123235 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:29.123213 2576 scope.go:117] "RemoveContainer" containerID="78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398" Jul 08 18:36:29.123564 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:36:29.123542 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398\": container with ID starting with 78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398 not found: ID does not exist" containerID="78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398" Jul 08 18:36:29.123656 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:29.123570 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398"} err="failed to get container status \"78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398\": rpc error: code = NotFound desc = could not find container \"78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398\": container with ID starting with 78c1e8abddaed3d48357d73c72acdf47726dbb0703697345e3ff519ad10d2398 not found: ID does not exist" Jul 08 18:36:29.134165 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:29.134135 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb"] Jul 08 18:36:29.137923 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:29.137897 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qt9qb"] Jul 08 18:36:29.657439 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:29.657400 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da8b1223-4181-4f12-87f9-3f6745846120" path="/var/lib/kubelet/pods/da8b1223-4181-4f12-87f9-3f6745846120/volumes" Jul 08 18:36:41.501084 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:41.501057 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:36:41.502289 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:41.502269 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:36:41.505997 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:41.505976 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:36:41.507280 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:36:41.507259 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:37:26.512718 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.512686 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr"] Jul 08 18:37:26.513234 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.513072 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6548a144-ee4f-47cc-a92a-16f71388169b" containerName="authorino" Jul 08 18:37:26.513234 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.513084 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6548a144-ee4f-47cc-a92a-16f71388169b" containerName="authorino" Jul 08 18:37:26.513234 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.513102 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8b1223-4181-4f12-87f9-3f6745846120" containerName="manager" Jul 08 18:37:26.513234 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.513108 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8b1223-4181-4f12-87f9-3f6745846120" containerName="manager" Jul 08 18:37:26.513234 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.513114 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a660a28-34a1-438f-aaa0-b0b29da4e0c5" containerName="cleanup" Jul 08 18:37:26.513234 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.513120 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a660a28-34a1-438f-aaa0-b0b29da4e0c5" containerName="cleanup" Jul 08 18:37:26.513234 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.513179 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6548a144-ee4f-47cc-a92a-16f71388169b" containerName="authorino" Jul 08 18:37:26.513234 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.513189 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a660a28-34a1-438f-aaa0-b0b29da4e0c5" containerName="cleanup" Jul 08 18:37:26.513234 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.513195 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="da8b1223-4181-4f12-87f9-3f6745846120" containerName="manager" Jul 08 18:37:26.516145 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.516128 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" Jul 08 18:37:26.518880 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.518860 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gh9kx\"" Jul 08 18:37:26.528686 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.528661 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr"] Jul 08 18:37:26.586862 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.586825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcpc9\" (UniqueName: \"kubernetes.io/projected/1b141795-8a18-47ae-a8d9-2845daca92d2-kube-api-access-lcpc9\") pod \"kuadrant-operator-controller-manager-86878c769f-qvlnr\" (UID: \"1b141795-8a18-47ae-a8d9-2845daca92d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" Jul 08 18:37:26.587058 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.586940 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b141795-8a18-47ae-a8d9-2845daca92d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qvlnr\" (UID: \"1b141795-8a18-47ae-a8d9-2845daca92d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" Jul 08 18:37:26.688424 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.688342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b141795-8a18-47ae-a8d9-2845daca92d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qvlnr\" (UID: \"1b141795-8a18-47ae-a8d9-2845daca92d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" Jul 08 18:37:26.688637 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.688476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcpc9\" (UniqueName: \"kubernetes.io/projected/1b141795-8a18-47ae-a8d9-2845daca92d2-kube-api-access-lcpc9\") pod \"kuadrant-operator-controller-manager-86878c769f-qvlnr\" (UID: \"1b141795-8a18-47ae-a8d9-2845daca92d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" Jul 08 18:37:26.688866 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.688844 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b141795-8a18-47ae-a8d9-2845daca92d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qvlnr\" (UID: \"1b141795-8a18-47ae-a8d9-2845daca92d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" Jul 08 18:37:26.702328 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.702299 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcpc9\" (UniqueName: \"kubernetes.io/projected/1b141795-8a18-47ae-a8d9-2845daca92d2-kube-api-access-lcpc9\") pod \"kuadrant-operator-controller-manager-86878c769f-qvlnr\" (UID: \"1b141795-8a18-47ae-a8d9-2845daca92d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" Jul 08 18:37:26.826488 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.826386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" Jul 08 18:37:26.962745 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:26.962708 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr"] Jul 08 18:37:26.966398 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:37:26.966344 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b141795_8a18_47ae_a8d9_2845daca92d2.slice/crio-95d6f0bdd29478708af2c29aa43a1e5d73c887b80cbc3738fb5fe0981591f400 WatchSource:0}: Error finding container 95d6f0bdd29478708af2c29aa43a1e5d73c887b80cbc3738fb5fe0981591f400: Status 404 returned error can't find the container with id 95d6f0bdd29478708af2c29aa43a1e5d73c887b80cbc3738fb5fe0981591f400 Jul 08 18:37:27.366135 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:27.366099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" event={"ID":"1b141795-8a18-47ae-a8d9-2845daca92d2","Type":"ContainerStarted","Data":"ef1fcd1e7561f6ca2415f62b0288ed03724e12f6c6e503df93eb2fd1a69e4e0a"} Jul 08 18:37:27.366333 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:27.366153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" event={"ID":"1b141795-8a18-47ae-a8d9-2845daca92d2","Type":"ContainerStarted","Data":"95d6f0bdd29478708af2c29aa43a1e5d73c887b80cbc3738fb5fe0981591f400"} Jul 08 18:37:27.366333 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:27.366187 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" Jul 08 18:37:27.385851 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:27.385801 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" podStartSLOduration=1.385784128 podStartE2EDuration="1.385784128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:37:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:37:27.383993718 +0000 UTC m=+1246.398220784" watchObservedRunningTime="2026-07-08 18:37:27.385784128 +0000 UTC m=+1246.400011265" Jul 08 18:37:38.373405 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:38.373302 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qvlnr" Jul 08 18:37:46.469761 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:46.469726 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:37:57.773496 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:37:57.773456 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:38:06.975059 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:38:06.975017 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:38:18.975688 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:38:18.975652 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:38:29.772005 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:38:29.771969 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:38:40.777608 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:38:40.777574 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:38:49.869240 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:38:49.869202 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:39:00.869997 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:39:00.869953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:39:11.877642 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:39:11.877554 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:39:21.069186 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:39:21.069148 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:39:34.569066 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:39:34.569031 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:39:55.866320 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:39:55.866286 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:40:02.976675 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:40:02.976638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:40:12.968657 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:40:12.968622 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:40:22.568094 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:40:22.568055 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:40:32.979555 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:40:32.979457 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:40:44.974249 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:40:44.974208 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:40:55.568877 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:40:55.568834 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:41:05.068401 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:41:05.068363 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:41:14.972443 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:41:14.972411 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:41:24.469067 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:41:24.469034 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:41:33.870926 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:41:33.870889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:41:41.529062 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:41:41.529031 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:41:41.532257 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:41:41.532232 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:41:41.533844 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:41:41.533824 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:41:41.536914 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:41:41.536895 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:41:47.665967 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:41:47.665935 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:41:57.077261 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:41:57.077230 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:42:06.770761 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:42:06.770676 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:42:19.076348 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:42:19.076313 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:42:30.068565 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:42:30.068522 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:42:39.571077 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:42:39.571024 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:42:52.065660 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:42:52.065626 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:43:04.372957 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:43:04.372922 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:43:16.969562 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:43:16.969526 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:43:26.070113 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:43:26.070076 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:43:38.863984 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:43:38.863897 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:43:47.570275 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:43:47.570230 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:45:00.140629 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:00.140591 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl"] Jul 08 18:45:00.143948 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:00.143928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" Jul 08 18:45:00.146480 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:00.146450 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 18:45:00.146623 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:00.146496 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 18:45:00.147403 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:00.147376 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dvcs5\"" Jul 08 18:45:00.156063 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:00.156029 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl"] Jul 08 18:45:00.239808 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:00.239767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-827dc\" (UniqueName: \"kubernetes.io/projected/0fd2a564-e7fe-4462-87fd-3e01c23792f4-kube-api-access-827dc\") pod \"maas-api-key-cleanup-29725605-fltnl\" (UID: \"0fd2a564-e7fe-4462-87fd-3e01c23792f4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" Jul 08 18:45:00.341120 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:00.341084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-827dc\" (UniqueName: \"kubernetes.io/projected/0fd2a564-e7fe-4462-87fd-3e01c23792f4-kube-api-access-827dc\") pod \"maas-api-key-cleanup-29725605-fltnl\" (UID: \"0fd2a564-e7fe-4462-87fd-3e01c23792f4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" Jul 08 18:45:00.349107 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:00.349060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-827dc\" (UniqueName: \"kubernetes.io/projected/0fd2a564-e7fe-4462-87fd-3e01c23792f4-kube-api-access-827dc\") pod \"maas-api-key-cleanup-29725605-fltnl\" (UID: \"0fd2a564-e7fe-4462-87fd-3e01c23792f4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" Jul 08 18:45:00.455272 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:00.455182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" Jul 08 18:45:00.595846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:00.595810 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl"] Jul 08 18:45:00.598489 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:45:00.598456 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd2a564_e7fe_4462_87fd_3e01c23792f4.slice/crio-87ed20206c7f4c1f7375fb7a70e7d0411c5aff2f77d488ab1d2379be165769de WatchSource:0}: Error finding container 87ed20206c7f4c1f7375fb7a70e7d0411c5aff2f77d488ab1d2379be165769de: Status 404 returned error can't find the container with id 87ed20206c7f4c1f7375fb7a70e7d0411c5aff2f77d488ab1d2379be165769de Jul 08 18:45:01.442914 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:01.442870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" event={"ID":"0fd2a564-e7fe-4462-87fd-3e01c23792f4","Type":"ContainerStarted","Data":"524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670"} Jul 08 18:45:01.443329 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:01.442958 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" event={"ID":"0fd2a564-e7fe-4462-87fd-3e01c23792f4","Type":"ContainerStarted","Data":"87ed20206c7f4c1f7375fb7a70e7d0411c5aff2f77d488ab1d2379be165769de"} Jul 08 18:45:01.458205 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:45:01.458152 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" podStartSLOduration=1.458136766 podStartE2EDuration="1.458136766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:45:01.457594968 +0000 UTC m=+1700.471822044" watchObservedRunningTime="2026-07-08 18:45:01.458136766 +0000 UTC m=+1700.472363842" Jul 08 18:46:00.009738 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:00.009702 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl"] Jul 08 18:46:00.010171 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:00.009913 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" podUID="0fd2a564-e7fe-4462-87fd-3e01c23792f4" containerName="cleanup" containerID="cri-o://524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670" gracePeriod=30 Jul 08 18:46:30.201139 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.201110 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" Jul 08 18:46:30.295961 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.295856 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-827dc\" (UniqueName: \"kubernetes.io/projected/0fd2a564-e7fe-4462-87fd-3e01c23792f4-kube-api-access-827dc\") pod \"0fd2a564-e7fe-4462-87fd-3e01c23792f4\" (UID: \"0fd2a564-e7fe-4462-87fd-3e01c23792f4\") " Jul 08 18:46:30.297978 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.297952 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd2a564-e7fe-4462-87fd-3e01c23792f4-kube-api-access-827dc" (OuterVolumeSpecName: "kube-api-access-827dc") pod "0fd2a564-e7fe-4462-87fd-3e01c23792f4" (UID: "0fd2a564-e7fe-4462-87fd-3e01c23792f4"). InnerVolumeSpecName "kube-api-access-827dc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:46:30.396514 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.396457 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-827dc\" (UniqueName: \"kubernetes.io/projected/0fd2a564-e7fe-4462-87fd-3e01c23792f4-kube-api-access-827dc\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:46:30.865964 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.865927 2576 generic.go:356] "Generic (PLEG): container finished" podID="0fd2a564-e7fe-4462-87fd-3e01c23792f4" containerID="524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670" exitCode=137 Jul 08 18:46:30.866162 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.865974 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" Jul 08 18:46:30.866162 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.866012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" event={"ID":"0fd2a564-e7fe-4462-87fd-3e01c23792f4","Type":"ContainerDied","Data":"524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670"} Jul 08 18:46:30.866162 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.866067 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl" event={"ID":"0fd2a564-e7fe-4462-87fd-3e01c23792f4","Type":"ContainerDied","Data":"87ed20206c7f4c1f7375fb7a70e7d0411c5aff2f77d488ab1d2379be165769de"} Jul 08 18:46:30.866162 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.866091 2576 scope.go:117] "RemoveContainer" containerID="524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670" Jul 08 18:46:30.875322 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.875305 2576 scope.go:117] "RemoveContainer" containerID="524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670" Jul 08 18:46:30.875630 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:46:30.875607 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670\": container with ID starting with 524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670 not found: ID does not exist" containerID="524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670" Jul 08 18:46:30.875677 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.875640 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670"} err="failed to get container status \"524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670\": rpc error: code = NotFound desc = could not find container \"524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670\": container with ID starting with 524c82099281d8122dde30decbdcd52f481de68a6c8c1beb20938b2bdc4c0670 not found: ID does not exist" Jul 08 18:46:30.886217 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.886188 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl"] Jul 08 18:46:30.888949 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:30.888925 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725605-fltnl"] Jul 08 18:46:31.658681 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:31.658645 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fd2a564-e7fe-4462-87fd-3e01c23792f4" path="/var/lib/kubelet/pods/0fd2a564-e7fe-4462-87fd-3e01c23792f4/volumes" Jul 08 18:46:41.557667 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:41.557631 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:46:41.561152 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:41.561128 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:46:41.562690 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:41.562667 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:46:41.566324 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:46:41.566303 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:50:30.763880 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:50:30.763846 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:50:39.277893 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:50:39.277860 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:51:41.585007 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:51:41.584970 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:51:41.590129 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:51:41.590104 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:51:41.590305 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:51:41.590282 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:51:41.595099 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:51:41.595081 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:52:00.768400 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:52:00.768349 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:52:09.385924 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:52:09.385887 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:52:23.971530 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:52:23.971497 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:52:32.672349 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:52:32.672269 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:53:05.973982 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:05.973950 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:53:12.971020 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:12.970980 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9"] Jul 08 18:53:12.971566 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:12.971432 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd2a564-e7fe-4462-87fd-3e01c23792f4" containerName="cleanup" Jul 08 18:53:12.971566 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:12.971447 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd2a564-e7fe-4462-87fd-3e01c23792f4" containerName="cleanup" Jul 08 18:53:12.971566 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:12.971531 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fd2a564-e7fe-4462-87fd-3e01c23792f4" containerName="cleanup" Jul 08 18:53:12.974596 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:12.974576 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:12.977850 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:12.977824 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2046dd63\"/\"openshift-service-ca.crt\"" Jul 08 18:53:12.977996 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:12.977824 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2046dd63\"/\"e2e-lifecycle-model-2046dd63-kserve-self-signed-certs\"" Jul 08 18:53:12.978138 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:12.978121 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2046dd63\"/\"kube-root-ca.crt\"" Jul 08 18:53:12.978201 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:12.978165 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2046dd63\"/\"default-dockercfg-cl8pm\"" Jul 08 18:53:12.985487 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:12.985463 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9"] Jul 08 18:53:13.104149 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.104106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-dshm\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.104149 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.104145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcm6w\" (UniqueName: \"kubernetes.io/projected/ca194576-484f-464a-9820-862a46c2a5cd-kube-api-access-dcm6w\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.104405 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.104174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca194576-484f-464a-9820-862a46c2a5cd-tls-certs\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.104405 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.104229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-tmp-dir\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.104405 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.104270 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-model-cache\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.104405 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.104314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-home\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.204969 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.204928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca194576-484f-464a-9820-862a46c2a5cd-tls-certs\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.204969 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.204970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-tmp-dir\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.205184 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.205109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-model-cache\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.205232 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.205188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-home\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.205276 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.205257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-dshm\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.205313 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.205286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcm6w\" (UniqueName: \"kubernetes.io/projected/ca194576-484f-464a-9820-862a46c2a5cd-kube-api-access-dcm6w\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.205394 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.205313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-tmp-dir\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.205498 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.205472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-model-cache\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.205623 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.205505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-home\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.207340 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.207319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-dshm\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.207530 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.207514 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca194576-484f-464a-9820-862a46c2a5cd-tls-certs\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.213233 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.213209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcm6w\" (UniqueName: \"kubernetes.io/projected/ca194576-484f-464a-9820-862a46c2a5cd-kube-api-access-dcm6w\") pod \"e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.285207 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.285169 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:13.416368 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.416332 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9"] Jul 08 18:53:13.419144 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:53:13.419113 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca194576_484f_464a_9820_862a46c2a5cd.slice/crio-c307b0b0fac09fe5f628b614d22bff15bbd6878ee05f28e8351df6ba35c2e487 WatchSource:0}: Error finding container c307b0b0fac09fe5f628b614d22bff15bbd6878ee05f28e8351df6ba35c2e487: Status 404 returned error can't find the container with id c307b0b0fac09fe5f628b614d22bff15bbd6878ee05f28e8351df6ba35c2e487 Jul 08 18:53:13.421514 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.421497 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:53:13.686317 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:13.686136 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" event={"ID":"ca194576-484f-464a-9820-862a46c2a5cd","Type":"ContainerStarted","Data":"c307b0b0fac09fe5f628b614d22bff15bbd6878ee05f28e8351df6ba35c2e487"} Jul 08 18:53:14.692751 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:14.692713 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" event={"ID":"ca194576-484f-464a-9820-862a46c2a5cd","Type":"ContainerStarted","Data":"0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b"} Jul 08 18:53:14.708193 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:14.707989 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" podStartSLOduration=1.678160611 podStartE2EDuration="2.707972337s" totalImagesPullingTime="1.029811726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:53:14.707250547 +0000 UTC m=+2193.721477626" watchObservedRunningTime="2026-07-08 18:53:14.707972337 +0000 UTC m=+2193.722199391" Jul 08 18:53:15.570404 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:15.570366 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:53:23.285525 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:23.285469 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:23.286006 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:23.285556 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:23.298118 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:23.298092 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:23.749217 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:23.749128 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:53:40.466707 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:40.466665 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:53:50.873997 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:50.873963 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:53:51.637065 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:53:51.637033 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9"] Jul 08 18:54:06.657161 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:06.657064 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" podUID="ca194576-484f-464a-9820-862a46c2a5cd" containerName="main" containerID="cri-o://0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b" gracePeriod=45 Jul 08 18:54:06.905639 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:06.905612 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:54:06.930576 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:06.930492 2576 generic.go:356] "Generic (PLEG): container finished" podID="ca194576-484f-464a-9820-862a46c2a5cd" containerID="0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b" exitCode=0 Jul 08 18:54:06.930576 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:06.930546 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" Jul 08 18:54:06.930755 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:06.930580 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" event={"ID":"ca194576-484f-464a-9820-862a46c2a5cd","Type":"ContainerDied","Data":"0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b"} Jul 08 18:54:06.930755 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:06.930632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9" event={"ID":"ca194576-484f-464a-9820-862a46c2a5cd","Type":"ContainerDied","Data":"c307b0b0fac09fe5f628b614d22bff15bbd6878ee05f28e8351df6ba35c2e487"} Jul 08 18:54:06.930755 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:06.930657 2576 scope.go:117] "RemoveContainer" containerID="0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b" Jul 08 18:54:06.939921 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:06.939903 2576 scope.go:117] "RemoveContainer" containerID="0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b" Jul 08 18:54:06.940216 ip-10-0-130-26 kubenswrapper[2576]: E0708 18:54:06.940196 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b\": container with ID starting with 0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b not found: ID does not exist" containerID="0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b" Jul 08 18:54:06.940291 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:06.940223 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b"} err="failed to get container status \"0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b\": rpc error: code = NotFound desc = could not find container \"0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b\": container with ID starting with 0fee87819e0593265b0d8433f6120848e77555d647fe24e6e76acf72275f568b not found: ID does not exist" Jul 08 18:54:07.055225 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.055189 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcm6w\" (UniqueName: \"kubernetes.io/projected/ca194576-484f-464a-9820-862a46c2a5cd-kube-api-access-dcm6w\") pod \"ca194576-484f-464a-9820-862a46c2a5cd\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " Jul 08 18:54:07.055225 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.055231 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca194576-484f-464a-9820-862a46c2a5cd-tls-certs\") pod \"ca194576-484f-464a-9820-862a46c2a5cd\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " Jul 08 18:54:07.055512 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.055269 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-tmp-dir\") pod \"ca194576-484f-464a-9820-862a46c2a5cd\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " Jul 08 18:54:07.055512 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.055308 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-dshm\") pod \"ca194576-484f-464a-9820-862a46c2a5cd\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " Jul 08 18:54:07.055512 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.055338 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-home\") pod \"ca194576-484f-464a-9820-862a46c2a5cd\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " Jul 08 18:54:07.055512 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.055425 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-model-cache\") pod \"ca194576-484f-464a-9820-862a46c2a5cd\" (UID: \"ca194576-484f-464a-9820-862a46c2a5cd\") " Jul 08 18:54:07.055735 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.055599 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ca194576-484f-464a-9820-862a46c2a5cd" (UID: "ca194576-484f-464a-9820-862a46c2a5cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:54:07.055735 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.055624 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-home" (OuterVolumeSpecName: "home") pod "ca194576-484f-464a-9820-862a46c2a5cd" (UID: "ca194576-484f-464a-9820-862a46c2a5cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:54:07.055842 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.055766 2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-tmp-dir\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:54:07.055842 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.055786 2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-home\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:54:07.055951 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.055851 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "ca194576-484f-464a-9820-862a46c2a5cd" (UID: "ca194576-484f-464a-9820-862a46c2a5cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:54:07.057555 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.057522 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-dshm" (OuterVolumeSpecName: "dshm") pod "ca194576-484f-464a-9820-862a46c2a5cd" (UID: "ca194576-484f-464a-9820-862a46c2a5cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:54:07.057667 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.057584 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca194576-484f-464a-9820-862a46c2a5cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ca194576-484f-464a-9820-862a46c2a5cd" (UID: "ca194576-484f-464a-9820-862a46c2a5cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:54:07.057667 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.057598 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca194576-484f-464a-9820-862a46c2a5cd-kube-api-access-dcm6w" (OuterVolumeSpecName: "kube-api-access-dcm6w") pod "ca194576-484f-464a-9820-862a46c2a5cd" (UID: "ca194576-484f-464a-9820-862a46c2a5cd"). InnerVolumeSpecName "kube-api-access-dcm6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:54:07.156751 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.156710 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcm6w\" (UniqueName: \"kubernetes.io/projected/ca194576-484f-464a-9820-862a46c2a5cd-kube-api-access-dcm6w\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:54:07.156751 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.156745 2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca194576-484f-464a-9820-862a46c2a5cd-tls-certs\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:54:07.156751 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.156760 2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-dshm\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:54:07.157032 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.156770 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca194576-484f-464a-9820-862a46c2a5cd-model-cache\") on node \"ip-10-0-130-26.ec2.internal\" DevicePath \"\"" Jul 08 18:54:07.251206 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.251170 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9"] Jul 08 18:54:07.255186 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.255158 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-2046dd63/e2e-lifecycle-model-2046dd63-kserve-75ccb649cf-62fp9"] Jul 08 18:54:07.657766 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:07.657722 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca194576-484f-464a-9820-862a46c2a5cd" path="/var/lib/kubelet/pods/ca194576-484f-464a-9820-862a46c2a5cd/volumes" Jul 08 18:54:31.368520 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:31.368481 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:54:52.883286 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:54:52.883249 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:55:06.675408 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:55:06.675372 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ch8jf"] Jul 08 18:56:41.611659 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:56:41.611626 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:56:41.616579 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:56:41.616554 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:56:41.620652 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:56:41.620632 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:56:41.625057 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:56:41.625040 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rl42_cff52718-1619-4071-af70-b7a6d040bcb8/ovn-acl-logging/0.log" Jul 08 18:59:04.088148 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:04.088117 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f8df5968d-nzfbc_b39f6155-3853-408a-a153-8926cd63243a/authorino/0.log" Jul 08 18:59:09.404562 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:09.404537 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-ds7m9_12f48164-c3aa-4af0-a914-97e08ff1b1e3/copy-manifests/0.log" Jul 08 18:59:09.411124 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:09.411096 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-ds7m9_12f48164-c3aa-4af0-a914-97e08ff1b1e3/manager/0.log" Jul 08 18:59:10.825563 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:10.825527 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f8df5968d-nzfbc_b39f6155-3853-408a-a153-8926cd63243a/authorino/0.log" Jul 08 18:59:11.444895 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:11.444864 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qvlnr_1b141795-8a18-47ae-a8d9-2845daca92d2/manager/0.log" Jul 08 18:59:11.580930 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:11.580894 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ch8jf_32baaa54-9d9f-4951-8bf6-073b278e1d83/limitador/0.log" Jul 08 18:59:12.398479 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:12.398450 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57657c797d-r8gpd_1c7849d1-7d46-4875-a635-2ccad8950350/kube-auth-proxy/0.log" Jul 08 18:59:17.926039 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:17.926005 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6hq9s/must-gather-cjqwl"] Jul 08 18:59:17.926456 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:17.926379 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca194576-484f-464a-9820-862a46c2a5cd" containerName="main" Jul 08 18:59:17.926456 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:17.926391 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca194576-484f-464a-9820-862a46c2a5cd" containerName="main" Jul 08 18:59:17.926546 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:17.926465 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca194576-484f-464a-9820-862a46c2a5cd" containerName="main" Jul 08 18:59:17.929447 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:17.929430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hq9s/must-gather-cjqwl" Jul 08 18:59:17.933168 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:17.933144 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6hq9s\"/\"default-dockercfg-nlchm\"" Jul 08 18:59:17.933954 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:17.933938 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hq9s\"/\"openshift-service-ca.crt\"" Jul 08 18:59:17.934023 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:17.933994 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hq9s\"/\"kube-root-ca.crt\"" Jul 08 18:59:17.940095 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:17.940074 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hq9s/must-gather-cjqwl"] Jul 08 18:59:18.048576 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:18.048537 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csgnv\" (UniqueName: \"kubernetes.io/projected/290bcdba-1a57-4af5-a2d5-fb534356a973-kube-api-access-csgnv\") pod \"must-gather-cjqwl\" (UID: \"290bcdba-1a57-4af5-a2d5-fb534356a973\") " pod="openshift-must-gather-6hq9s/must-gather-cjqwl" Jul 08 18:59:18.048576 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:18.048586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/290bcdba-1a57-4af5-a2d5-fb534356a973-must-gather-output\") pod \"must-gather-cjqwl\" (UID: \"290bcdba-1a57-4af5-a2d5-fb534356a973\") " pod="openshift-must-gather-6hq9s/must-gather-cjqwl" Jul 08 18:59:18.149336 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:18.149297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/290bcdba-1a57-4af5-a2d5-fb534356a973-must-gather-output\") pod \"must-gather-cjqwl\" (UID: \"290bcdba-1a57-4af5-a2d5-fb534356a973\") " pod="openshift-must-gather-6hq9s/must-gather-cjqwl" Jul 08 18:59:18.149526 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:18.149421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csgnv\" (UniqueName: \"kubernetes.io/projected/290bcdba-1a57-4af5-a2d5-fb534356a973-kube-api-access-csgnv\") pod \"must-gather-cjqwl\" (UID: \"290bcdba-1a57-4af5-a2d5-fb534356a973\") " pod="openshift-must-gather-6hq9s/must-gather-cjqwl" Jul 08 18:59:18.149658 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:18.149639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/290bcdba-1a57-4af5-a2d5-fb534356a973-must-gather-output\") pod \"must-gather-cjqwl\" (UID: \"290bcdba-1a57-4af5-a2d5-fb534356a973\") " pod="openshift-must-gather-6hq9s/must-gather-cjqwl" Jul 08 18:59:18.158178 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:18.158149 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csgnv\" (UniqueName: \"kubernetes.io/projected/290bcdba-1a57-4af5-a2d5-fb534356a973-kube-api-access-csgnv\") pod \"must-gather-cjqwl\" (UID: \"290bcdba-1a57-4af5-a2d5-fb534356a973\") " pod="openshift-must-gather-6hq9s/must-gather-cjqwl" Jul 08 18:59:18.239026 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:18.238925 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hq9s/must-gather-cjqwl" Jul 08 18:59:18.370145 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:18.370120 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hq9s/must-gather-cjqwl"] Jul 08 18:59:18.372625 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:59:18.372590 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod290bcdba_1a57_4af5_a2d5_fb534356a973.slice/crio-5f29467f89f2d7a11667b06bb8841b236ec1e3dac3c3fcb723905be19c8cfecb WatchSource:0}: Error finding container 5f29467f89f2d7a11667b06bb8841b236ec1e3dac3c3fcb723905be19c8cfecb: Status 404 returned error can't find the container with id 5f29467f89f2d7a11667b06bb8841b236ec1e3dac3c3fcb723905be19c8cfecb Jul 08 18:59:18.374593 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:18.374574 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:59:19.324514 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:19.324473 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hq9s/must-gather-cjqwl" event={"ID":"290bcdba-1a57-4af5-a2d5-fb534356a973","Type":"ContainerStarted","Data":"9adf8bb062bbc968ea7e53405d3344999a745e6f854e79fb00f679f3b3331c8c"} Jul 08 18:59:19.325134 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:19.325093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hq9s/must-gather-cjqwl" event={"ID":"290bcdba-1a57-4af5-a2d5-fb534356a973","Type":"ContainerStarted","Data":"713d35a84a8f0ed19dfc57e88844e302cf454adb26c61d91d920f42ac346f97a"} Jul 08 18:59:19.325278 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:19.325142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hq9s/must-gather-cjqwl" event={"ID":"290bcdba-1a57-4af5-a2d5-fb534356a973","Type":"ContainerStarted","Data":"5f29467f89f2d7a11667b06bb8841b236ec1e3dac3c3fcb723905be19c8cfecb"} Jul 08 18:59:19.343863 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:19.343802 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6hq9s/must-gather-cjqwl" podStartSLOduration=1.715383809 podStartE2EDuration="2.343781509s" totalImagesPullingTime="628.3977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:19.343774316 +0000 UTC m=+2558.358001392" watchObservedRunningTime="2026-07-08 18:59:19.343781509 +0000 UTC m=+2558.358008586" Jul 08 18:59:20.592176 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:20.592127 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4tl96_ff0b27c4-6651-41d5-bbb0-9d13194da0ce/global-pull-secret-syncer/0.log" Jul 08 18:59:20.795163 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:20.795127 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rc4kr_e3e63b4f-08bb-4fa9-8581-3bc863976c06/konnectivity-agent/0.log" Jul 08 18:59:20.847245 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:20.847176 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-26.ec2.internal_537b291d55a88c57e658b0d66fcf4efc/haproxy/0.log" Jul 08 18:59:26.300558 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:26.300509 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f8df5968d-nzfbc_b39f6155-3853-408a-a153-8926cd63243a/authorino/0.log" Jul 08 18:59:26.587153 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:26.587057 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qvlnr_1b141795-8a18-47ae-a8d9-2845daca92d2/manager/0.log" Jul 08 18:59:26.611667 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:26.611644 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ch8jf_32baaa54-9d9f-4951-8bf6-073b278e1d83/limitador/0.log" Jul 08 18:59:28.548130 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:28.548096 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7lzkl_b3e981c9-3b91-482a-96d6-287793464594/cluster-monitoring-operator/0.log" Jul 08 18:59:28.799015 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:28.798941 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tsssm_1cc596df-6635-4c66-b662-907f98506766/node-exporter/0.log" Jul 08 18:59:28.831829 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:28.831787 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tsssm_1cc596df-6635-4c66-b662-907f98506766/kube-rbac-proxy/0.log" Jul 08 18:59:28.851492 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:28.851464 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tsssm_1cc596df-6635-4c66-b662-907f98506766/init-textfile/0.log" Jul 08 18:59:28.962449 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:28.962412 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-j8z7v_7b4e721c-1f42-41dd-a1d2-28a40ad445ed/kube-rbac-proxy-main/0.log" Jul 08 18:59:28.983914 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:28.983882 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-j8z7v_7b4e721c-1f42-41dd-a1d2-28a40ad445ed/kube-rbac-proxy-self/0.log" Jul 08 18:59:29.007482 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.007449 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-j8z7v_7b4e721c-1f42-41dd-a1d2-28a40ad445ed/openshift-state-metrics/0.log" Jul 08 18:59:29.043215 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.043182 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0143fcea-64ec-4d0c-8e93-9c43c5d48393/prometheus/0.log" Jul 08 18:59:29.067509 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.067431 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0143fcea-64ec-4d0c-8e93-9c43c5d48393/config-reloader/0.log" Jul 08 18:59:29.089036 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.089011 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0143fcea-64ec-4d0c-8e93-9c43c5d48393/thanos-sidecar/0.log" Jul 08 18:59:29.114896 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.114862 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0143fcea-64ec-4d0c-8e93-9c43c5d48393/kube-rbac-proxy-web/0.log" Jul 08 18:59:29.138633 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.138591 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0143fcea-64ec-4d0c-8e93-9c43c5d48393/kube-rbac-proxy/0.log" Jul 08 18:59:29.162784 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.162752 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0143fcea-64ec-4d0c-8e93-9c43c5d48393/kube-rbac-proxy-thanos/0.log" Jul 08 18:59:29.185349 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.185327 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0143fcea-64ec-4d0c-8e93-9c43c5d48393/init-config-reloader/0.log" Jul 08 18:59:29.216508 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.216457 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-m6vj6_8aa1b9d6-ce68-4e84-887a-0d162a1d816a/prometheus-operator/0.log" Jul 08 18:59:29.234567 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.234530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-m6vj6_8aa1b9d6-ce68-4e84-887a-0d162a1d816a/kube-rbac-proxy/0.log" Jul 08 18:59:29.359096 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.359020 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d68b49d4-42cwz_7fd593e5-048d-469c-855f-b8cacdeab66c/thanos-query/0.log" Jul 08 18:59:29.383634 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.383607 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d68b49d4-42cwz_7fd593e5-048d-469c-855f-b8cacdeab66c/kube-rbac-proxy-web/0.log" Jul 08 18:59:29.406601 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.406574 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d68b49d4-42cwz_7fd593e5-048d-469c-855f-b8cacdeab66c/kube-rbac-proxy/0.log" Jul 08 18:59:29.427421 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.427394 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d68b49d4-42cwz_7fd593e5-048d-469c-855f-b8cacdeab66c/prom-label-proxy/0.log" Jul 08 18:59:29.449836 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.449796 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d68b49d4-42cwz_7fd593e5-048d-469c-855f-b8cacdeab66c/kube-rbac-proxy-rules/0.log" Jul 08 18:59:29.472969 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:29.472943 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d68b49d4-42cwz_7fd593e5-048d-469c-855f-b8cacdeab66c/kube-rbac-proxy-metrics/0.log" Jul 08 18:59:30.616846 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.616809 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69"] Jul 08 18:59:30.620079 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.620050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.629413 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.629386 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69"] Jul 08 18:59:30.678398 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.677435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-lib-modules\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.678398 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.677495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-podres\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.678398 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.677593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-sys\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.678398 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.677620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ghr4\" (UniqueName: \"kubernetes.io/projected/abe7f4ab-1822-4994-aec7-824826627a54-kube-api-access-9ghr4\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.678398 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.677660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-proc\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.778546 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.778504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-lib-modules\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.778738 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.778568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-podres\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.778738 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.778654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-sys\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.778738 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.778683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ghr4\" (UniqueName: \"kubernetes.io/projected/abe7f4ab-1822-4994-aec7-824826627a54-kube-api-access-9ghr4\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.778738 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.778723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-proc\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.778991 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.778832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-proc\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.778991 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.778956 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-lib-modules\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.779104 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.779034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-podres\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.779104 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.779079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abe7f4ab-1822-4994-aec7-824826627a54-sys\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.788781 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.788744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ghr4\" (UniqueName: \"kubernetes.io/projected/abe7f4ab-1822-4994-aec7-824826627a54-kube-api-access-9ghr4\") pod \"perf-node-gather-daemonset-5qt69\" (UID: \"abe7f4ab-1822-4994-aec7-824826627a54\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:30.934275 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:30.934202 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:31.132436 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:31.132139 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69"] Jul 08 18:59:31.134868 ip-10-0-130-26 kubenswrapper[2576]: W0708 18:59:31.134834 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podabe7f4ab_1822_4994_aec7_824826627a54.slice/crio-89d27fbb8f05e6e9bb0b40ef37a76ab37fe62dd4c0fdfe46ed92490a4c64ecba WatchSource:0}: Error finding container 89d27fbb8f05e6e9bb0b40ef37a76ab37fe62dd4c0fdfe46ed92490a4c64ecba: Status 404 returned error can't find the container with id 89d27fbb8f05e6e9bb0b40ef37a76ab37fe62dd4c0fdfe46ed92490a4c64ecba Jul 08 18:59:31.316521 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:31.316491 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/2.log" Jul 08 18:59:31.322422 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:31.322388 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ft4kj_46c25403-0132-4dd9-8bdb-8698f003933f/console-operator/3.log" Jul 08 18:59:31.405232 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:31.405174 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" event={"ID":"abe7f4ab-1822-4994-aec7-824826627a54","Type":"ContainerStarted","Data":"f112677589cb22f5528fd35a055025cd5bc1dc3625622daac07e54f10dc92822"} Jul 08 18:59:31.405426 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:31.405258 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:31.405426 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:31.405286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" event={"ID":"abe7f4ab-1822-4994-aec7-824826627a54","Type":"ContainerStarted","Data":"89d27fbb8f05e6e9bb0b40ef37a76ab37fe62dd4c0fdfe46ed92490a4c64ecba"} Jul 08 18:59:32.434138 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:32.434114 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-26j6r_faecf749-b7f7-443b-8a0c-befc4e0800c8/volume-data-source-validator/0.log" Jul 08 18:59:33.506510 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:33.506469 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lqqxz_13a2bd72-57a5-4ee5-9ad4-b74f4702e655/dns/0.log" Jul 08 18:59:33.528447 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:33.528419 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lqqxz_13a2bd72-57a5-4ee5-9ad4-b74f4702e655/kube-rbac-proxy/0.log" Jul 08 18:59:33.624195 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:33.624165 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8dmgl_b7662b55-a0d9-457d-a19f-8b2b1db85a6f/dns-node-resolver/0.log" Jul 08 18:59:34.245500 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:34.245455 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zbmxw_72892583-5a63-47ab-bb5c-957e69be5460/node-ca/0.log" Jul 08 18:59:35.336608 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:35.336571 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57657c797d-r8gpd_1c7849d1-7d46-4875-a635-2ccad8950350/kube-auth-proxy/0.log" Jul 08 18:59:36.188308 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:36.188279 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rg8rh_c6350e06-e68e-4d24-94d5-785a4e570bb6/serve-healthcheck-canary/0.log" Jul 08 18:59:36.753789 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:36.753755 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gdg6l_e1fc28df-e4bd-4307-996b-310fb9ac9828/kube-rbac-proxy/0.log" Jul 08 18:59:36.773407 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:36.773383 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gdg6l_e1fc28df-e4bd-4307-996b-310fb9ac9828/exporter/0.log" Jul 08 18:59:36.794653 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:36.794624 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gdg6l_e1fc28df-e4bd-4307-996b-310fb9ac9828/extractor/0.log" Jul 08 18:59:37.422973 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:37.422944 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" Jul 08 18:59:37.441213 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:37.441161 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-5qt69" podStartSLOduration=7.441145304 podStartE2EDuration="7.441145304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:59:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:31.423182886 +0000 UTC m=+2570.437409965" watchObservedRunningTime="2026-07-08 18:59:37.441145304 +0000 UTC m=+2576.455372380" Jul 08 18:59:39.348678 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:39.348644 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-ds7m9_12f48164-c3aa-4af0-a914-97e08ff1b1e3/manager/0.log" Jul 08 18:59:39.369269 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:39.369234 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-ds7m9_12f48164-c3aa-4af0-a914-97e08ff1b1e3/copy-manifests/0.log" Jul 08 18:59:40.843165 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:40.843138 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85f5474f9b-5cvm2_c52026eb-3255-4f2f-941b-45f49227fbd3/manager/0.log" Jul 08 18:59:41.232577 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:41.232502 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57657c797d-r8gpd_1c7849d1-7d46-4875-a635-2ccad8950350/kube-auth-proxy/0.log" Jul 08 18:59:42.673664 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:42.673634 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57657c797d-r8gpd_1c7849d1-7d46-4875-a635-2ccad8950350/kube-auth-proxy/0.log" Jul 08 18:59:45.924236 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:45.924207 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-chmmh_b4fa2ab1-79bd-4a82-8c1e-bf7b21401fdd/migrator/0.log" Jul 08 18:59:45.945748 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:45.945718 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-chmmh_b4fa2ab1-79bd-4a82-8c1e-bf7b21401fdd/graceful-termination/0.log" Jul 08 18:59:46.299776 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:46.299747 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-rdcf4_2f0939a2-0489-42b6-8ccc-79b7488d5abc/kube-storage-version-migrator-operator/1.log" Jul 08 18:59:46.300644 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:46.300627 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-rdcf4_2f0939a2-0489-42b6-8ccc-79b7488d5abc/kube-storage-version-migrator-operator/0.log" Jul 08 18:59:47.287481 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:47.287450 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ws4q_c2e66deb-ce72-4b79-b05f-2a60a0c18c51/kube-multus-additional-cni-plugins/0.log" Jul 08 18:59:47.326842 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:47.326816 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ws4q_c2e66deb-ce72-4b79-b05f-2a60a0c18c51/egress-router-binary-copy/0.log" Jul 08 18:59:47.381967 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:47.381938 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ws4q_c2e66deb-ce72-4b79-b05f-2a60a0c18c51/cni-plugins/0.log" Jul 08 18:59:47.426877 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:47.426852 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ws4q_c2e66deb-ce72-4b79-b05f-2a60a0c18c51/bond-cni-plugin/0.log" Jul 08 18:59:47.485904 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:47.485824 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ws4q_c2e66deb-ce72-4b79-b05f-2a60a0c18c51/routeoverride-cni/0.log" Jul 08 18:59:47.507467 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:47.507439 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ws4q_c2e66deb-ce72-4b79-b05f-2a60a0c18c51/whereabouts-cni-bincopy/0.log" Jul 08 18:59:47.529435 ip-10-0-130-26 kubenswrapper[2576]: I0708 18:59:47.529410 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4ws4q_c2e66deb-ce72-4b79-b05f-2a60a0c18c51/whereabouts-cni/0.log"